Broken Links Job Gets Rate Limited

[czarcas7ic]

Background

See #7752

Every error is from the job getting rate limited

Suggested Design

Change the job to only query x per second so it no longer gets rate limited

Acceptance Criteria

Broken link detector job detects broken links instead of getting rate limited

[deividaspetraitis]

It seems there is no available option to specify request limiting per interval i. One of possible solutions may be running checks more frequently ( let's say every few hours ) and let failed requests to be retried on the next run while succesfull ones can be cached, let's say for 24h. Feature to cache only successfully checked links was already proposed in lycheeverse/lychee#1400 including a pull request implementing proposed functionality. I was wondering, would that work for our case?

[czarcas7ic]

Surely there is an option to make the action run longer, but reduce the rate of requests right?

[czarcas7ic]

Tbh this doesn't need to run often, just need a general idea of we have broken links