Code

improve content-fetch#4221

Code

Merged

sywhb merged 10 commits intomainomnivore-app/omnivore:mainfrom fix/content-fetch-erroromnivore-app/omnivore:fix/content-fetch-errorCopy head branch name to clipboardJul 25, 2024

+164-308

Commits

Commits on Jul 24, 2024

• remove scrapingbee from content-fetch

  sywhb

  committed
  29a5b20

• remove unused dependencies

  sywhb

  committed
  066883a

• remove readability from content-fetch

  sywhb

  committed
  31fe4b6

• check if there are more than five items "created" within a minute instead of "saved"

  sywhb

  committed
  6776cdf

• add hour rate limiter middleware to the api router and allows max 600 requests per hour

  sywhb

  committed
  dee421d

• block failed domains

  sywhb

  committed
  0e0c4bd

Commits on Jul 25, 2024

• reduce bulk action batch size to 50

  sywhb

  committed
  6f12b5e

• Add an index of columns user_id and created_at to the library_item table for counting query

  sywhb

  committed
  465e5dc

• revert index

  sywhb

  committed
  c503b47

• rate limit save url action in redis: max 5 save urls in a minute

  sywhb

  committed
  156feb8