What basic scraping library do you recommend

[rufuspollock]

@pudo given you have deprecated this what do you recommend for a library for basic retrieval, cache, retry? Or do you just use requests?

[pudo]

We've built our own at OCCRP (alephdata/memorious); but really I get the sense that buying into the Scrapy ecosystem is probably the way to go, even if it's way too prescriptive and and complex for my taste. It's just what everybody is using and would be able to satisfy needs like what you describe through their ecosystem.