Skip to content

Issues: apify/crawlee

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

121 Open 779 Closed
121 Open 779 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Get rid of dependency on deprecated WMIC on Windows debt Code quality improvement or decrease of technical debt. t-tooling Issues with this label are in the ownership of the tooling team.
#2771 opened Dec 9, 2024 by janbuchar
Utilize queueHasLockedRequests to simplify RequestQueue v2 t-tooling Issues with this label are in the ownership of the tooling team.
#2767 opened Dec 6, 2024 by janbuchar
@janbuchar
Rust based HTTP client as an alternative for got-scraping Epic An epic is a large body of work that can be broken down into a number of smaller issues. feature Issues that represent new features or improvements to existing features. product roadmap Issues synchronized to product roadmap. t-tooling Issues with this label are in the ownership of the tooling team.
#2756 opened Nov 29, 2024 by B4nan
@barjin
1
RequestList messes up URLs containing characters like ' or * when populated with requestsFromUrl bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2755 opened Nov 29, 2024 by webrdaniel
1 task
1
feat: creating multiple unnamed queues feature Issues that represent new features or improvements to existing features. t-tooling Issues with this label are in the ownership of the tooling team.
#2752 opened Nov 22, 2024 by barjin 4.0
3
Crawling context sendRequest cookies can't be easily overriden bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2744 opened Nov 13, 2024 by MatousMarik
1 task done
@B4nan
Update eslint to v9, use new flat Apify eslint config t-tooling Issues with this label are in the ownership of the tooling team.
#2742 opened Nov 11, 2024 by jirimoravcik
Create Statistics.liveRetryHistorgram feature Issues that represent new features or improvements to existing features. t-tooling Issues with this label are in the ownership of the tooling team.
#2733 opened Nov 1, 2024 by metalwarrior665
Statistics.state.requestsRetries only updates after request is fully handled bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2732 opened Nov 1, 2024 by metalwarrior665
1 task
Don't enqueue over maxRequestsPerCrawl t-tooling Issues with this label are in the ownership of the tooling team.
#2728 opened Oct 29, 2024 by barjin 4.0
2
Performance issues with KVS holding lots of items locally t-tooling Issues with this label are in the ownership of the tooling team.
#2723 opened Oct 25, 2024 by B4nan 4.0
1
Make references in code documentation clickable inside IDE feature Issues that represent new features or improvements to existing features. t-tooling Issues with this label are in the ownership of the tooling team.
#2717 opened Oct 16, 2024 by tobice
@B4nan
Consider avoiding adding suffixes to files in MemoryStorageClient debt Code quality improvement or decrease of technical debt. t-tooling Issues with this label are in the ownership of the tooling team.
#2710 opened Oct 14, 2024 by janbuchar 4.0
9
Monitor mode feature Issues that represent new features or improvements to existing features. hacktoberfest help wanted Extra attention is needed. t-tooling Issues with this label are in the ownership of the tooling team.
#2680 opened Sep 26, 2024 by ImBIOS
1
3
Revisit API of storages t-tooling Issues with this label are in the ownership of the tooling team.
#2674 opened Sep 24, 2024 by janbuchar 4.0
5
remove all enums feature Issues that represent new features or improvements to existing features. t-tooling Issues with this label are in the ownership of the tooling team.
#2654 opened Sep 3, 2024 by ryanleecode
1
Failed to prolong lock for cached request. bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2653 opened Sep 2, 2024 by matrs
1 task
Implement max crawl depth feature Issues that represent new features or improvements to existing features. t-tooling Issues with this label are in the ownership of the tooling team.
#2633 opened Aug 26, 2024 by janbuchar
3
CheerioCrawler not persisting cookies bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2618 opened Aug 14, 2024 by taythebot
1 task
6
How do I re-crawl already processed requests for incremental crawling? feature Issues that represent new features or improvements to existing features.
#2611 opened Aug 12, 2024 by jezsung
Node crash on Crawlee running fs.stat on a request_queue lock file bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2606 opened Aug 7, 2024 by Clearmist
1 task
4
Support SOCKS proxy for CheerioCrawler feature Issues that represent new features or improvements to existing features. t-tooling Issues with this label are in the ownership of the tooling team.
#2599 opened Aug 2, 2024 by sushantdhiman
Form POST request returns error page using BasicCrawler, but works when using node-fetch bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2586 opened Jul 22, 2024 by Hamza5
1 task
Enqueue strategy check after redirects is not working with adaptive crawler bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2525 opened Jun 7, 2024 by B4nan
1 task done
@janbuchar
3
Bug? PlaywrightCrawler enqueueLinks fails after WWW redirect. bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2513 opened Jun 5, 2024 by obsidience
1 task
1
ProTip! Updated in the last three days: updated:>2024-12-10.