Skip to content

Crawl not starting for large list of urls #13

@MaxPensel

Description

@MaxPensel

Originally reported by @HeinPensel.

When attempting to initiate a crawl with 200+ start urls, the scrapy_wrapper does not start the crawl.

No error messages are known at this point, further analysis needed.

@HeinPensel: please share the list of urls that led to this failure, if it contains sensitive data, please do so privately.

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions