Skip to content

Implement crawl_quotes (Pagination & Delay) #25

@ThomasKarpinski

Description

@ThomasKarpinski

Implement the crawling logic to iterate over multiple pages and handle polite scraping practices. Tasks:

  • Implement crawl_quotes() to handle pagination (for N pages or by tag).
  • Add a small delay (time.sleep(delay)) between requests.
  • Implement logic to stop crawling gracefully upon receiving a 404 error code.

Metadata

Metadata

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions