New scraper: graphviz (also known as DOT language)#2607
Merged
simon04 merged 4 commits intofreeCodeCamp:mainfrom Oct 19, 2025
Merged
New scraper: graphviz (also known as DOT language)#2607simon04 merged 4 commits intofreeCodeCamp:mainfrom
simon04 merged 4 commits intofreeCodeCamp:mainfrom
Conversation
Closes: https://trello.com/c/Jaa1vC24 This is my second scraper. It's almost in a good shape, but I left a TODO comment because I couldn't figure out how to make UrlScraper reliably scrape the website. I keep getting random errors. Otherwise, it's ready for review.
Contributor
Author
|
If anyone can figure out a solution for the web scraper, feel free to modify this PR. It feels like 95% of the work is already done, and I appreciate if anyone else manages to contribute the remaining work. |
Contributor
|
I've implemented a very basic retry logic in 8e07071 and cbaedce when the error code is 0/500/501/502/503/504 to fix the sporadically occurring errors as the following: |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Closes: https://trello.com/c/Jaa1vC24
This is my second scraper. It's almost in a good shape, but I left a TODO comment because I couldn't figure out how to make UrlScraper reliably scrape the website. I keep getting random errors.
Otherwise, it's ready for review.
If you’re adding a new scraper, please ensure that you have:
public/icons/your_scraper_name/directory:16.png: a 16×16 pixel icon for the doc16@2x.png: a 32×32 pixel icon for the docSOURCE: A text file containing the URL to the page the image can be found on or the URL of the original image itself