Getting Started To get us started, you will need to start a new Python3 project with and install Scrapy (a web scraping and web crawling library for Python).

To grab every Hackaday URL ever, [Alex] wrote a small Python script using the Beautiful Soup screen scraping library. The program starts on Hackaday’s main page and grabs every link to a ...