Scrapy
Scrapy is a more robust, feature-complete, more extensible, and more maintained web scraping tool.
Scrapy allows you to crawl, extract, and store a full website. BeautilfulSoup on the other end only allows you to parse HTML and extract the information you're looking for.
However, Scrapy is much harder to use, this is why we suggest you check out this tutorial showing you how to start with Scrapy if you want to use it.
If you don't need to use Scrapy advanced features like multithreading or rate limiting you can use BeautifulSoup with a classic Python HTTP client .