Test a Web Scraper using Responses

As mentioned in the introduction to web scraper testing, unit tests should be self-contained and not involve direct access to the target website. The responses
package allows you to easily mock the responses returned by a website, so it’s well suited to the job. The package is stable and well documented.