Skip to content
@scrapy-plugins

Scrapy Plugins

Plugins for the Scrapy framework

Pinned Loading

  1. scrapy-playwright scrapy-playwright Public

    🎭 Playwright integration for Scrapy

    Python 1.2k 142

  2. scrapy-spider-metadata scrapy-spider-metadata Public

    Python 5 3

  3. scrapy-zyte-api scrapy-zyte-api Public

    Zyte API integration for Scrapy

    Python 38 22

  4. scrapy-zyte-smartproxy scrapy-zyte-smartproxy Public

    Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy

    Python 364 90

Repositories

Showing 10 of 33 repositories
  • scrapy-playwright Public

    🎭 Playwright integration for Scrapy

    scrapy-plugins/scrapy-playwright’s past year of commit activity
    Python 1,247 BSD-3-Clause 142 17 1 Updated Aug 18, 2025
  • scrapy-zyte-api Public

    Zyte API integration for Scrapy

    scrapy-plugins/scrapy-zyte-api’s past year of commit activity
    Python 38 BSD-3-Clause 22 14 3 Updated Aug 8, 2025
  • scrapy-crawl-maps Public

    Scrapy plugin that allows defining the logic of a spider using a directed graph defined in JSON format.

    scrapy-plugins/scrapy-crawl-maps’s past year of commit activity
    2 BSD-3-Clause 0 0 1 Updated May 21, 2025
  • scrapy-plugins/scrapy-spider-metadata’s past year of commit activity
    Python 5 MIT 3 3 0 Updated Mar 24, 2025
  • scrapy-zyte-smartproxy Public

    Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy

    scrapy-plugins/scrapy-zyte-smartproxy’s past year of commit activity
    Python 364 BSD-3-Clause 90 7 (2 issues need help) 1 Updated Mar 24, 2025
  • scrapy-deltafetch Public

    Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls

    scrapy-plugins/scrapy-deltafetch’s past year of commit activity
    Python 273 48 13 4 Updated Feb 26, 2025
  • scrapy-plugins/scrapy-feedexporter-sftp’s past year of commit activity
    Python 6 BSD-3-Clause 4 0 0 Updated Feb 12, 2025
  • scrapy-splash Public

    Scrapy+Splash for JavaScript integration

    scrapy-plugins/scrapy-splash’s past year of commit activity
    Python 3,220 BSD-3-Clause 458 62 7 Updated Feb 11, 2025
  • scrapy-plugins/zyte-spidermon’s past year of commit activity
    Python 0 1 0 0 Updated Sep 5, 2024
  • scrapy-settings-log Public Forked from further-reading/scrapy-settings-log

    An extension that allows a user to display all or some of their scrapy spider settings at runtime.

    scrapy-plugins/scrapy-settings-log’s past year of commit activity
    Python 0 GPL-3.0 4 0 0 Updated Aug 20, 2024