Scrapy (/ˈskreɪpaɪ/ SKRAY-peye) is a free and open-source web-crawling framework written in Python and developed in Cambuslang. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It is currently maintained by Zyte (formerly Scrapinghub), a web-scraping development and services company. Scrapy project architecture is built around "spiders", which are self-contained crawlers that are given a set of instructions. Following the spirit of other don't repeat yourself frameworks, such as Django, it makes it easier to build and scale large crawling projects by allowing developers to reuse their code. More information...
According to PR-model, scrapy.org is ranked 411,793rd in multilingual Wikipedia, in particular this website is ranked 407,049th in English Wikipedia.
The website is placed before ereau.de and after tjklunebooks.com in the BestRef global ranking of the most important sources of Wikipedia.