Scrapy
From Wikipedia, the free encyclopedia
| Initial release | June 26, 2008 |
|---|---|
| Stable release | 0.16 / October 18, 2012 |
| Written in | Python |
| Operating system | Linux/Mac OS X/Windows |
| Type | Web crawler |
| License | BSD License |
| Website | scrapy.org |
Scrapy is a web crawling framework with support for web scraping. It is open-source and written in Python. It is controlled using command line tools, that can be used to trigger the scrapers written in Python.
Scrapy was born in Mydeco, where it was developed and maintained by Insophia and Mydeco employees. In 2011 Scrapinghub became the new official maintainer.[1] The first official release was in August 2008, and it has been continually improved since then.