github.devotd.
NewData

scrapy/scrapy 2.19.0 — Python web crawling and scraping framework

scrapy/scrapy is a framework that crawls websites with Python to extract structured data, and its latest release on GitHub is 2.19.0.

Repositoryscrapy/scrapy ↗

scrapy/scrapy is a framework that crawls websites with Python to extract structured data, and its latest release on GitHub is 2.19.0.

GitHub description: Scrapy, a fast high-level web crawling & scraping framework for Python.

stars
★ 64.9K
Forks
12K
Language
Python
License
BSD-3-Clause
Latest release
2.19.0
Read original source ↗View on GitHub ↗

The latest release of scrapy/scrapy is 2.19.0. Scrapy is a web crawling and scraping framework written in Python — a tool that sweeps through websites and pulls out structured data.

Crawling is the work of moving around a site and collecting pages, while scraping is the work of extracting only the values you need from the pages you have gathered. Scrapy combines the two, focusing on extracting structured data from websites. The repository description says it is a fast, high-level web crawling and scraping framework for Python. The README states that it can be used on multiple platforms, that Python 3.11 or later is required, and that it is maintained by Zyte and several contributors. Installation is done with pip install scrapy, and usage can be found in the documentation. The implementation language is Python and the license is BSD-3-Clause. The repository was created on February 22, 2010 and has 64921 GitHub stars.

Still, there are limits to what can be judged from this record. There are no release notes or change list for 2.19.0, so it is impossible to know what this version fixed. No performance figures or evaluation criteria compared against other crawling tools are given either. The only score remaining is momentum 5.4, and the novelty, technology, and quality scores are empty. Aside from the fact that this is a long-running project and its cumulative star count, this record offers no evidence of the scale of improvement in this version. So it is better to check the release notes directly before deciding whether to adopt 2.19.0.