CVE-2021-41125
Scrapy HTTP Authentication Exposure
Description
Scrapy is a high-level web crawling and scraping framework for Python. If you use `HttpAuthMiddleware` (i.e. the `http_user` and `http_pass` spider attributes) for HTTP authentication, all requests will expose your credentials to the request target. This includes requests generated by Scrapy components, such as `robots.txt` requests sent by Scrapy when the `ROBOTSTXT_OBEY` setting is set to `True`, or as requests reached through redirects. Upgrade to Scrapy 2.5.1 and use the new `http_auth_domain` spider attribute to control which domains are allowed to receive the configured HTTP authentication credentials. If you are using Scrapy 1.8 or a lower version, and upgrading to Scrapy 2.5.1 is not an option, you may upgrade to Scrapy 1.8.1 instead. If you cannot upgrade, set your HTTP authentication credentials on a per-request basis, using for example the `w3lib.http.basic_auth_header` function to convert your credentials into a value that you can assign to the `Authorization` header of your request, instead of defining your credentials globally using `HttpAuthMiddleware`.
INFO
Published Date :
Oct. 6, 2021, 6:15 p.m.
Last Modified :
April 22, 2022, 4 p.m.
Source :
[email protected]
Remotely Exploitable :
Yes !
Impact Score :
3.6
Exploitability Score :
2.8
References to Advisories, Solutions, and Tools
Here, you will find a curated list of external links that provide in-depth
information, practical solutions, and valuable tools related to
CVE-2021-41125.
| URL | Resource |
|---|---|
| http://doc.scrapy.org/en/latest/topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.httpauth | Vendor Advisory |
| https://github.com/scrapy/scrapy/commit/b01d69a1bf48060daec8f751368622352d8b85a6 | Patch Third Party Advisory |
| https://github.com/scrapy/scrapy/security/advisories/GHSA-jwqp-28gf-p498 | Third Party Advisory |
| https://lists.debian.org/debian-lts-announce/2022/03/msg00021.html | Mailing List Third Party Advisory |
| https://w3lib.readthedocs.io/en/latest/w3lib.html#w3lib.http.basic_auth_header | Third Party Advisory |
We scan GitHub repositories to detect new proof-of-concept exploits. Following list is a collection of public exploits and proof-of-concepts, which have been published on GitHub (sorted by the most recently updated).
Results are limited to the first 15 repositories due to potential performance issues.
The following list is the news that have been mention
CVE-2021-41125 vulnerability anywhere in the article.
The following table lists the changes that have been made to the
CVE-2021-41125 vulnerability over time.
Vulnerability history details can be useful for understanding the evolution of a vulnerability, and for identifying the most recent changes that may impact the vulnerability's severity, exploitability, or other characteristics.
-
CVE Modified by [email protected]
May. 14, 2024
Action Type Old Value New Value -
Modified Analysis by [email protected]
Apr. 22, 2022
Action Type Old Value New Value Changed Reference Type https://lists.debian.org/debian-lts-announce/2022/03/msg00021.html No Types Assigned https://lists.debian.org/debian-lts-announce/2022/03/msg00021.html Mailing List, Third Party Advisory Added CWE NIST CWE-522 Added CPE Configuration OR *cpe:2.3:o:debian:debian_linux:9.0:*:*:*:*:*:*:* -
CVE Modified by [email protected]
Mar. 16, 2022
Action Type Old Value New Value Added Reference https://lists.debian.org/debian-lts-announce/2022/03/msg00021.html [No Types Assigned] -
Initial Analysis by [email protected]
Oct. 14, 2021
Action Type Old Value New Value Added CVSS V2 NIST (AV:N/AC:L/Au:S/C:P/I:N/A:N) Added CVSS V3.1 NIST AV:N/AC:L/PR:L/UI:N/S:U/C:H/I:N/A:N Changed Reference Type http://doc.scrapy.org/en/latest/topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.httpauth No Types Assigned http://doc.scrapy.org/en/latest/topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.httpauth Vendor Advisory Changed Reference Type https://github.com/scrapy/scrapy/commit/b01d69a1bf48060daec8f751368622352d8b85a6 No Types Assigned https://github.com/scrapy/scrapy/commit/b01d69a1bf48060daec8f751368622352d8b85a6 Patch, Third Party Advisory Changed Reference Type https://github.com/scrapy/scrapy/security/advisories/GHSA-jwqp-28gf-p498 No Types Assigned https://github.com/scrapy/scrapy/security/advisories/GHSA-jwqp-28gf-p498 Third Party Advisory Changed Reference Type https://w3lib.readthedocs.io/en/latest/w3lib.html#w3lib.http.basic_auth_header No Types Assigned https://w3lib.readthedocs.io/en/latest/w3lib.html#w3lib.http.basic_auth_header Third Party Advisory Added CPE Configuration OR *cpe:2.3:a:scrapy:scrapy:*:*:*:*:*:*:*:* versions up to (excluding) 1.8.1 *cpe:2.3:a:scrapy:scrapy:*:*:*:*:*:*:*:* versions from (including) 2.0.0 up to (excluding) 2.5.1
CWE - Common Weakness Enumeration
While CVE identifies
specific instances of vulnerabilities, CWE categorizes the common flaws or
weaknesses that can lead to vulnerabilities. CVE-2021-41125 is
associated with the following CWEs:
Common Attack Pattern Enumeration and Classification (CAPEC)
Common Attack Pattern Enumeration and Classification
(CAPEC)
stores attack patterns, which are descriptions of the common attributes and
approaches employed by adversaries to exploit the CVE-2021-41125
weaknesses.
Exploit Prediction
EPSS is a daily estimate of the probability of exploitation activity being observed over the next 30 days.
0.52 }} 0.15%
score
0.77202
percentile