Breaking News: Thousands Of GitHub Accounts Hijacked With wfx-loot CI Secret
Read the Report
Learn How MCP Is Bypassing a Decade of Cloud Security Best Practices
Read the Report
Are you exposed? Connect a repo in minutes.
Scan your repos free

CVE-2021-41125

Scrapy is a high-level web crawling and scraping framework for Python. ...

Overview

Published
6 Oct 2021
Modified
17 Jun 2026
Medium CVE
1 Registry packages
4 OS packages
4 Linux distributions
Yes Fix available

Description

Scrapy is a high-level web crawling and scraping framework for Python. If you use HttpAuthMiddleware (i.e. the http_user and http_pass spider attributes) for HTTP authentication, all requests will expose your credentials to the request target. This includes requests generated by Scrapy components, such as robots.txt requests sent by Scrapy when the ROBOTSTXT_OBEY setting is set to True, or as requests reached through redirects. Upgrade to Scrapy 2.5.1 and use the new http_auth_domain spider attribute to control which domains are allowed to receive the configured HTTP authentication credentials. If you are using Scrapy 1.8 or a lower version, and upgrading to Scrapy 2.5.1 is not an option, you may upgrade to Scrapy 1.8.1 instead. If you cannot upgrade, set your HTTP authentication credentials on a per-request basis, using for example the w3lib.http.basic_auth_header function to convert your credentials into a value that you can assign to the Authorization header of your request, instead of defining your credentials globally using HttpAuthMiddleware.

Source: OX vulnerability database

Severity

6.5 · MEDIUM

CVSS 3.1 base score, scored by NVD.

Attack vector
Network
Attack complexity
Low
Privileges required
Low
User interaction
None
Scope
Unchanged
Confidentiality
High
Integrity
None
Availability
None

CVSS:3.1/AV:N/AC:L/PR:L/UI:N/S:U/C:H/I:N/A:N

Weakness: CWE-200, CWE-522

Affected packages · 1

Packages affected by CVE-2021-41125
EcosystemPackageVulnerableFixed in
PyPI scrapy <1.8.1>=2.0.0, <2.5.1 1.8.12.5.1

Open a package to see all its vulnerabilities.

Operating systems · 10 fixes

debian 6 releases · 1 package

fixed 6
python-scrapy
debian fixes for CVE-2021-41125
ReleasePackageFixed in
10 python-scrapy 1.5.1-1+deb10u1
11 python-scrapy 2.4.1-2+deb11u1
12 python-scrapy 2.5.1-1
13 python-scrapy 2.5.1-1
14 python-scrapy 2.5.1-1
9 python-scrapy 1.0.3-2+deb9u1

echo 1 release · 1 package

fixed 1
python-scrapy
echo fixes for CVE-2021-41125
ReleasePackageFixed in
python-scrapy 2.5.1-1

openSUSE 1 release · 1 package

fixed 1
python-scrapy-doc
openSUSE fixes for CVE-2021-41125
ReleasePackageFixed inAdvisory
Tumbleweed python-scrapy-doc +2 2.5.1-1.1 openSUSE-SU-2024:11558-1

ubuntu 2 releases · 1 package

fixed 2
python-scrapy
ubuntu fixes for CVE-2021-41125
ReleasePackageFixed in
18.04-ESM python-scrapy 1.5.0-1ubuntu0.1~esm1
20.04-ESM python-scrapy 1.7.3-1ubuntu0.1~esm1

References

OX Radar and Response Center

Find threats in your stack.

OX Radar can check high-priority threats, like critical package CVEs, against your context.

Each incident is marked Detected or Not Detected with a remediation plan and proof all tracked in the Response Center.