Use case

Proxies for Transfermarkt: the terms, robots.txt, the bot check and the RSS feeds

Transfermarkt's terms forbid bots, spiders and screen scraping, and an open robots.txt is no permission. What the site offers instead: free RSS news feeds.

HProxy Team··Updated October 4, 2026·5 min read
HProxy.Use case

Free proxies won't hold up here.

Shared datacenter IPs get flagged and dropped fast. When it has to hold, gaming, streaming, accounts, you need mobile and residential IPs that read as a real device, from $0.44/GB, pay as you go.

See plans & pricing→

Transfermarkt's terms forbid its users to access or copy its content with bots, spiders, screen scraping or other automated processes. They also forbid using it to train AI. Its robots.txt lets crawlers in, but that file is not a permission. The site offers free RSS news feeds, and on the pages we read it offers no API. A proxy does not change what the terms allow.

What Transfermarkt's terms say

The terms of use cover transfermarkt.de "as well as all other country coded websites containing a 'Transfermarkt' URL". They print no date. The English copy that Common Crawl saved on 14 September 2026 matches the live page we read on 4 October 2026, from the heading through section 11.1.

rulewhat the terms say
scraping"The User is not permitted to access or copy the Digital Content using bots, spiders, screen scraping or other automated processes." (11.1)
AI trainingThe user may not use the content "for the training or development of artificial intelligence (AI), including language models, machine learning, neural networks or other AI systems". (11.1)
text and data mining"Uses for text and data mining (Section 44b UrhG) are expressly reserved." (11.1)
databasesAll rights to the site's "databases, and all material related to Transfermarkt reside exclusively with Transfermarkt". Programs and their contents may be used only "for the purposes stated in their license agreements". (3.2)
breachesThe site may "limit your user rights, issue a warning or ban your account temporarily or permanently". (5.1)

What robots.txt says

The robots.txt file of Transfermarkt was last modified on 1 October 2026. It has four groups:

crawlerwhat the file says
wget"Disallow: /", so the whole site is closed
Slurp"Crawl-delay: 2", so it is asked to wait two seconds between requests
Mediapartners-Googlean empty "Disallow:", so nothing is closed
every other crawler"Allow: /", so every path is open

It names no AI crawler. The standard behind the file, RFC 9309, says its rules "are not a form of access authorization". So an open robots.txt is no permission to scrape, and section 11.1 still applies.

What the site did when our server asked

Our server in St. Louis asked for the home page, the terms page and the RSS feed on 4 October 2026. Each answered HTTP 202 with an empty page and the header "x-amzn-waf-action: challenge". The robots.txt file answered normally.

AWS documents this as the Challenge action of its web firewall, where the client has to show that it is a browser "and not a bot". AWS sends its JavaScript check only to a request that asks for an HTML page. Ours did not, so each page came back empty. We did not run the check.

Is there a Transfermarkt API?

Not on the pages we read. The terms, the FAQ, the RSS guide and the site footer name no API and offer no data licence. The FAQ's questions about the data are about corrections, not reuse. The results titled "Transfermarkt API" in our searches were scraping services run by others.

What the site does offer is free RSS news feeds for ten of its country sites, such as transfermarkt.co.uk/rss/news. Its guide says each item brings the headline, the text and a link to the full news, and you can subscribe "directly in your browser or via your email client".

For questions, the terms and the FAQ give info@transfermarkt.de, for revoking a registration and for sending photos and club crests. No page we read names an address for data requests.

The pages that rank

The pages that rank for "transfermarkt scraper" include open source scrapers, scraper marketplaces, an R package, and the landing pages of scraping and proxy services. Several promise CAPTCHA solving, rotating fingerprints or residential IPs against blocks. None of the pages we read quotes section 11.1, and the three that mention the site's terms leave them to the user.

Where a proxy fits

For collecting Transfermarkt data, a proxy does not fit. Section 11.1 forbids bots, spiders and screen scraping, and a proxy only changes the address a request comes from. For the news, the free RSS feeds can be read in a browser or an email client, as the site describes.

For other work where a proxy is allowed, what a residential proxy is explains the type. How to check if a proxy is working shows how to test one. Residential traffic without city targeting starts at $0.44/GB, and every plan is on our pricing page.

The limits of this page

We read the terms, the FAQ and the RSS guide in Common Crawl's copies of 14 September 2026, because our server got the bot check. We compared that copy once with the live terms, from a home connection on 4 October 2026, and they read the same. We did not register, run the check, or collect any data. The terms print no date. This page is due for a check by 4 January 2027.

Sources

Every page below was read on 4 October 2026.

  • Transfermarkt, Terms of Use, sections 3.2, 5.1 and 11.1, live from a home connection in Germany and in Common Crawl's copy of 14 September 2026.
  • Transfermarkt, the "FAQ" and "RSS feeds" pages, in Common Crawl's copies of 14 September 2026.
  • The robots.txt file of transfermarkt.com, last modified 1 October 2026, read from our server in St. Louis.
  • IETF, RFC 9309: Robots Exclusion Protocol, September 2022.
  • AWS WAF Developer Guide, CAPTCHA and Challenge action behavior.
  • Our requests from our server in St. Louis on 4 October 2026, and one read of the live terms from a home connection in Germany, to compare them with the copy.

Frequently asked questions

Is it allowed to scrape Transfermarkt?
No. Section 11.1 of Transfermarkt's terms says a user may not access or copy its content with bots, spiders, screen scraping or other automated processes. Its robots.txt lets crawlers in, but the standard behind that file says its rules are not a form of access authorization.
Is there a Transfermarkt API?
Not on the pages we read. The terms, the FAQ, the RSS guide and the site footer name no API and offer no data licence. The results called a Transfermarkt API in our searches were scraping services run by others.
Why does my request to Transfermarkt get an empty 202 response?
Our server got exactly that on 4 October 2026: HTTP 202, an empty body and the header x-amzn-waf-action: challenge. AWS documents this as the Challenge action of its web firewall, which checks that the client is a browser. The terms forbid scraping in any case.
Can I use Transfermarkt data to train an AI model?
No. Section 11.1 forbids using the content to train or develop AI, including language models and machine learning. The same section reserves text and data mining under section 44b of the German Copyright Act.
Do I need a proxy for Transfermarkt?
No. The terms forbid automated access, whatever address it comes from, and the free RSS feeds can be read in a browser or an email client.

Proxies that don't die mid-job

Residential, ISP, datacenter and mobile, verified by the same engine that runs tens of millions of checks. They read as a real device and hold up under load. Pay as you go, and your balance never expires. $0.44/GB is the 2,000 GB+ rate; a single gigabyte is $0.50/GB, with no minimum order.

129M+ proxy checks run · 100+ countries · HTTP / HTTPS / SOCKS · re-checked every few minutes · no signup

HProxy.

Honest guides and comparisons on proxies, scraping and staying unblocked, from the team that runs the network.

RSS feed