web scraping

Everything tagged web scraping.

121 articles

Topic web scraping

Free Rotating Proxies: What Exists, and How to Rotate a Free List

No free rotating proxy gateway holds up. What exists: trials, free quotas, Tor, and rotating a free list yourself, with tested Python code and measured decay.

September 26, 2026 · 8 min read

Proxies for Aider: installing the browser turns your proxy off

Aider's web command has two implementations. One reads your proxy variables, the other passes nothing, and an optional install decides which you get.

September 22, 2026 · 5 min read

Proxies for Camoufox: the proxy dict, geoip and one IP per browser

Camoufox matches timezone and locale to the proxy's IP with geoip=True, but looks the IP up once per process. Which proxy lines keep it right, in 0.5.6.

September 19, 2026 · 7 min read

Proxies for CrewAI: the scrape tool refuses them on purpose

CrewAI's ScrapeWebsiteTool ignores your proxy variables and raises if you pass one. Why that is deliberate, and the two routes that still work.

September 19, 2026 · 6 min read

Proxies for self-hosted Firecrawl: PROXY_SERVER and what it reaches

A self-hosted Firecrawl has no stealth proxies. Where PROXY_SERVER goes, which parts use it, and the checks that break it, read in v2.11.0 and main.

September 19, 2026 · 8 min read

Proxies for google-maps-scraper: what the list really does

The open source Google Maps scraper takes a proxy list in one flag. How v1.18.0 spends it: one address per browser, a login on every line, and the traps.

September 19, 2026 · 7 min read

Proxies for Lightpanda: the browser that takes the login

Lightpanda runs on libcurl, not Chrome, so its proxy takes a login in the address and SOCKS5 works. What the CDP proxy parameter really changes.

September 19, 2026 · 6 min read

Proxies for n8n: the node's Proxy option, HTTP_PROXY and NO_PROXY

n8n ignores a socks5:// proxy in the HTTP Request node, and HTTP_PROXY moves every node's traffic. Which proxy settings work, read in n8n 2.39.8.

September 19, 2026 · 7 min read

Proxies for nodriver: browser_args, create_context and the login

nodriver ignores a login in browser_args. Where a proxy with a username and password goes (create_context), and what its local forwarder does, in 0.50.3.

September 19, 2026 · 6 min read

Proxies for Playwright MCP: the proxy flag, the login and localhost

Playwright MCP drops a user:pass written into --proxy-server and sends localhost through the proxy. Where the proxy and its login go, read in the code.

September 19, 2026 · 8 min read

Proxies for Scrapling: proxy=, ProxyRotator and the three fetchers

Scrapling takes a proxy per fetcher, per session or through ProxyRotator. The formats, the rotation and where the password shows up, read in 0.4.15.

September 19, 2026 · 7 min read

Proxies for SeleniumBase: the proxy string, the login and Chrome 142

SeleniumBase takes a proxy as one string with the login inside. How each mode answers the login, what Chrome 142 changed, and how to run several at once.

September 19, 2026 · 6 min read

Proxies for yfinance: the setting moved, and what 429 means

yfinance 1.7.0 dropped the per-call proxy argument. Where the setting lives now, which shape of proxy Yahoo tolerates, and what a proxy does not fix.

September 19, 2026 · 6 min read

Anti-Captcha.com alternatives on cost per successful call

Weighing up Anti-Captcha? What is actually published, what it does not tell you, and how to settle the decision on your own target for a few dollars.

September 9, 2026 · 4 min read

Apify.com Pricing: What a Compute Unit Actually Costs

Apify bills in compute units, not requests. We read the published rates on 9 September 2026 and converted every tier into money per thousand successful calls.

September 9, 2026 · 10 min read

Coresignal.com alternatives without a monthly floor

Weighing up Coresignal? What is actually published, what it does not tell you, and how to settle the decision on your own target for a few dollars.

September 9, 2026 · 5 min read

Ficstar.com alternatives once credits are converted to requests

Comparing a Ficstar alternative? The published numbers, the questions their pricing page leaves open, and a ten minute test that beats every review.

September 9, 2026 · 4 min read

Firecrawl.dev Pricing: What a Credit Buys and What a Top-Up Costs

Firecrawl sells credits, and one credit is one page. We read the plans on 9 September 2026 and found top-up credits costing three times plan credits.

September 9, 2026 · 10 min read

Import.io alternatives without a monthly floor

A Import.io alternative, judged by a competitor who says so up front: the record we hold, the gaps in it, and the test that outranks this page.

September 9, 2026 · 4 min read

Nimble (nimbleway.com) Pricing: What Is Public and What Needs a Sales Call

Nimble publishes six API rates and a managed service starting at $30,000 a year. We read both price lists on 9 September 2026 and converted them.

September 9, 2026 · 7 min read

Octoparse.com Pricing: What a Task and a Cloud Process Cost

Octoparse advertises Standard from $69 a month and bills $83 monthly. We re-read the plans on 14 September 2026 and converted them to cost per task and per cloud process.

September 9, 2026 · 9 min read

Parsera.com alternatives on cost per successful call

Comparing a Parsera alternative? The published numbers, the questions their pricing page leaves open, and a ten minute test that beats every review.

September 9, 2026 · 3 min read

ScrapeBox.com alternatives on cost per successful call

Weighing up ScrapeBox? What is actually published, what it does not tell you, and how to settle the decision on your own target for a few dollars.

September 9, 2026 · 5 min read

Leaving ScrapeHero.com: what the same job costs elsewhere

Comparing a ScrapeHero alternative? The published numbers, the questions their pricing page leaves open, and a ten minute test that beats every review.

September 9, 2026 · 5 min read

Showing 1 to 24 of 121

Proxies that don't die mid-job

Residential, ISP, datacenter and mobile, verified by the same engine that runs tens of millions of checks. They read as a real device and hold up under load. Pay as you go, and your balance never expires. $0.44/GB is the 2,000 GB+ rate; a single gigabyte is $0.50/GB, with no minimum order.

129M+ proxy checks run · 100+ countries · HTTP / HTTPS / SOCKS · re-checked every few minutes · no signup

HProxy.

Honest guides and comparisons on proxies, scraping and staying unblocked, from the team that runs the network.

RSS feed