DEV Community

# webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
How to Handle JavaScript-Rendered Pages Without a Full Browser

How to Handle JavaScript-Rendered Pages Without a Full Browser

Comments
5 min read
Why Your Scraper Works in the Browser But Fails in Python

Why Your Scraper Works in the Browser But Fails in Python

Comments
7 min read
How to Scrape RedNote (Xiaohongshu) Without Coding

How to Scrape RedNote (Xiaohongshu) Without Coding

Comments
4 min read
How to monitor a brand across 5 Chinese social platforms with Python in 2026 — the cross-platform dedup problem and how to handle it

How to monitor a brand across 5 Chinese social platforms with Python in 2026 — the cross-platform dedup problem and how to handle it

Comments
4 min read
Bing Search API Replacement: scrape SERP results for $1.05/1K

Bing Search API Replacement: scrape SERP results for $1.05/1K

Comments
7 min read
Google AI Overview Tracker: 8-selector battery + citation drift telemetry

Google AI Overview Tracker: 8-selector battery + citation drift telemetry

Comments
8 min read
How to Scrape Reddit Without the API (After the 2023 Price Changes)

How to Scrape Reddit Without the API (After the 2023 Price Changes)

Comments
6 min read
Equity Crowdfunding Leads: scrape 4,800+ Wefunder founders for $5/1K

Equity Crowdfunding Leads: scrape 4,800+ Wefunder founders for $5/1K

Comments
7 min read
Bluesky Starter Pack Scraper: export any community list for $2.05/1K

Bluesky Starter Pack Scraper: export any community list for $2.05/1K

Comments
8 min read
DEV.to Scraper: pull articles by tag, author, or feed into clean JSON

DEV.to Scraper: pull articles by tag, author, or feed into clean JSON

Comments
8 min read
ATS Tech Stack Detector: pull company back-end stacks from jobs for $5.05/1K

ATS Tech Stack Detector: pull company back-end stacks from jobs for $5.05/1K

Comments
8 min read
arXiv Scraper: build a RAG-ready paper corpus for $1.50/1K

arXiv Scraper: build a RAG-ready paper corpus for $1.50/1K

Comments
7 min read
Google Ads Transparency Scraper: pull any competitor's ads for $1.20/1K

Google Ads Transparency Scraper: pull any competitor's ads for $1.20/1K

Comments
7 min read
Building Instagram Data Workflows with HikerAPI (Without Maintaining Scrapers)

Building Instagram Data Workflows with HikerAPI (Without Maintaining Scrapers)

Comments
3 min read
Choosing the Right Scraping Interface for LLM Workflows

Choosing the Right Scraping Interface for LLM Workflows

1
Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.