DEV Community

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
My Web Scraper Died at 3 AM Because of reCAPTCHA
_ab214f84f83a01455a74b profile

My Web Scraper Died at 3 AM Because of reCAPTCHA

#automation #monitoring #programming #webscraping
Comments
6 min read
Building an Instagram Data Project Without Maintaining Scrapers
zubair_alibabur_48f21f84 profile

Building an Instagram Data Project Without Maintaining Scrapers

#api #automation #data #webscraping
Comments
2 min read
# Building Instagram OSINT Projects with HikerAPI
naraya_developer_ac9df3b0 profile

# Building Instagram OSINT Projects with HikerAPI

#python #api #webscraping
Comments
2 min read
Stop checking competitor prices manually — automate it with n8n (free workflow JSON)
flowkithq profile

Stop checking competitor prices manually — automate it with n8n (free workflow JSON)

#automation #nocode #productivity #webscraping
Comments
4 min read
Web Scraping with Node.js: Puppeteer vs Cheerio (Complete 2026 Guide)
akaranjkar08 profile

Web Scraping with Node.js: Puppeteer vs Cheerio (Complete 2026 Guide)

#webscraping #puppeteervs #nodejsscraping #puppeteerscraping
Comments
5 min read
Stop Scraping Betting Sites: How to Build a Real-Time Sports Tracker in Python
drengregious profile

Stop Scraping Betting Sites: How to Build a Real-Time Sports Tracker in Python

#api #python #tutorial #webscraping
Comments
3 min read
What I learned scraping 141 crypto cardholder agreements
sweepbase profile

What I learned scraping 141 crypto cardholder agreements

#webscraping #fintech #crypto #dataengineering
Comments
5 min read
Your LLM Pipeline Is Choking on Raw HTML. Here's the Fix.
rhymeswithlimo profile
Kimo

Your LLM Pipeline Is Choking on Raw HTML. Here's the Fix.

#llm #rag #webscraping #python
Comments
3 min read
How to Extract Structured Data from A Website
tinyfishie profile

How to Extract Structured Data from A Website

#webscraping #dataextraction #tutorial #playwright
Comments
8 min read
Synthesio charges $36K+/year for Chinese platform coverage. I built one for $0.045/mention.
sami_8858131362756585e4f4 profile
Sami

Synthesio charges $36K+/year for Chinese platform coverage. I built one for $0.045/mention.

#python #webscraping #china #analytics
Comments
8 min read
XCrawl vs Puppeteer vs Playwright: Which Web Scraping Tool Saves You More Time in 2026?
charles_90891cea4a1800830 profile

XCrawl vs Puppeteer vs Playwright: Which Web Scraping Tool Saves You More Time in 2026?

#webdev #javascript #comparison #webscraping
Comments
2 min read
How to Scrape JS-Rendered E-Commerce Pages Without Getting Blocked (2026 Guide)
charles_90891cea4a1800830 profile

How to Scrape JS-Rendered E-Commerce Pages Without Getting Blocked (2026 Guide)

#webdev #javascript #tutorial #webscraping
Comments
2 min read
Stop Building Fragile Scrapers — Build Actors Instead
sian-agency profile

Stop Building Fragile Scrapers — Build Actors Instead

#architecture #automation #python #webscraping
Comments
4 min read
AI-Powered Web Scraper
zahidkhan-xen profile

AI-Powered Web Scraper

#showdev #ai #automation #webscraping
Comments
4 min read
I scraped every **Show HN** post from May 2025 to May 2026 that crossed **200 points** and ran a quick analysis. There were 334 of them. Here is what landed.
sab0tajue profile

I scraped every **Show HN** post from May 2025 to May 2026 that crossed **200 points** and ran a quick analysis. There were 334 of them. Here is what landed.

#analytics #data #sideprojects #webscraping
Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.