The Scrapingdog Blog
Designed with you in mind, our web scraping tutorials cater to any skill level. Each guide is straightforward and packed with useful insights.
How To Use Proxy in Puppeteer (A Complete Guide)
TL;DR Set up Puppeteer with proxies; use page.authenticate() for private proxies. Ensure full loads with waitUntil (e.g., networkidle2 ) and timeouts;…
Mar 15, 2025 9 min readPuppeteer Stealth Mode: Scrape Without a Trace
TL;DR Puppeteer + stealth plugin reduces detection (patches UA, webdriver , plugins, WebGL, timezone). Install and enable; verify on bot.sannysoft.com…
Mar 15, 2025 21 min readAutomating Employee Extraction For A Company using Scrapingdog API
Access to employee details can help you pinpoint decision-makers & influencers in a company. Moreover, the employee list can help you with market…
Mar 13, 2025 3 min readAutomating Lead Generation using Scrapingdog Google Search API & Make.com
TL;DR Make.com flow + Scrapingdog Google Search API + search operators to pull Instagram “fashion influencer” emails from Google. AI step ( OpenRouter…
Mar 10, 2025 5 min readHow To Scrape Yelp Data using Python
TL;DR Step-by-step Python scrape of Yelp business details (name, address, rating, phone). Uses requests + BeautifulSoup : fetch HTML → parse → output…
Mar 4, 2025 6 min read5 Bright Data Alternatives for Web Scraping
TL;DR 2026 roundup: five economical Bright Data alternatives. Scrapingdog : scraping API + JSON outputs; handles proxies / headless / CAPTCHAs; unmetered…
Mar 4, 2025 5 min readScrape Linkedin Profiles using Python
TL;DR Scrape public LinkedIn profiles in Python using requests + public-page cookies (legal), but it’s fragile. Expect IP bans / cookie expiry leading to…
Mar 1, 2025 7 min readAutomate Content Briefing using Scrapingdog's Autocomplete API & Make.com
Content Marketing is one of the top channels for many businesses currently. According to a source , 82% of companies leverage content as one of the…
Feb 28, 2025 8 min readHow To Scrape Website with Cloudscraper in Python & Fix Common Errors
TL;DR Sets up cloudscraper ( Node.js interpreter, delay, browser emulation) to bypass Cloudflare, then parses with BeautifulSoup . Covers adding…
Feb 27, 2025 5 min readAnalysing Footfall Near British Museum By Scraping Popular Times Data from Google Maps
TL;DR Analyzes footfall near the British Museum using Google Maps “Popular Times”. Flow: collect nearby businesses, extract hourly popularity, average by…
Feb 25, 2025 7 min readAutomate Amazon Price Tracking Using Scrapingdog Amazon Scraper API & Make
TL;DR Build an automated Amazon price tracker with Make + Scrapingdog’s Amazon Scraper . Store ASIN / domain / country , fetch product data, use…
Feb 24, 2025 4 min readAutomating Scraping & Summarizing Research Papers with Python & OpenAI
TL;DR End-to-end Python flow: find papers on Google Scholar, scrape the full text, auto-summarize. Use Scrapingdog to get Scholar results, pick a link,…
Feb 21, 2025 7 min read
No articles found
Try a different keyword or category.
Try Scrapingdog for Free!
Get 200 free credits to spin the API. No credit card required!
Try Scrapingdog for Free!
Get 200 free credits to spin the API. No credit card required!