Skip to content
View siddharthkumarx's full-sized avatar

Block or report siddharthkumarx

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
siddharthkumarx/README.md

Siddharth Kumar, e-commerce price and availability data. Data from the shops you track flows into a scraper that fills your sheet every day. When a site changes, the scraper is fixed and the data keeps coming.

I build and maintain web scrapers for e-commerce price and availability data. You get prices and in-stock status from the sites you track, daily or weekly, as a Google Sheet or CSV file.

Sites change and scrapers break. When that happens, I fix it. That's part of the price, not an extra.

Work with me: siddharthkumar.com · Get a free sample

How it works

  1. You send the sites and the data you need.
  2. I send a free sample of 20 to 50 real rows, so you can check the data before you pay.
  3. You get a fixed price: per month for a regular feed, or once for a one-time file.
  4. Your data arrives on schedule, with a short note on what changed since the last run.

You always talk to me, from the first message to every delivery. I only collect public data: no logins and no personal data.

How I keep your data reliable

What I do Why it matters to you
Read the site's own data feed when there is one Faster, and less likely to break when the page design changes
Go through every results page You get the full catalogue, not just page 1
Retry failed requests One network error doesn't leave gaps in your data
Keep going when a product has a missing field One odd listing doesn't stop the whole run
Wait between requests Less load on the site, so fewer blocks
Fix the scraper when a site changes Your feed keeps arriving on schedule

Tools

Python · Playwright · requests · BeautifulSoup · SQL · Google Sheets

Contact

Pinned Loading

  1. ecommerce-price-monitor ecommerce-price-monitor Public

    Daily price, sale and stock monitor for 25 US Shopify stores: polite web scraping, prices checked against a second source, full history in Parquet, CSV, Google Sheets and a live dashboard. Python, …

    Python

  2. job-postings-pipeline job-postings-pipeline Public

    Daily web scraping and data engineering pipeline: every open job at 1,500 US tech companies, collected from public Greenhouse, Lever and Ashby job boards, tested with dbt and published as a free da…

    Python 1

  3. scrapeplanner scrapeplanner Public

    Point it at a URL; it reports the cheapest polite way to collect that site's data. Python CLI: reads robots.txt and sitemaps, detects the platform, public feeds and APIs, JSON-LD, embedded JSON and…

    Python

  4. scrapewatch scrapewatch Public

    Python