Skip to content

All work

Print & fulfillment · United States

Order-Automation Scrapers

Print & fulfillment operator 2023 Scraper design 4 weeks Python

Staff were re-keying hundreds of daily orders from a supplier portal with no API.

Approach

  1. Reverse-engineered the portal

    Logged in like a human, traced every request, mapped the order pages. No API — so we build one on our side.

  2. Wrote resilient Playwright scrapers

    Retries, captcha handling, and deterministic selectors so the bot survives the portal's quarterly redesign.

  3. Normalized orders into the fulfillment schema

    Parsed every variant into the fulfillment system's canonical shape so downstream apps don't have to care where the data came from.

  4. Scheduled and alarmed it

    Ran on a cron on AWS with health pings and on-failure alerts. Silent success, loud failure.

Outcomes

Daily orders
100s
Manual entry
Zero
Build weeks
4
“Our team stopped re-keying orders overnight. They got their afternoons back.”
— Operations manager, print & fulfillment client

Stack

  • Python
  • Playwright
  • Postgres
  • AWS
Next case

Live Fish Auction Platform