Company-location extraction at web scale
2021–2023
A web-scale crawler that finds a company's office address from its hostname, built for an external client.
Engineering
Web Scraping
I extracted business data at scale by crawling websites.
See its threads in the worldUsed on
Address-directory crawling estate
2020–2021
Crawling and address-extraction system that builds a directory of the physical locations of internet businesses from public web pages.
Supplement ingredient dataset
2021–2022
A knowledge base of supplement ingredients and synonyms plus a recogniser that finds them in free-text product listings, for an outside client.
Kray store rollouts
2023–2026
Work that puts Kray, an AI e-commerce search product, into real stores: a store cloner, demo store and grocery rollouts.
SEO analysis platform
2016–2021
SEO analysis product that crawls a customer site, analyses its pages and turns findings into assignable tasks for marketing teams.
Nutrition Label grocery analysis
2022
An internal product analysing ingredients across an online grocery catalogue, explaining each ingredient to shoppers.
Rental-listing change monitoring
2023
A scraper that watches rental listings every hour and posts new properties into the client's system, scoped as a pre-sales demonstration.
Market-analysis tool for a market-intelligence firm
2020–2023
A tool that shows who competes for a market in chosen locations and how visible each competitor is, for a market-intelligence firm.
Retail shopping automation
2023–2024
A bot that shops on a major online retailer through a cloud browser, placing orders without a person at the keyboard.
Goes with
Python
Docker
Kubernetes
Rate Limiting
Fault ToleranceThrow me a paper plane
Write a line; I’ll find it in my inbox.