Data & crawling · Built for a client · 2021–2023
Company-location extraction at web scale
A web-scale crawler that finds a company's office address from its hostname, built for an external client.
View in the worldWhat I did
- Wrote most of the code across the crawl, extraction and location-data stack
- Split throughput work into infrastructure scale and code efficiency, measured by pages crawled
- Built the accuracy measurement and held back tuning until it existed
Skills
Architecture Decision Records
Kubernetes
Docker
Client Engagement
PHPThrow me a paper plane
Write a line; I’ll find it in my inbox.