About
I'm Surendra Tamang, a data engineer from Pokhara, Nepal. Since 2015 I've shipped 50+ production systems: scraper fleets crawling millions of pages a month, the pipelines that clean, deduplicate and store what they collect, and the APIs that serve it.
My specialty is the hard part of scraping — the anti-bot systems. Cloudflare, DataDome, Kasada, Imperva, Akamai, PerimeterX, F5 Shape. TLS fingerprinting, browser fingerprinting, rate-limit evasion, and the reverse engineering it takes to understand what a protection vendor is actually checking. I write about what I learn here.
The second hard part is what happens after week two: the site changes, the proxy pool burns, and nobody notices the pipeline returned zero rows. So every delivery ships with scheduling, monitoring, alerting and change history, not just a script.
I am Top Rated on Upwork and an Apify Ambassador. I run a small data engineering team, so I can take on larger builds and ongoing maintenance, not only one-off jobs.
What I work with
- Scraping: Python (Scrapy, asyncio, aiohttp), Playwright, Apify / Crawlee, residential proxies, fingerprint and session handling
- Pipelines: PostgreSQL, Snowflake, Airflow, Kafka, S3 / Parquet, incremental loads, data-quality checks
- Serving: FastAPI, Node / TypeScript, Docker / Kubernetes, GCP and AWS
- AI extraction: Claude and OpenAI APIs with schema validation and accuracy checks, so the model never invents a value
- Daily tooling: Claude Code, Git, and whatever a target site forces me to learn that week
Hire me
I take on scraping, data pipeline, API integration and AI extraction projects. Reach me on Upwork or email [email protected].