About the role

What will you do at bareinsights?

About the Role

This role sits at the core of a high-growth AI data infrastructure platform, owning the systems that keep web extraction fast and reliable against websites actively fighting back. You'll work on adversarial web-extraction infrastructure — anti-bot evasion, proxy rotation, browser/TLS fingerprinting, and CAPTCHA handling — so that the platform "just works" where others fail. You'll own real production systems from day one, not a backlog of tickets.

What You'll Do

Architect and manage proxy rotation, IP/session management, and egress-node isolation at scale.
Beat anti-bot and anti-scraping defenses, maintaining high success rates against sites that actively resist automated access.
Build and maintain browser/TLS fingerprint management and CAPTCHA/challenge-solving infrastructure.
Own the health, cost efficiency, and economics of the proxy layer end-to-end.
Debug hard, intermittent adversarial failures across the stack and make them stay fixed.

What We're Looking For

0–3 years of backend infrastructure or distributed systems experience, with demonstrated hands-on work in adversarial web-extraction as a dealbreaker requirement.
Production experience architecting proxy rotation, IP/session management, and egress-node isolation.
Hands-on experience bypassing aggressive anti-bot and anti-scraping defenses at scale.
Strong proficiency in Go and/or Python; TypeScript/Node.js a plus.
Solid networking fundamentals: TCP/IP, HTTP/2, connection pooling, and proxy orchestration.
Experience with Kubernetes, Docker, AWS, and Terraform for service deployment and scaling.
Familiarity with PostgreSQL, Redis, and Kafka in production environments.
Observability experience using Prometheus and Grafana; comfortable with on-call ownership.
Relentless about reliability and at home in messy, adversarial problem spaces.
Authorized to work in the United States without visa sponsorship.

Compensation

& Benefits

Salary range: $200,000 – $250,000 USD annually. Visa sponsorship is not available.

Location

Hybrid role based in the San Francisco Bay Area, CA. Candidates in other U.S. locations open to relocating to the SF Bay Area are welcome to apply.

Which skills does this role require?

GoPythonTypeScriptNode.jsProxy rotationBackend InfrastructureDistributed SystemsAdversarial Web-extractionAnti-bot EvasionProxy RotationBrowser FingerprintingTLS FingerprintingCAPTCHA HandlingEgress-node isolationAI Data InfrastructureJavaScript

Make your next move

Build a shortlist and prepare

Identify the requirements you can demonstrate, then choose examples from your work to discuss with the hiring team.

Build a focused shortlist before you applyCompare role requirements with your experience and give each application a clear reason.
Backend engineering jobsCompare current openings and review what to look for in this role.
Platform engineering jobsCompare current openings and review what to look for in this role.
Practice explaining your experience in an interviewRehearse your answers before meeting the hiring team.

Review the responsibilities and requirements before adding an opening to your shortlist.