About the role
What will you do at Hercules?
What you'll do
Provision and optimize GPU compute across AWS, Azure, GCP, and specialized providers (CoreWeave, Lambda Labs), including Kubernetes GPU orchestration and hardware evaluation (NVIDIA H100/B200, AMD MI300X, Intel Gaudi)
Design and maintain IaC foundations (Terraform, Pulumi, Helm) for agentic AI systems, including agent orchestration platforms, RAG stacks, vector databases, and model serving endpoints
Implement policy-as-code guardrails (OPA, Sentinel, Kyverno) for autonomous agent workloads
Design and enforce zero-trust architectures with network segmentation, IAM/RBAC least-privilege, and secrets management (Vault, AWS Secrets Manager)
Configure and manage Cloudflare (or equivalent) for DDoS protection, WAF, bot management, SSL/TLS termination, and Zero Trust access
Manage DNS security (DNSSEC, DMARC, SPF, DKIM), certificate lifecycle, and API security controls (mTLS, token management)
Lead vulnerability management, penetration testing coordination, and CIS benchmarking
Partner with customer success teams to assess, secure, and threat-model customer deployment environments
Build and maintain CI/CD pipelines (GitHub Actions, GitLab CI) with integrated security scanning (SAST, DAST, SCA, container scanning)
Deploy and manage Kubernetes clusters across cloud and on-prem with security-hardened, GPU-enabled configurations
Implement observability (Prometheus, Grafana, Splunk, Datadog) and SIEM integrations
Lead incident response and drive compliance (SOC 2, ISO 27001, HIPAA, FedRAMP) through audit automation
Qualifications
- Proven expertise with Terraform/Pulumi, IaC, policy-as-code, and scripting (Python, Bash, PowerShell)
- Hands-on GPU compute provisioning across major cloud and specialized providers
- Experience with Cloudflare or equivalent CDN/WAF/DDoS platforms for perimeter security and Zero Trust
- Strong background in AWS, Azure, GCP, and on-prem infrastructure with secure architecture focus
- Proficiency in Kubernetes and Docker, including container security, GPU scheduling, and runtime protection
- Deep understanding of network security, zero-trust principles, IAM/RBAC, and secrets management
- CI/CD experience with integrated security scanning
- Ability to conduct security assessments, threat modeling, and work directly with customers
- Pay Range
- $175,000 - $230,000
Which skills does this role require?
Make your next move
Build a shortlist and prepare
Identify the requirements you can demonstrate, then choose examples from your work to discuss with the hiring team.
- Build a focused shortlist before you applyCompare role requirements with your experience and give each application a clear reason.
- Platform engineering jobsCompare current openings and review what to look for in this role.
- Practice explaining your experience in an interviewRehearse your answers before meeting the hiring team.
Other roles to compare
Review the responsibilities and requirements before adding an opening to your shortlist.
Infrastructure Engineer Sr. (Azure Cloud Product Team)
PNC · Pittsburgh, Pennsylvania, United States
Cloud Security Engineer - OCI (Oracle Cloud Infrastructure)
Workstreet · United States
Cloud Infrastructure Engineer - Kubernetes & KubeVirt (REF1242M)
Mirantis · Texas City, Texas, United States
Hybrid Infrastructure Engineer (Cloud Migration Lead)
Paramount Acceptance · Holladay, Utah, United States
Adaptive Network Infrastructure Security Engineer
V2X Inc · United States
Sr. Network Engineer, AI Infrastructure (Starshield)
SpaceX · Palo Alto, California, United States
Role information can change. Confirm current details on the original application page.
