Job Description
Job Description
Location: Cambridge, MA (Eastern Time / UTC -4) Relocation package available, remote options for out-of-state talent
Start date: ASAP
Languages: English (required)
About the Role
Pragmatike is hiring on behalf of a fast-growing AI startup recognized as a Top 10 GenAI company by GTM Capital, founded by MIT CSAIL researchers, a hub of innovation in systems and AI.
Were seeking Senior Infrastructure Engineers to build and optimize distributed training and inference systems that power cutting-edge AI at scale, directly influencing production workloads for Fortune 500 customers.
This is a rare opportunity to work at the frontier of AI infrastructure, solving unique challenges while shaping the backbone of a leading AI company. Youll own critical systems end-to-end and collaborate with world-class researchers and engineers.What Youll Do
- Design, build, and maintain scalable infrastructure for distributed AI pipelines.
- Optimize cloud-native systems for performance, reliability, and cost-efficiency.
- Automate deployment, monitoring, and orchestration of Kubernetes-based systems.
- Collaborate with research and product teams to turn AI models into production-grade systems.
- Contribute to architecture and strategy, mentoring peers and shaping the roadmap.
What Were Looking For
- 5+ years in DevOps, infrastructure, or platform engineering, ideally in AI/ML pipelines.
- Deep Kubernetes expertise (Helm charts, CRDs, controllers, operators).
- Hands-on experience with AWS, GCP, and Azure in distributed systems.
- Strong skills in CI/CD, infrastructure-as-code (Terraform, Helm, scripting).
- Familiarity with secure software delivery and artifact pipelines.
- Excellent collaborator with a track record of mentorship and cross-team impact.
Bonus Points
- Experience with large-scale ML training and inference workloads.
- Exposure to service meshes, zero-downtime deployments, hybrid cloud setups.
- Knowledge of security and compliance in distributed systems.
Why This Role Will Pivot Your Career
- Research pedigree: MIT CSAIL founders with breakthrough AI and systems contributions.
- Customer impact: Powering Fortune 500 clients.
- Industry momentum: Alumni of the lab have led major acquisitions (MosaicML Databricks, Run:AI Nvidia, W&B CoreWeave).
- Funding & growth: Oversubscribed seed round, next funding in 2026.
- Career growth & influence: Lead initiatives, shape infrastructure strategy, and impact production AI systems at scale.
- Culture & autonomy: Own critical systems while collaborating with world-class engineers.
- Aspirational impact: Solve frontier-level AI infrastructure challenges few engineers encounter.
Benefits
- Competitive salary & stock options
- Sign-on bonus
- Health, Dental, and Vision
- 401k
Pragmatike is an Equal Opportunity Employer and is committed to providing equal employment opportunities to all applicants without discrimination. We recruit on behalf of our clients and prohibit discrimination and harassment based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.We are committed to a fair and inclusive hiring process. We process your personal data solely for recruitment purposes, in accordance with applicable privacy laws, and maintain reasonable safeguards to protect your information. Your data may be shared with our client(s) for hiring consideration, but will not be disclosed to third parties outside of the recruitment process.