Staff Software Engineer, Platform

New Today

We're building the AI platform for underserved industries.
LLM usage has seen a meteoric rise in the past year, but there is still a significant gap between agentic innovation and its use in the real world. This is especially true for underserved industries like automotive and healthcare, where outdated systems persist due to barriers to entry, legacy software, and high-stakes consequences of hallucinations and failure.
Here at Toma (YC W24), we are bridging this gap by providing a customer-centric platform to deploy and monitor AI agents, even for non-technical users. We recently raised a $17M Series A from a16z and are building the future of human-AI interactions, starting in the automotive industry.
Our Team
We're assembling a team of Avengers: engineers, product managers, former founders, athletes, and leaders from Scale AI, Uber, Braze, Microsoft, Amazon, and more. We consider everyone regardless of their backgrounds or identities. Learn more about us here.
About this Role
We are seeking an experienced Software Engineer to join our team as one of the most senior engineers, with experience in scaling infrastructure for high-growth companies. This role will involve owning our infrastructure, modeling deployments, vendor relationships, and compliance initiatives. You will report directly to the CTO and be provided the opportunity to shape the roadmap, make critical technical decisions, and mentor junior engineers. This role is in-person in our SF office, 5 days a week.
What you will do Manage release deployments on AWS EKS/Porter Architect and build infrastructure to improve reliability and operational excellence Deploy and maintain self-hosted LLMs and other ML models Engage with software providers and develop long-term partnerships Preferred Qualifications Proficiency in TypeScript & Python Experience in low-level Node.js (Bun), Kubernetes, and instrumentation providers (Datadog, Sentry, Grafana, Prometheus, etc.) Strong utilization of LLMs and familiarity with prompt engineering Desire to continuously learn Benefits Competitive salary w/ meaningful equity Free health, dental, and vision insurance Free in-office lunch and dinners Monthly $200 wellness benefit Unlimited PTO
Location:
San Francisco, CA, United States
Category:
Computer And Mathematical Occupations