← All jobs

Software Engineer, Inference Platform

Cerebras · Headquarters/Sunnyvale Office

On-site
OrchestrationObservabilityGPULatencyThroughputKubernetesCI/CDGoC++GCPAWSAzurePythonDockerRayMulti-agentTool use

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services. This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation. Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership https://openai.com/index/cerebras-partnership/ with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference. About the Role We're hiring a Software Engineer to help contribute to projects on our Inference Platform team. Our team primarily owns the orchestration layer that runs inference on our datacenter clusters, connecting cloud components with machine learning services. We are often the first team to face problems that haven't been solved yet, leading solutions across Kubernetes operators, service security policies, and CI/CD. If you're interested in building the next-generation architecture of a globally distributed inference platform, we'd like to talk. Responsibilities - Design, develop, test, and maintain production software, with responsibilities spanning testing, continuous development, observability, security, networking, debugging, and productionization. - Platform Direction. Help shape the technical direction for the Inference Platform, Kubernetes custom resource definitions, failure domains, service boundaries, and system evolution over time, and own the roadmap for major technical areas. - Reliability & Performance. Architect active-active systems with rapid failover, graceful degradation, and clear SLOs. Drive system-level improvements in latency, throughput, capacity efficiency, and resilience under unpredictable

Apply on company site →