← All jobs

Senior Software Engineer, Observability Insights

CoreWeave · New York, NY / Sunnyvale, CA

On-site Senior
LangChainMCPObservabilityKubernetesPythonGoTool useDockerGPULatencyThroughputCI/CDAWSGCPAzureDeep learningNLPMulti-agentOrchestrationLLM-as-judgeLlamaIndexHugging FaceRAGEmbeddingsRerankingPineconeWeaviatepgvectorQdrantMilvusvLLMTritonTensorRTQuantizationLoRAPEFTRLHFDPODistillationPyTorchTensorFlow

CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted by leading AI labs, startups, and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs and turn compute into capability. Founded in 2017, CoreWeave became a publicly traded company (Nasdaq: CRWV) in March 2025. Learn more at  www.coreweave.com . What You’ll Do: Join CoreWeave’s Observability team, where we are building the next-generation insights layer for AI systems. Our team empowers internal and external users to understand, troubleshoot, and optimize complex AI workloads by transforming telemetry into actionable insights. About the role: As a Senior Software Engineer on the Observability Insights team, you will lead the development of agentic interfaces and product experiences that sit atop CoreWeave’s telemetry layer. You’ll design multi-tenant APIs, managed Grafana experiences, and MCP-based tool servers to help customers and internal teams interact with data in innovative ways. Collaborating closely with PMs and engineering leadership, your work will shape the end-to-end observability experience and influence how people engage with cutting-edge AI infrastructure. Who You Are: 6+ years of experience in software or infrastructure engineering building production-grade backend systems and distributed APIs. Strong focus on developer-facing infrastructure, with a customer-obsessed approach to SDKs, CLIs, and APIs. Proficient in reliability engineering, including fault-tolerant design, SLOs, error budgets, and multi-tenant system resilience. Familiar with observability systems such as ClickHouse, Loki, VictoriaMetrics, Prometheus, and Grafana. Experienced in agentic applications or LLM-based features, including grounding, tool calling, and operational safety. Comfortable writing

Apply on company site →