← All jobs

Backend Software Engineer — Data Platform & AI Data Products

Together AI · San Francisco

On-site
RAGEmbeddingsObservabilityPythonGoRustLLM-as-judgeEval harnessesMulti-agentOrchestration

About the Role You’ll join the Data Platform team, responsible for building the backend services and “data products” that power how data moves through the company. We create the core platform primitives — high-quality event streams, reliable access layers, and developer-friendly APIs/tools — so teams across the org can self-serve what they need and ship faster. You’ll contribute to backend services that create value from our company data, and help make our data platform more self-serve so product and engineering teams can easily create and operate event-driven architectures, publish/consume streams, define access models, and ship data products end-to-end. You’ll also work on LLM-adjacent services such as prompt categorization/taxonomy, enrichment, and metadata systems that turn raw telemetry into trusted, usable products — with mentorship and support from experienced engineers. Responsibilities Contribute to backend services that enhance the data platform’s capabilities (APIs, control planes, automation, governance). Help enable DIY workflows for teams across the company: Define/publish events and schemas Create/consume streams and subscriptions Establish access models (authz, row/field-level controls where applicable) Manage dataset/catalog metadata, lineage, versioning, and retention Contribute to end-to-end data products: ingestion → validation/quality → enrichment → serving (APIs/streams) → observability → adoption. Work on prompt categorization and enrichment services: taxonomy design, labeling workflows, classifier/rules integration, evaluation, drift/quality monitoring, and safe rollouts. Learn to own reliability: SLOs, alerting, performance/cost tuning, incident response, and postmortems. Partner cross-functionally with ML/LLM, infra, security, and product teams to define crisp contracts and deliver durable platform primitives. Requirements 0–4 years building production or project-based backend systems (internships, coursework, and personal projects count).

Apply on company site →