About the role

As an IT (Sys Admin) Engineer, you will be working across identity, devices, SaaS platforms, and supporting end users. You should be organized, collaborative, and eager to learn while working within established systems and processes.

Remote Working 2-3 days a week in the office Amsterdam.

Responsibilities 

• Provide reliable, hands-on IT support for our in-office and remote employees by efficiently resolving Help Desk tickets while delivering excellent customer service.
• Support Together’s MDM fleet comprising macOS and some Linux devices.
• Provide in-office support by troubleshooting basic network issues and our A/V systems.
• Help manage and optimize Okta and our core SaaS tooling by administering and improving integrations and role-based access controls.
• Support daily procurement and asset management operations by coordinating hardware purchasing and tracking while maintaining accurate asset inventory and device assignments throughout their lifecycle (purchase to decommission).
• Help maintain clear, organized, and accessible IT documentation by creating easy-to-understand technical documentation for both technical and non-technical audiences.
• Contribute to IT initiatives by supporting project execution, managing priorities, and ensuring clear communication with stakeholders through regular updates.
• Help maintain a secure environment by supporting basic security hygiene to include access reviews and basic identity security tasks.
• Support onboarding and offboarding of Together employees, interns, and contractors.
• Support the IT team by creating reliable automations that reduce manual work and improve operational efficiency.
• Collaborates well with a team, but also able to work autonomously when needed: working in tandem with other locations and having consistency in practices, documentation, asset mgmt.,etc.

Requirements

• Practical experience administering Okta, including users, groups, and basic app integrations (Terraform a plus).
• Strong knowledge of Google Workspace.
• Hands-on MDM experience with macOS, ideally with FleetDM.
• Ability to support macOS, Linux, iOS, and Android devices.
• Experience participating in procurement and asset management processes.
• Clear, concise technical writing skills for documentation and knowledge base content.
• Excellent communication and customer service abilities.
• Basic understanding of security principles and best practices.
• Experience with low‑code automation tools (Serval, Okta Workflows, Gumloop).
• Scripting familiarity with common languages (Bash, Python).
• Understanding of API integrations and webhooks and how to use them effectively.
• Experience with AWS provisioning and Identity Center

Nice To Haves

• Exposure to security and compliance frameworks (SOC 2, ISO 27001, NIST, CIS, FedRAMP).
• Experience with AI tools, agents, MCPs, automations, and prompting. 
• Familiarity with Notion and Linear for documentation and project management.
• HRIS integration experience with systems like HiBob and Workday.

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy 

About the Role

As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software engineer that applies sound engineering principles, operational discipline, and mature automation to our operating environments and codebase.

You specialize in systems (operating systems, storage subsystems, networking), while implementing best practices for availability, reliability and scalability, with varied interests in algorithms and distributed systems.

Responsibilities

• Participate in on-call rotation (Pagerduty) to respond to production incidents
• Build and run our infrastructure with Ansible, Terraform, and Kubernetes to enable scaling to a massive number of concurrent users
• Build monitoring systems to ensure the highest quality service for our customers
• Design and implement operational processes (such as deployments and upgrades)
• Debug production issues across all services and levels of the stack
• Identify improvements for the product architecture from the reliability, performance and availability perspectives 
• Plan the growth of Together AI’s infrastructure

Requirements

• 5+ years of professional AI Infra or related experience
• Bachelor's degree in Computer Science or a related field or equivalent work experience
• Knowledge of Ansible (roles, playbooks), Terraform, and Kubernetes
• Proficiency in programming/scripting languages
• Direct experience in monitoring and observability practices
• Knowledge of cloud services
• Ability to thrive in a collaborative environment involving different stakeholders and subject matter experts

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $190,000 - $270,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

As a AI Infrastructure Engineer (SRE) at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software engineer that applies sound engineering principles, operational discipline, and mature automation to our operating environments and codebase.

You specialize in systems (operating systems, storage subsystems, networking), while implementing best practices for availability, reliability and scalability, with varied interests in algorithms and distributed systems.

Requirements

• 7+ years of professional SRE or related experience
• Bachelor's degree in Computer Science or a related field or equivalent work experience
• Expert knowledge of Ansible (roles, playbooks), Terraform, and Kubernetes
• Proficiency in programming/scripting languages
• Direct experience in monitoring and observability practices
• Advanced knowledge of cloud services
• Ability to thrive in a collaborative environment involving different stakeholders and subject matter experts

Responsibilities

• Be on an on-call (PagerDuty) rotation to respond to incidents that impact availability
• Build and run our infrastructure with Ansible, Terraform, and Kubernetes to enable scaling to a massive number of concurrent users
• Build monitoring systems to ensure the highest quality service for our customers
• Design and implement operational processes (such as deployments and upgrades)
• Debug production issues across all services and levels of the stack
• Identify improvements for the product architecture from the reliability, performance and availability perspectives 
• Plan the growth of Together AI’s infrastructure

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

About the Role

The Turbo team sits at the intersection of efficient inference (algorithms, architectures, engines) and post‑training / RL systems. We build and operate the systems behind Together’s API, including high‑performance inference and RL/post‑training engines that can run at production scale.

Our mandate is to push the frontier of efficient inference and RL‑driven training: making models dramatically faster and cheaper to run, while improving their capabilities through RL‑based post‑training (e.g., GRPO‑style objectives). This work lives at the interface of algorithms and systems: asynchronous RL, rollout collection, scheduling, and batching all interact with engine design, creating many knobs to tune across the RL algorithm, training loop, and inference stack. Much of the job is modifying production inference systems—for example, SGLang‑ or vLLM‑style serving stacks and speculative decoding systems such as ATLAS—grounded in a strong understanding of post‑training and inference theory, rather than purely theoretical algorithm design.

You’ll work across the stack—from RL algorithms and training engines to kernels and serving systems—to build and improve frontier models via RL pipelines. People on this team are often spiky: some are more RL‑first, some are more systems‑first. Depth in one of these areas plus appetite to collaborate across (and grow toward more full‑stack ownership over time) is ideal.

Requirements

We don’t expect anyone to check every box below. People on this team typically have deep expertise in one or more areas and enough breadth (or interest) to work effectively across the stack. The closer you are to full‑stack (inference + post‑training/RL + systems), the stronger the fit—but being spiky in one area and eager to grow is absolutely okay.

You might be a good fit if you:

• Have strong expertise in at least one of the following, and are excited to collaborate across (and grow into) the others:
• Systems‑first profile: Large‑scale inference systems (e.g., SGLang, vLLM, FasterTransformer, TensorRT, custom engines, or similar), GPU performance, distributed serving.
• RL‑first profile: RL / post‑training for LLMs or large models (e.g., GRPO, RLHF/RLAIF, DPO‑like methods, reward modeling), and using these to train or fine‑tune real models.
• Model architecture design for Transformers or other large neural nets.
• Distributed systems / high‑performance computing for ML.
• Are comfortable working from algorithms to engines:
• Strong coding ability in Python
• Experience profiling and optimizing performance across GPU, networking, and memory layers.
• Able to take a new sampling method, scheduler, or RL update and turn it into a production‑grade implementation in the engine and/or training stack.
• Have a solid research foundation in your area(s) of depth:
• Track record of impactful work in ML systems, RL, or large‑scale model training (papers, open‑source projects, or production systems).
• Can read new RL / post‑training papers, understand their implications on the stack, and design minimal, correct changes in the right layer (training engine vs. inference engine vs. data / API).
• Operate well as a full‑stack problem solver:
• You naturally ask: “Where in the stack is this really bottlenecked?”
• You enjoy collaborating with infra, research, and product teams, and you care about both scientific quality and user‑visible wins.

Minimum qualifications

• 3+ years of experience working on ML systems, large‑scale model training, inference, or adjacent areas (or equivalent experience via research / open source).
• Advanced degree in Computer Science, EE, or a related field, or equivalent practical experience.
• Demonstrated experience owning complex technical projects end‑to‑end.

If you’re excited about the role and strong in some of these areas, we encourage you to apply even if you don’t meet every single requirement.

Responsibilities

• Advance inference efficiency end‑to‑end
• Design and prototype algorithms, architectures, and scheduling strategies for low‑latency, high‑throughput inference.
• Implement and maintain changes in high‑performance inference engines (e.g., SGLang‑ or vLLM‑style systems and Together’s inference stack), including kernel backends, speculative decoding (e.g., ATLAS), quantization, etc.
• Profile and optimize performance across GPU, networking, and memory layers to improve latency, throughput, and cost.
• Unify inference with RL / post‑training
• Design and operate RL and post‑training pipelines (e.g., RLHF, RLAIF, GRPO, DPO‑style methods, reward modeling) where 90+% of the cost is inference, jointly optimizing algorithms and systems.
• Make RL and post‑training workloads more efficient with inference‑aware training loops—for example, async RL rollouts, speculative decoding, and other techniques that make large‑scale rollout collection and evaluation cheaper.
• Use these pipelines to train, evaluate, and iterate on frontier models on top of our inference stack.
• Co‑design algorithms and infrastructure so that objectives, rollout collection, and evaluation are tightly coupled to efficient inference, and quickly identify bottlenecks across the training engine, inference engine, data pipeline, and user‑facing layers.
• Run ablations and scale‑up experiments to understand trade‑offs between model quality, latency, throughput, and cost, and feed these insights back into model, RL, and system design.
• Own critical systems at production scale
• Profile, debug, and optimize inference and post‑training services under real production workloads.
• Drive roadmap items that require real engine modification—changing kernels, memory layouts, scheduling logic, and APIs as needed.
• Establish metrics, benchmarks, and experimentation frameworks to validate improvements rigorously.
• Provide technical leadership (Staff level)
• Set technical direction for cross‑team efforts at the intersection of inference, RL, and post‑training.
• Mentor other engineers and researchers on full‑stack ML systems work and performance engineering.

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $200,000 - $280,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

About the Role

You’ll join the Data Platform team, responsible for building the backend services and “data products” that power how data moves through the company. We create the core platform primitives - high-quality event streams, reliable access layers, and developer-friendly APIs/tools - so teams across the org can self-serve what they need and ship faster. You’ll design, build, and run backend services that create value from our company data, and make our data platform more self-serve (DIY)- so product and engineering teams can easily create and operate event-driven architectures, publish/consume streams, define access models, and ship data products end-to-end. You’ll also build LLM-adjacent services such as prompt categorization/taxonomy, enrichment, and metadata systems that turn raw telemetry into trusted, usable products.

Responsibilities

• Identify, design, and develop foundational data infrastructure components capable of handling millions or billions of events daily
• Analyze and improve the robustness and scalability of existing data processing infrastructure
• Partner with product teams to understand functional requirements and deliver solutions that meet business needs
• Write clear, well-tested, and maintainable infra-as-code and software for both new and existing systems
• Conduct design and code reviews, create developer documentation, and develop testing strategies for robustness and fault tolerance
• Participate in an on-call rotation to address critical incidents when necessary

Requirements

• 6+ years building production backend systems (distributed systems, APIs, data services).
• Strong skills in at least one backend language (e.g., Go, Python, Java, Rust) and API design (REST/gRPC).
• Demonstrated ability to own services end-to-end: design docs, implementation, testing, deployment, on-call, and iteration based on real usage.
• Strong engineering fundamentals: clean, maintainable code, thoughtful abstractions, strong design patterns, and systems that are easy to evolve.
• Solid data modeling and query skills (SQL) and experience with at least one of:

• • Streaming/eventing (Kafka/PubSub/Kinesis, etc.)
  • Workflow/compute (Airflow/Spark/Flink/Trino, etc.)
  • OLTP/OLAP stores and data lakes (Postgres + warehouse/lake tech)

• AI augmentation mindset:
  • You understand the state-of-the-art ways engineers use AI/LLMs to build software faster and better (e.g., coding copilots, agentic workflows, eval-driven iteration, retrieval/knowledge grounding), and you apply this thoughtfully to your own development and to the systems you build.
  • You have engineering judgment and you understand when AI Augmentation can fail or create team dynamics issues, putting mitigation mechanisms and guardrails in place.

Nice to have

• Experience building self-serve platforms (control planes, templates/golden paths, paved roads, multi-tenant services).
• LLM/AI product exposure: prompt/response telemetry, eval datasets, embeddings/RAG metadata, model/tool traces, privacy-safe logging.
• Security and governance experience: least-privilege access, auditability, data retention, PII handling.

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $160,000 - $240,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

About the role

As a Customer Support Engineer at a pioneering AI company, you'll be the first line of defense to support customers as they build out training, fine tuning, and inference solutions with Together AI. You'll dive deep into complex technical challenges, providing swift and effective solutions while serving as a product expert. As a part of the Customer Experience organization, you will collaborate closely with product and sales, driving continuous improvement of our offerings. This is an exciting opportunity for a deeply technical professional passionate about AI and customer success to make a significant impact in a fast-paced, innovative environment.

Responsibilities

• Engage directly with customers to tackle and resolve complex technical challenges involving our cutting-edge Kubernetes GPU clusters; ensure swift and effective solutions every time.
• Become a product expert in our GPU Cluster service, serving as the last line of technical defense before issues are escalated to Engineering and Product teams.
• Collaborate seamlessly across Engineering, Research, and Product teams to address customer concerns; collaborate with senior leaders both internally and externally to ensure the highest levels of customer satisfaction.
• Transform customer insights into action by identifying patterns in support cases and working with Engineering and Go-To-Market teams to drive Together’s roadmap (e.g., future models to support)
• Maintain detailed documentation of system configurations, procedures, troubleshooting guides, and FAQs to facilitate knowledge sharing with team and customers.
• Be flexible in providing support coverage during holidays, nights and weekends as required by business needs to ensure consistent and reliable service for our customers.

Requirements

• 3+ years of experience in a customer-facing technical role with at least 1 year in a support function in AI or supporting a mission-critical API in SaaS
• Strong technical background, with knowledge of AI, ML, GPU technologies and their integration into high-performance computing (HPC) environments.
• Familiarity with infrastructure services (e.g., Kubernetes, SLURM), infrastructure as code solutions (e.g., Ansible) high-performance network fabrics, NFS-based storage management, container infrastructure, and scripting and programming languages.
• Foundational understanding in the installation, configuration, administration, troubleshooting, and securing of compute clusters.
• Complex technical problem solving and troubleshooting, with a proactive approach to issue resolution
• Ability to work cross-functionally with teams such as Sales, Engineering, Support, Product and Research to drive customer success.
• Strong sense of ownership and willingness to learn new skills to ensure both team and customer success.
• Excellent communication and interpersonal skills, with the ability to explain complex technical concepts to non-technical stakeholders.
• Ability to operate in dynamic environments, adept at managing multiple projects, and comfortable with frequent context switching and prioritization.

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure. 

Compensation

We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $160,000-230,000K + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our Privacy Policy at https://www.together.ai/privacy

About the Role

As a Customer Support Engineer at a pioneering AI company, you'll be the first line of defense to support customers as they build out training, fine tuning, and inference solutions with Together AI. You'll dive deep into complex technical challenges, providing swift and effective solutions while serving as a product expert. As a part of the Customer Experience organization, you will collaborate closely with product and sales, driving continuous improvement of our offerings. This is an exciting opportunity for a deeply technical professional passionate about AI and customer success to make a significant impact in a fast-paced, innovative environment.

Responsibilities

• Engage directly with customers to tackle and resolve complex technical challenges involving our cutting-edge Kubernetes GPU clusters; ensure swift and effective solutions every time.
• Become a product expert in our GPU Cluster service, serving as the last line of technical defense before issues are escalated to Engineering and Product teams.
• Collaborate seamlessly across Engineering, Research, and Product teams to address customer concerns; collaborate with senior leaders both internally and externally to ensure the highest levels of customer satisfaction.
• Transform customer insights into action by identifying patterns in support cases and working with Engineering and Go-To-Market teams to drive Together’s roadmap (e.g., future models to support)
• Maintain detailed documentation of system configurations, procedures, troubleshooting guides, and FAQs to facilitate knowledge sharing with team and customers.
• Be flexible in providing support coverage during holidays, nights and weekends as required by business needs to ensure consistent and reliable service for our customers.

Requirements

• 3+ years of experience in a customer-facing technical role with at least 1 year in a support function in AI or supporting a mission-critical API in SaaS
• Strong technical background, with knowledge of AI, ML, GPU technologies and their integration into high-performance computing (HPC) environments.
• Familiarity with infrastructure services (e.g., Kubernetes, SLURM), infrastructure as code solutions (e.g., Ansible) high-performance network fabrics, NFS-based storage management, container infrastructure, and scripting and programming languages.
• Foundational understanding in the installation, configuration, administration, troubleshooting, and securing of compute clusters.
• Complex technical problem solving and troubleshooting, with a proactive approach to issue resolution
• Ability to work cross-functionally with teams such as Sales, Engineering, Support, Product and Research to drive customer success.
• Strong sense of ownership and willingness to learn new skills to ensure both team and customer success.
• Excellent communication and interpersonal skills, with the ability to explain complex technical concepts to non-technical stakeholders.
• Ability to operate in dynamic environments, adept at managing multiple projects, and comfortable with frequent context switching and prioritization.

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure. 

Working Schedule

This position operates on a non-standard workweek to support business needs. The schedule will be either Saturday–Wednesday or Wednesday–Sunday, with two weekly off days.

Compensation

We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work for the respective hiring region. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

About the Role

As a Customer Support Engineer at a pioneering AI company, you'll be the first line of defense to support customers as they build out training, fine tuning, and inference solutions with Together AI. You'll dive deep into complex technical challenges, providing swift and effective solutions while serving as a product expert. As a part of the Customer Experience organization, you will collaborate closely with product and sales, driving continuous improvement of our offerings. This is an exciting opportunity for a deeply technical professional passionate about AI and customer success to make a significant impact in a fast-paced, innovative environment.

Responsibilities

• Engage directly with customers to tackle and resolve complex technical challenges involving our cutting-edge GPU clusters and our inference and fine-tuning services; ensure swift and effective solutions every time.
• Become a product expert in all of our Gen AI solutions, serving as the last line of technical defense before issues are escalated to Engineering and Product teams.
• Collaborate seamlessly across Engineering, Research, and Product teams to address customer concerns; collaborate with senior leaders both internally and externally to ensure the highest levels of customer satisfaction.
• Transform customer insights into action by identifying patterns in support cases and working with Engineering and Go-To-Market teams to drive Together’s roadmap (e.g., future models to support)
• Maintain detailed documentation of system configurations, procedures, troubleshooting guides, and FAQs to facilitate knowledge sharing with team and customers.
• Be flexible in providing support coverage during holidays, nights and weekends as required by business needs to ensure consistent and reliable service for our customers.

Requirements

• 5+ years of experience in a customer-facing technical role with at least 1 year in a support function in AI 
• Strong technical background, with knowledge of AI, ML, GPU technologies and their integration into high-performance computing (HPC) environments.
• Familiarity with infrastructure services (e.g., Kubernetes, SLURM), infrastructure as code solutions (e.g., Ansible) high-performance network fabrics, NFS-based storage management, container infrastructure, and scripting and programming languages.
• Familiarity with operating storage systems in HPC environments such as Vast and Weka
• Familiarity with inspecting and resolving network-related errors 
• Strong knowledge of Python, TypeScript, and/or JavaScript with testing/debugging experience using curl and Postman-like tools
• Foundational understanding in the installation, configuration, administration, troubleshooting, and securing of compute clusters.
• Complex technical problem solving and troubleshooting, with a proactive approach to issue resolution
• Ability to work cross-functionally with teams such as Sales, Engineering, Support, Product and Research to drive customer success.
• Strong sense of ownership and willingness to learn new skills to ensure both team and customer success.
• Excellent communication and interpersonal skills, with the ability to explain complex technical concepts to non-technical stakeholders.
• Ability to operate in dynamic environments, adept at managing multiple projects, and comfortable with frequent context switching and prioritization.

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure. 

Compensation

We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work for the respective hiring region. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

About the Role

Together AI is scaling its physical AI infrastructure rapidly — and we're looking for a Director of Data Center Operations to help us build it right. This is a ground-floor opportunity to own the operational foundation of Together's growing data center portfolio across the US and Asia.

You'll be responsible for designing and commissioning white space deployments — taking pre-built environments and fitting them out with the power distribution, cooling distribution, and systems infrastructure needed to run high-density GPU workloads at scale. At the same time, you'll be building the break-fix and smart hands team from scratch: hiring, defining the playbook, and standing up the function that keeps our sites running around the clock.

This is not a steady-state operations role. It's a builder role. You'll be joining a small but fast-moving team, with real ownership over outcomes and the autonomy to shape how Together AI operates its physical infrastructure for years to come. If you've scaled data center infrastructure through hypergrowth before and want to do it again with more ownership — this is that opportunity.

Responsibilities

• Own the design, fit-out, and commissioning of white space sites across the US and Asia, with a focus on power distribution (PDUs), cooling distribution (CDUs), and IT-adjacent infrastructure
• Build and lead a ~20-person break-fix and smart hands team from scratch — define the operating model, hire the initial team, and establish the processes and playbooks that keep sites running
• Manage a portfolio of 5+ sites across two regions in various stages of deployment and live operation
• Partner with vendors, contractors, and equipment suppliers to drive site deployments to schedule and quality
• Establish operational standards, runbooks, and escalation processes for a nascent but rapidly growing infrastructure function
• Serve as the technical authority on data center infrastructure decisions — from white space evaluation through to live production operation
• Travel to Asia periodically to oversee regional site deployments and support the local team

Requirements

• Deep, hands-on technical knowledge of data center power and cooling systems at the IT-adjacent layer — PDUs, CDUs, power distribution, and white space fit-out
• Proven experience designing and commissioning data center infrastructure, from evaluation through to live operation
• Experience operating data center infrastructure at meaningful scale, supporting large production workloads
• People leadership experience — you've hired, developed, and led technical operations teams
• A builder's instinct — you're comfortable standing up teams and functions from scratch, writing the playbook where none exists, and operating with ambiguity
• Strong vendor and contractor management skills — you know how to hold external partners accountable to timeline and quality
• Nice to have: experience with GPU or AI infrastructure deployments, multi-site or multi-region portfolio management, or familiarity with Asian markets

About Together AI

Together AI is a research-driven AI infrastructure company on a mission to dramatically lower the cost of modern AI by co-designing software, hardware, algorithms, and models. We believe open and transparent AI systems create the best outcomes for society — and we're building the physical and computational foundation to make that real. Our team has been behind landmark advances including FlashAttention, Hyena, FlexGen, and RedPajama.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $250,000 - $300,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

About the Role

We’re seeking an exceptional tax leader to establish and scale our tax function from the ground up. This is a rare opportunity to define global tax strategy across multiple jurisdictions within a high-growth, dynamic environment, partnering with a world-class team.

Responsibilities

Tax Strategy & Planning

• Develop and execute a comprehensive global tax strategy aligned with business objectives
• Advise leadership on tax implications of corporate structure, financing, and expansion
• Optimize effective tax rate through strategic planning and structuring

Compliance & Reporting

• Lead all federal, state, and international tax compliance (income, sales/use, VAT, payroll tax etc.)
• Ensure accurate and timely tax filings and provisions under U.S. GAAP (ASC 740) and applicable international local laws
• Manage audits and inquiries from tax authorities

Indirect Tax

• Lead global indirect tax strategy for Together AI's AI infrastructure platform, APIs, and usage-based services
• Advise on U.S. and international indirect tax matters, including sales tax and VAT/GST across key jurisdictions, with a focus on AI, cloud, and compute offerings
• Assess the tax implications of fixed-fee subscription or usage-based AI services
• Partner with Product, Finance, and Legal to structure enterprise contracts and bundled offerings in a tax-efficient and compliant manner, including input on pricing, invoicing, and go-to-market decisions

Data Center and Infrastructure Operations

• Advise on tax treatment of data center operations, including leasing and colocation arrangements
• Manage sales and use tax on infrastructure and hardware purchases, including applying for tax exemption status across geographies
• Identify and support data center tax incentives and credits
• Oversee property tax exposure for data center assets
• Monitor tax developments impacting data center and infrastructure operations 

International Expansion

• Support market entry into new jurisdictions, including entity structuring and transfer pricing
• Design and maintain transfer pricing policies and documentation

Process & Systems

• Build scalable tax processes and leverage automation where possible
• Partner with various teams  on tax provision processes and systems integration

Requirements

• Bachelor's degree in Accounting, Finance, or a related field required; CPA or Master's in Taxation (MST) preferred
• 10+ years of progressive tax experience in public accounting and/or in-house roles, including experience building tax functions from the ground up
• Strong knowledge of U.S. and international direct and indirect tax laws, including transfer pricing and global structuring
• Experience in high-growth technology or AI infrastructure companies; familiarity with indirect tax in cloud-based and hardware-inclusive business models
• IPO or mid-to-late-stage private company experience, with the ability to operate effectively in a fast-paced startup environment
• Familiarity with emerging regulatory frameworks impacting AI infrastructure companies

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $259k - $310k + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy.  

About the Role

We’re hiring a Support Leader to own and scale Together AI’s customer support function across two distinct, technically demanding domains: API Support (billing, serverless inference, and dedicated inference) and GPU Support (large-scale GPU infrastructure for model training workloads). You’ll work closely with Together AI’s VP of Customer Experience and partner tightly with SRE, Inference Platform, and Engineering to represent customers internally and drive resolution at speed. This is a player-coach role: you’ll be hands-on in escalations. 

Our support operation runs 24/7. Our GPU infrastructure customers hold us to high-stakes SLAs on training workloads. Our API customer base spans thousands of PLG and enterprise accounts relying on our serverless and dedicated inference endpoints. Both domains need a leader who can keep pace technically and build the operational muscle to scale.

Responsibilities

Team Leadership and Mentorship

• Directly manage and develop a team of support engineers and technical account specialists across API Support and GPU Support functions.
• Establish clear performance expectations, career growth paths, and a coaching culture leveraged to identify skill gaps and build training programs to close them.
• Run structured 1:1s, team reviews, and escalation retrospectives.

Operationalization and Scaling

• Assess and overhaul support workflows, SLA frameworks, and escalation playbooks
• Build triage, prioritization, and handoff protocols that allow the team to scale with customer growth without proportional headcount growth.
• Define and own support KPIs: SLA attainment, time-to-resolution, escalation rate, CSAT

GPU Infrastructure Support (Hands-On)

• Jump into complex, active GPU infrastructure issues alongside your team. Investigate NCCL and InfiniBand failures, SSH connection stalls, Kubelet TLS misconfigurations, GPU/RDMA provisioning timeouts, NFS RDMA mount failures, VAST storage failures, network fabric degradation, etc.
• Manage high-stakes SLA obligations with GPU cloud customers running multi-thousand-GPU training workloads
• Coordinate closely with SRE and infrastructure engineering on hardware-level issues and cluster bringup.

 API and Inference Support (Hands-On)

• Own the support surface for Together AI’s API platform: serverless inference, dedicated inference endpoints (self-serve and managed), billing, rate limits, model upload (BYOM), and API authentication.
• Represent the team on complex cases: dedicated endpoint startup failures, safetensors validation errors, NFS/storage performance issues on inference clusters, billing disputes and negative-balance enforcement, and rate limit escalations.
• Work with the Inference Platform, Commerce, and Product teams to surface patterns and drive fixes upstream.

Escalation and Cross-Functional Partnership

• Be the escalation point for your team’s highest-severity customer issues — triage fast, communicate clearly to customers and internal stakeholders, and drive to resolution.
• Partner with SRE, Engineering, and Sales on shared priorities. Represent the support team’s perspective in cross-functional planning.
• Own the relationship with support tooling vendors and drive improvements to alerting, SLA tracking, and ticket routing.

Customer Feedback Loop

• Systematically analyze ticket patterns and surface product and infrastructure gaps to Engineering and Product. Turn support signal into actionable roadmap input.
• Build documentation and self-service resources that reduce inbound volume over time.

Requirements

• 10+ years of support engineering or technical support leadership experience, with at least 3 years managing a team.
• Demonstrated experience leading infrastructure support or cloud operations. You understand how large-scale workloads behave on distributed systems. 
• Working knowledge of AI infrastructure. You know how APIs work, can reason about latency and throughput issues, and understand the operational surface of a managed inference platform.
• Technical depth to be a credible player-coach. Ability to guide engineers through root cause analysis, and bring credibility to customer-facing escalations.
• Experience running SLA-driven support operations with real accountability. Familiarity with Pylon or equivalent support ticketing platforms (Zendesk, etc.) and PagerDuty-style alerting systems.
• Strong communication skills, especially under pressure. You can write a clear, concise customer-facing update in the middle of a live incident and distill a complex infrastructure issue into a crisp internal escalation.
• Startup mindset. You’re comfortable building process where none exists, and you thrive in environments where priorities shift fast.

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure. 

Compensation

We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $290,000 - $310,000K + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge. 

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more. Please see our Privacy Policy at https://www.together.ai/privacy

Together AI is building the AI Inference & Model Shaping Platform that brings the most advanced generative AI models to the world. Our platform powers multi-tenant server-less workloads and dedicated endpoints, enabling developers, enterprises, and researchers to harness the latest LLMs, multimodal models, image, audio, video, and reasoning models at scale.

We are looking for an exceptional Engineering Lead to partner closely with our cross-functional engineering, infrastructure, research, and sales teams to ensure excellence of our ML API offerings. Your primary focus will be on delivering world-class inference and fine-tuning in our public APIs and customer deployments by building automation and operations processes.

This role is ideal for a highly motivated and technically adept individual who excels in fast-paced, dynamic environments. You will be in charge of designing and scaling our ML processes & tooling at production scale – optimizing operations to ensure availability and reliability for our services, across differing tenants and user loads, and in a multi-cluster deployment. You will serve as a passionate advocate for internal and external customers, providing feedback to the wider engineering and infrastructure teams to improve our systems and core business metrics. If you thrive in a collaborative, problem-solving environment and are driven to deliver operational excellence, we encourage you to apply for this exciting opportunity.

Key Responsibilities

• Own availability and performance SLAs for production inference and fine-tuning services across serverless and dedicated deployments
• Own & improve testing, deployment, configuration management, and monitoring practices for multi-cluster ML infrastructure – partnering closely with Infra SREs
• Build self-serve tooling and automation to reduce operational toil and enable self-serve offerings.
• Define and enforce configuration best practices for inference engines (SGLang, TRT-LLM, vLLM etc.) to prevent runtime issues
• Lead incident response, conduct postmortems, and drive reliability improvements
• Mentor team members and potentially grow into hiring/team building as the organization scales
• Partner with infrastructure and ML engineering teams to improve system reliability and cost efficiency

Required Qualifications

• 5+ years operating production ML inference or training systems at scale
• 2+ years in senior IC or tech lead roles, with demonstrated mentorship and technical leadership experience. Having built or scaled teams is a plus.
• Deep expertise with Kubernetes, multi-cluster orchestration, and ML serving frameworks
• Experience with multi-tenant SaaS platforms
• Proven track record of SLA ownership with specific metrics (99.9% uptime, p99 latency targets)
• Customer escalation and incident communication experience
• Experience with LLM inference serving systems (SGLang, vLLM, TRT-LLM, or similar)
• Ability to influence cross-functional teams and make deployment/architecture decisions

Nice to Have

• Experience building internal developer platforms or self-serve tooling
• Background in cost optimization for GPU infrastructure
• Contributions to open-source ML infrastructure projects

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $250,000 - $300,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

About the Role

We are building the world’s best cloud for generative AI. We are looking for an experienced Executive Assistant who will support our Finance and Infrastructure Strategy leadership and work with key stakeholders across the company to proactively manage schedules, priorities, and resolve administrative and operational needs before they arise. The right person for this role is a professional with strong interpersonal skills who enjoys a fast-paced startup environment. This person also brings a can-do attitude and collaborative spirit.

Responsibilities

• Thrives in a fast-paced, high-intensity environment with the ability to manage competing priorities and tight deadlines
• Comfortable with ambiguity and operates with a strong sense of urgency
• Proactive and organized approach to calendar management, with strong responsiveness and follow-through
• Plan, book, and manage domestic and international travel arrangements
• Create, manage, and track expenses in accordance with company expense policy
• Support event coordination across the Finance and Infrastructure organization, including All Hands, offsites, and other company events
• Handle confidential and sensitive information with discretion, facilitating communication across departments as needed
• Provide contracts support, including uploading agreements and managing them through the review and signature process

Requirements

• BA / BS degree or equivalent work experience
• 4-6+ years supporting leadership, with at least 2 years working with a C-level OR VP-level leadership in a global business
• Prior experience supporting 2+ executives
• Superior organizational skills, attention to detail and timely follow through on all tasks
• Problem solver with strong analytical skills
• Works well under pressure in a fast paced environment
• ​​Ability to collaborate across all levels of an organization and with external executives and their staff
• Strong problem-solving skills to anticipate challenges, address issues, and de-escalate potential conflicts
• Strong communication skills and ability to interact with internal and external partners

Preferred Qualifications

• Prior experience working at a startup
• Prior experience working in tech and supporting finance or Infrastructure leadership and organizations 
• Proficient with Google Workspace and Slack

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $150k - 190k+ equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy.  

About the Role

This is the first dedicated data hire on Together AI's Finance team. You will own the data layer that Finance runs on — building from scratch the models, pipelines, and reporting infrastructure that allow Strategic Finance, FP&A, and Accounting teams to get reliable answers quickly. The person in this role will have direct exposure to every part of the Finance organization and a real opportunity to shape how data-driven decision-making develops here as the company scales.

A significant portion of your work will touch the data behind the economics of Together's infrastructure, which sits behind nearly every financial question we ask. You will work closely with Together's Data and Commerce engineering team, which owns the underlying billing pipelines and data warehouse. Your job is to define and build the modeling and reporting layer that turns raw operational data into finance-grade datasets — aligning on data contracts, representing Finance's requirements in data design decisions, and ensuring the metrics Finance depends on are correct, documented, and trusted.

Responsibilities

• Own and evolve the dbt transformation layer for Finance: design, build, test, document, and maintain models covering billing, financial performance, compute unit economics, and operational metrics
• Author and maintain Airflow DAGs (Astronomer-managed) that orchestrate Finance dbt runs, data quality checks, and downstream dependencies reliably
• Deliver dashboards and reporting in Hex for the executive team covering financial performance, utilization, and key operating metrics
• Partner with Strategic Finance, FP&A, and Accounting teams on the data infrastructure behind forecasting, cost modeling, and other financial analyses
• Set data quality standards across Finance data products and own incident response when Finance-critical pipelines break
• Build the data foundation – clean, well-structured, documented, and reliably maintained – that enables Finance team to self-serve data analysis and supports AI automation and agentic workflows 

Requirements

• 5+ years in an analytics engineering or data engineering role, with meaningful time supporting Finance or business operations teams
• Expert SQL and production-grade dbt experience — models, tests, docs, snapshots, incremental strategies; you've designed a dbt project from scratch and maintained it
• Hands-on experience with Snowflake and Airflow in production; familiarity with Astronomer and the Cosmos dbt integration is a strong plus
• Solid dimensional modeling fundamentals: star schemas, slowly changing dimensions, fact table grain — you can apply Kimball principles without needing to look them up
• Strong dashboarding skills with a track record of executive-facing reporting that people actually use; experience with Hex or a comparable notebook/BI tool
• Clear communicator who can align stakeholders on metric definitions and translate between engineering tradeoffs and Finance requirements in both directions
• High comfort with ambiguity; this role will require scoping problems from scratch, not executing against pre-defined specs

Nice to Have

• Experience with financial data or billing data such as ARR, usage-based billing, invoice reconciliation, revenue recognition patterns, etc.. We operate a usage-based billing system and this context transfers directly.
• Experience with PII handling, data masking, access-tier modeling, or compliance work (SOC 2, ISO 27001, GDPR, CCPA).
• Familiarity with lakehouse patterns (Iceberg, Delta, Hudi) and hybrid warehouse/lake architectures.
• Python for data tooling: automation, data quality frameworks, custom dbt macros or operators.
• Experience with Hex, Metabase, or similar notebook/BI tooling that sits on top of your dbt models.
• Prior experience in a high-growth AI/ML infrastructure or platform company

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $200k -$240k + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy.  

About the role

As a Forward Deployed Engineer (FDE) focused on large scale GPU clusters, you will be a hands-on technical partner to our strategic customers – the world’s leading AI model builders. You will partner with our SAs as a deep-domain specialist in large-scale infrastructure, storage, high-performance networking, and cluster orchestration. As key contributors to the CX, Engineering, and Sales organizations, FDEs add tremendous value by ensuring we can meet the requirements of our most complex POCs, facilitate successful platform adoption for our strategic customers, and guide tailored optimization efforts - directly impacting company growth and the hardening of our core platform.

Responsibilities

• Cluster Hardening & Validation: Design and execute rigorous pre-handover test suites (NCCL, DCGM, GPU Burn) to ensure clusters are stable under the extreme stress of multi-node training.
• Technical Partnership: Act as the primary technical point of contact for model labs, helping them tune their orchestration layer (Kubernetes or SLURM) for maximum throughput.
• Infrastructure Optimization: Profile and debug low-level bottlenecks in InfiniBand (IB) fabrics, NVLink topologies, and high-performance storage systems.
• Opinionated Onboarding: Build reference designs and "out-of-the-box" configurations for training frameworks to reduce customer time-to-train.
• Benchmarking & Migration: Lead complex benchmarking exercises to demonstrate the performance impact of migrating to new hardware families or Together AI’s optimized infrastructure.
• Product Feedback Loop: Directly influence our hardware and software roadmap by surfacing edge cases and performance gaps found during customer deployments.

Requirements

• Experience: 5+ years in a technical role, with a strong focus on Large-Scale GPU Infrastructure.
• Orchestration Mastery: Deep, hands-on experience with Kubernetes (specifically GPU-operator and device plugins) and/or SLURM for workload scheduling.
• Networking & Interconnects: Expert knowledge of InfiniBand, RoCE, and NVLink; ability to diagnose network failures that degrade collective communication (NCCL).
• Storage Knowledge: Familiarity with parallel file systems (VAST or Weka preferred) and object storage, specifically in the context of large-scale checkpointing.
• Benchmarking Skills: Ability to run and interpret training benchmarks and communication tests to validate cluster health and performance.
• Coding & Automation: Proficiency in Python and shell scripting; experience with Ansible or similar tools for automated cluster configuration.
• Willingness to dive into the customer's stack to solve hard problems and comfortable with the high-stakes, fast-paced environment of frontier model labs.

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancements such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers on our journey in building the next generation of AI infrastructure. 

Compensation

We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $270,000 - $300,000 OTE + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge. 

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our Privacy Policy at https://www.together.ai/privacy

About the role

As a Forward Deployed Engineer (FDE) focused on Inference & Post-Training, you will be a hands-on technical partner to our most strategic customers — production AI teams looking to leverage high quality models and do inference at scale. For us, FDE is not a replacement for a Solutions Architect; you will partner with our SAs as a deep-domain specialist in inference optimization, fine-tuning pipelines, and production deployment. As key contributors to both the CX, Engineering, and Sales organizations, FDEs add tremendous value by ensuring we can meet the requirements of our most complex POCs, facilitate successful platform adoption, and guide tailored optimization efforts — directly impacting customer success, company growth, and the hardening of our core platform.

Responsibilities

• Inference Engine Optimization: Select, configure, and optimize inference engine based on hardware, model architecture, and workload profile
• Configuration & Performance Tuning: Develop configuration updates to win critical POCs, benchmarks, and optimize customer deployments; tune KV cache, apply speculative decoding, determine optimal tensor parallelism, and determine quantization strategy to hit throughput and latency targets.
• Post-Training & Fine-Tuning: Drive hands-on RL training runs and optimize system design; guide customers through LoRA, SFT, DPO, RLHF, and GRPO pipelines from experimentation through production.
• Strategic Customer Alignment: Act as the primary technical point of contact for aligned strategic accounts — monitoring and optimizing endpoint configurations, helping customers get the most out of the platform, and collaborating to ensure we hit critical milestones.
• Opinionated Onboarding: Establish direct alignment with strategic customers at onboarding; ensure the right inference and post-training configurations are in place from day one to improve time-to-value.
• Product Feedback Loop: Directly influence our software and model roadmap by surfacing insights from the field. Contribute back to the product where needed to support customer requirements or drive a better experience. Drive early feature and research adoption with strategic logos.

Qualifications

• Experience: 5+ years in a technical role, with a strong focus on inference systems, open-source LLM deployment, or post-training workflows.
• Inference Engine Depth: Expert-level, hands-on experience with inference engines (e.g., vLLM, TensorRT-LLM, SGLang); ability to diagnose and resolve performance issues at the engine level.
• Inference Optimization: Deep knowledge of KV cache tuning, speculative decoding, tensor parallelism, pipeline parallelism, and quantization techniques
• Post-Training Knowledge: Hands-on experience with fine-tuning and post-training pipelines, including LoRA, SFT, DPO, RLHF, and GRPO; ability to advise on system design
• Model Landscape Awareness: Broad knowledge of state-of-the-art open-source models and strong judgment on model selection for specific customer use cases, hardware profiles, and performance targets.
• Coding Proficiency: Strong Python skills; comfortable working in production environments

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancements such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers on our journey in building the next generation of AI infrastructure. 

Compensation

We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $270,000 - $300,000 OTE + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge. 

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our Privacy Policy at https://www.together.ai/privacy

About the Role

Lead a team of Site Reliability Engineer (SRE) at Together based out of our office in Amsterdam, you  and the SRE team are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software engineer that applies sound engineering principles, operational discipline, and mature automation to our operating environments and codebase.

You specialize in systems (operating systems, storage subsystems, networking), while implementing best practices for availability, reliability and scalability, with varied interests in algorithms and distributed systems.

Responsibilities

• Be on an on-call (PagerDuty) rotation to respond to incidents that impact availability
• Manage, develop and coach the SRE Team.
• Build and run our infrastructure with Ansible, Terraform, and Kubernetes to enable scaling to a massive number of concurrent users
• Build monitoring systems to ensure the highest quality service for our customers
• Design and implement operational processes (such as deployments and upgrades)
• Debug production issues across all services and levels of the stack
• Identify improvements for the product architecture from the reliability, performance and availability perspectives 
• Plan the growth of Together AI’s infrastructure

Requirements

• 7+ years of professional SRE or related experience
• Ideally 2 years as a Lead SRE
• Bachelor's degree in Computer Science or a related field or equivalent work experience
• Expert knowledge of Ansible (roles, playbooks), Terraform, and Kubernetes
• Proficiency in programming/scripting languages
• Direct experience in monitoring and observability practices
• Advanced knowledge of cloud services
• Ability to thrive in a collaborative environment involving different stakeholders and subject matter experts

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

About the Role

The product team is seeking a Lead Product Designer with advanced expertise in crafting exceptional user experiences for technical tools. In this strategic role, you'll shape AI development tools while laying the foundation for our growing design organization.

You bring a proven ability to lead complex UX initiatives and elevate design quality across complex product surfaces. Your technical design sensibility will elevate tools used daily by AI engineers. And your leadership experience will help establish processes and standards for future team growth.

You are a natural collaborator and an excellent communicator, able to develop and present design ideas in a larger cross-functional team context: Engineering, Product, and Marketing. You thrive in highly collaborative environments and work closely with Engineering and Product to ensure strong execution quality. As part of a scaling product team, We hold a high bar for craft across interaction, visual design, usability, and systems thinking, and expect this role to raise that bar across the product.

Naturally, you'll be able to make key strategic decisions with us, besides your everyday work: Craft and map elegant user flows, prototype smooth interactions, launch new product features. You will also contribute to and evolve our design system to ensure consistency and scalability across surfaces.

Ideally, you are biased toward long-term and keep your eyes on priorities, are used to self-managing projects you take ownership over from start to finish and know how to involve others outside your role. You are a fast learner who can quickly ramp in complex technical domains and independently build context around AI and developer workflows.

Requirements

• 7+ of experience in a professional software product-driven environment.
• Advanced skills in UX and interaction design
• Experience building developer tools, IDEs, infrastructure platforms, or data products
• Demonstrated experience building, scaling, or significantly contributing to a production design system, including component architecture and cross-product consistency
• Experienced in user research
• Technical enough to learn about the needs of our users 
• Can consume and interpret user interaction data
• Experience designing complex software used daily by technical users
• Love thinking through complex interaction design problems
• Get excited about being immersed in the AI ecosystem and defining how tooling for AI services should look and behave
• Enjoy tackling ambiguous problems and shaping them into a clear vision
• Excellent communication and storytelling skills.
• Creative problem-solving. Preferably with a systematic, long-term approach.
• Experience with data-informed design.
• High standards for visual, interaction, and product craftsmanship
• Proven ability to ramp quickly in new technical environments
• Experience designing enterprise software
• Drive design vision for AI development tooling ecosystem
• Partner with exec team on strategic product decisions
• Develop scalable design practices for team growth
• Foster cross-functional collaboration at senior levels
• Champion user-centered culture across organization
• Set and maintain a high bar for design quality and craft across teams
• Promote consistent design standards and systems thinking across products

Responsibilities

• Contribute to the overall design and direction of Together products
• Design and ship high-quality products and improvements, from early concepts to high-fidelity prototypes and visuals
• Partner closely with engineering, product management, AI research, and design peers to define both long-term strategy and short-term tactics
• Engage in user research to better understand our users and refine our products
• Contribute to and evolve our design system
• Own and improve shared components within the design system in collaboration with Engineering
• Ensure strong implementation quality by partnering closely with Engineering throughout delivery
• Maintain consistency and cohesion across product surfaces

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, and other competitive benefits. The base salary range is $200,000 - $240,000. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

About the Role

At Together.ai, we are building state-of-the-art infrastructure to enable efficient and scalable inference for large language models (LLMs). Our mission is to optimize inference frameworks, algorithms, and infrastructure, pushing the boundaries of performance, scalability, and cost-efficiency.

We are seeking an Inference Frameworks and Optimization Engineer to design, develop, and optimize distributed inference engines that support multimodal and language models at scale. This role will focus on low-latency, high-throughput inference, GPU/accelerator optimizations, and software-hardware co-design, ensuring efficient large-scale deployment of LLMs and vision models.

This role offers a unique opportunity to shape the future of LLM inference infrastructure, ensuring scalable, high-performance AI deployment across a diverse range of applications. If you're passionate about pushing the boundaries of AI inference, we’d love to hear from you!

Responsibilities

Inference Framework Development and Optimization

• Design and develop fault-tolerant, high-concurrency distributed inference engine for text, image, and multimodal generation models.
• Implement and optimize distributed inference strategies, including Mixture of Experts (MoE) parallelism, tensor parallelism, pipeline parallelism for high-performance serving.
• Apply CUDA graph optimizations, TensorRT/TRT-LLM graph optimizations, and PyTorch-based compilation (torch.compile), and speculative decoding to enhance efficiency and scalability.

Software-Hardware Co-Design and AI Infrastructure

• Collaborate with hardware teams on performance bottleneck analysis, co-optimize inference performance for GPUs, TPUs, or custom accelerators.
• Work closely with AI researchers and infrastructure engineers to develop efficient model execution plans and optimize E2E model serving pipelines.

Requirements

Must-Have:

• Experience:
  • 3+ years of experience in deep learning inference frameworks, distributed systems, or high-performance computing.
• Technical Skills:
  • Familiar with at least one LLM inference frameworks (e.g., TensorRT-LLM, vLLM, SGLang, TGI(Text Generation Inference)).
  • Background knowledge and experience in at least one of the following: GPU programming (CUDA/Triton/TensorRT), compiler, model quantization, and GPU cluster scheduling.
  • Deep understanding of KV cache systems like Mooncake, PagedAttention, or custom in-house variants.
• Programming:
  • Proficient in Python and C++/CUDA for high-performance deep learning inference.
• Optimization Techniques:
  • Deep understanding of Transformer architectures and LLM/VLM/Diffusion model optimization.
  • Knowledge of inference optimization, such as workload scheduling, CUDA graph, compiled, efficient kernels
• Soft Skills:
  • Strong analytical problem-solving skills with a performance-driven mindset.
  • Excellent collaboration and communication skills across teams.

Nice-to-Have:

• Experience in developing software systems for large-scale data center networks with RDMA/RoCE
• Familiar with distributed filesystem(e.g., 3FS, HDFS, Ceph)
• Familiar with open source distributed scheduling/orchestration frameworks, such as Kubernetes (K8S)
• Contributions to open-source deep learning inference projects.

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $160,000 - $230,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

About the role

Together AI/Codesandbox is looking for a Senior Backend/Distributed Systems engineer to help us build and maintain the codebase that powers the Together AI Sandbox service. This is a role for engineers that are familiar with standard backend architecture, database design, and high-performance backend services. Our API platform is under constant load and scrutiny, so a key part of the role is experience and commitment to writing easily understood and well-tested code. You will be working closely with the product team to understand and document the functional needs of their product requirements, developing new code to solve new problems, as well as maintaining existing code to squash bugs.

• Location: Hybrid in Amsterdam, or Open to Relocation in the Netherlands
• Full-time: This means 40 flexible hours, Monday through Friday.

Responsibilities

• Design core, backend software components
• Perform architecture and research work for AI workloads
• Interface with other teams to incorporate their innovations
• Analyze and improve efficiency, scalability, and stability of various system resources
• Conduct design and code reviews
• Create services, tools and developer documentation
• Create testing frameworks for robustness and fault-tolerance
• Participate in an on-call rotation to respond to critical incidents as needed

Requirements

• 5+ years experience writing high-performance, well-tested, production quality code
• Bachelor's or Master's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
• Demonstrated experience in building large scale, fault tolerant, distributed systems like storage, search, and computation
• Expert level programmer in one or more of Golang, Java, Rust, or C/C++
• Demonstrated experience with relational (e.g., PostgreSQL) and non-relational (e.g., ClickHouse, Redis) databases
• Experience designing, analyzing and improving efficiency, scalability, and stability of various system resources
• Excellent understanding of low level operating systems concepts including multi-threading, memory management, networking and storage, performance and scale
• Experience with Kubernetes/Nomad and containers is a plus
• Experience with virtual machines, microVMs, or sandboxing technologies (e.g., gVisor, Firecracker, QEMU) is a plus
• Experience with Ceph is a plus
• Experience with Elixir is a plus

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, and other competitive benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

About the Role

Together AI is looking for an ML Engineer who will develop systems and APIs that enable our customers to perform inference and fine tune LLMs. Relevant experience includes implementing runtime systems that perform inference at scale using AI/ML models from simple models up to the largest LLMs.

Requirements

• 5+ years experience writing high-performance, well-tested, production quality code
• Bachelor’s degree in computer science or equivalent industry experience
• Familiar with LLM inference ecosystem, including frameworks and engines (e.g. vLLM, SGLang, TRT, ...)
• Demonstrated experience in building large scale, fault tolerant, distributed systems like storage, search, and computation
• Expert level programmer in one or more of Python, Go, Rust, or C/C++
• Experience implementing runtime inference services at scale or similar

Responsibilities

• Design and build the production systems that power the Together Cloud inference and fine-tuning APIs, enabling reliability and performance at scale
• Partner with researchers, engineers, product managers, and designers to bring new features and research capabilities to the world
• Analyze and improve efficiency, scalability, and stability of various system resources
• Conduct design and code reviews
• Create services, tools & developer documentation
• Create testing frameworks for robustness and fault-tolerance
• Participate in an on-call rotation to respond to critical incidents as needed

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $160,000 - $220,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

About the Role

Together AI is a frontier AI cloud, which has been built bottoms up to cater to the demand for the new generation of AI applications and agents. The company has seen tremendous growth with 20X customer growth and 6X ARR growth in the financial year.

As we continue to drive product innovation, we are also investing deeply in GTM. We are looking for a product marketing leader to continue to build and scale our PMM function. This role will own the platform as well as all product level value propositions and define how the messaging flows downstream across all channels. They will partner closely with the product management team to build and execute our product launch calendar and GTM plans to deliver adoption and user growth for our key products. This role will report into the head of marketing and is expected to lead our current PMM organization and continue to build a bar-raising PMM function.

Responsibilities

• Build and maintain detailed buyer personas and ideal customer profiles to guide segmentation, messaging, and campaign strategies.​
• Develop compelling product positioning and messaging that clearly differentiate us in a competitive landscape
• Partner closely with Product Management to influence roadmap priorities based on market insights, customer feedback, and competitive analysis​
• Own the go-to-market strategy for new product launches and major updates, managing the cross-functional coordination needed for success.​
• Lead creation of sales enablement tools—pitch decks, battlecards, and case studies—to empower sales and customer success teams.​
• Drive consistent storytelling across all customer touchpoints—website, campaigns, and events
• Partner with PR, demand generation, field marketing, and web teams to ensure alignment between GTM campaigns and core value propositions.​
• Manage, coach and scale a bar-raising team of product marketers
• Set up, measure and report on key OKRs for the PMM function 

Requirements 

• 10+ years of PMM experience in enterprise software, preferably in AI, AI natives, Digital Natives or Cloud
• 5+ years as a team leader in the PMM function 
• Proven success leading and scaling high-performing product marketing teams in fast-paced growth environments
• Strong ability to translate complex technical features into business-oriented messaging for diverse audiences
• Demonstrated experience building GTM strategies, launching new products, and achieving measurable awareness, adoption or pipeline growth​
• Comfortable operating cross-functionally with Sales, Product, and Engineering to align market strategy with execution
• Exceptional analytical skills with a data-driven approach to decision-making and reporting
• Bachelor’s degree in engineering and MBA preferre

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $250-295k + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge. This is a hybrid role based in the Bay Area.  

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

About the Role

Together AI is seeking a Payroll Manager to lead and scale our payroll operations. This role will be responsible for managing all aspects of payroll ensuring accurate, compliant, and timely processing for all employees. Reporting to the VP Controller, the Payroll Manager will bring a strong end-to-end mindset and a deep understanding of payroll operations, including upstream and downstream impacts across HR, benefits, and finance processes. The ideal candidate has extensive experience managing complex multi-state payrolls, equity and stock-based compensation, and navigating specialized scenarios such as visa-related exemptions - ensuring every payroll input, deduction, and tax treatment is processed accurately, seamlessly, and with exceptional attention to detail.

Responsibilities

• Administer full-cycle payroll for all employees, ensuring accuracy, compliance, and adherence to federal, state, and local regulations.
• Oversee timely and accurate bi-weekly payroll processing, ensuring all deadlines are consistently met.
• Review and validate payroll inputs - including compensation changes, bonuses, commissions, benefits, and leave - and ensure accurate calculations across pay cycles.
• Serve as the payroll subject matter expert, maintaining up-to-date knowledge of tax regulations, and labor laws across all relevant U.S. jurisdictions.
• Manage payroll requirements for employees on work visas, including identifying exemption eligibility (e.g., FICA exemptions) and coordinating necessary documentation.
• Oversee incentive and equity-related payroll processing for RSUs, NSOs, and ISOs, ensuring precise tax calculations, accurate reporting, and timely estimated tax submissions.
• Serve as the primary point of contact for payroll inquiries from employees and internal stakeholders, ensuring responsive and high-quality support.

Requirements

• 6+ years of hands-on payroll experience, with demonstrated expertise managing complex, multi-state U.S. payroll operations; CPP or FPC certification is a plus, but not required.
• Proven experience administering payroll; Paylocity experience is a strong plus.
• Strong understanding of federal, state, and local payroll regulations, wage and hour laws, and tax compliance requirements.
• Experience managing payroll considerations for employees on work visas, including proper application of visa-related tax exemptions (e.g., FICA exemption eligibility).
• Knowledge of equity and stock-based compensation (e.g., RSUs, NSOs, ISOs) and their associated tax and reporting implications.
• Experience managing payroll inputs such as bonuses, commissions, benefits, leave-of-absence scenarios, and retroactive adjustments.
• Strong analytical skills with a high degree of accuracy, attention to detail, and ability to identify and resolve discrepancies.
• Excellent communication skills, with the ability to explain payroll concepts clearly and support employees and internal partners.
• Ability to operate independently, prioritize effectively, and thrive in a fast-paced, scaling environment.
• Demonstrates sound judgment, confidentiality, and integrity in handling sensitive employee data.
• Experience with HiBob is preferred, but not required.

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $150,000 - $170,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy

About the Role

Together AI is seeking a Machine Learning Engineer to join our Inference Engine team, focusing on optimizing and enhancing the performance of our AI inference systems. This role involves working with state-of-the-art large language models models and ensuring they run efficiently and effectively at scale. If you are passionate about AI inference, PyTorch, and developing high-performance systems, we want to hear from you. This position offers the chance to collaborate closely with AI researchers and engineers to create cutting-edge AI solutions. Join us in shaping the future at Together AI!

Responsibilities

• Design and build the production systems that power the Together AI inference engine, enabling reliability and performance at scale.
• Develop and optimize runtime inference services for large-scale AI applications.
• Collaborate with researchers, engineers, product managers, and designers to bring new features and research capabilities to the world.
• Conduct design and code reviews to ensure high standards of quality.
• Create services, tools, and developer documentation to support the inference engine.
• Implement robust and fault-tolerant systems for data ingestion and processing.

Requirements

• 3+ years of experience writing high-performance, well-tested, production-quality code.
• Proficiency with Python and PyTorch.
• Demonstrated experience in building high performance libraries and tooling.
• Excellent understanding of low-level operating systems concepts including multi-threading, memory management, networking, storage, performance, and scale.
• Preferred: Knowledge of existing AI inference systems such as TGI, vLLM, TensorRT-LLM, Optimum
• Preferred: Knowledge of AI inference techniques such as speculative decoding.
• Preferred: Knowledge of CUDA/Triton programming.
• Nice to have: Knowledge of Rust, Cython and compilers.

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society. Together, we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI. Our team has been behind technological advancements such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey to build the next-generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance, and other competitive benefits. The US base salary range for this full-time position is $160,000 - $230,000 + equity + benefits. Our salary ranges are determined by location, level, and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunities to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

About the Role

Our team focuses on enabling custom models and dedicated inference on Together. We are responsible for building a container platform, optimizing autoscaling, minimizing cold starts, achieving the best end-to-end model performance, and providing a best-in-class developer experience with great tooling. We often focus on video or audio generation across the stack: CUDA kernels, pytorch optimization, inference engines, container orchestration, queueing theory, etc. An ideal candidate will be great at profiling/optimization but know the word kubernetes, or be intimately familiar with multi-cluster scheduling and have some sense of ML bottlenecks.

Responsibilities

• New hires may work on multi-cluster orchestration, portfolio optimization, predictive autoscaling, control panes, model bring-up, model optimization, APIs for managing deployments, inference worker SDKs, and CLI tools.
• Analyze and improve the robustness and scalability of existing distributed systems, APIs, databases, and infrastructure
• Partner with product teams to understand functional requirements and deliver solutions that meet business needs
• Write clear, well-tested, and maintainable software and IaC for both new and existing systems
• Conduct design and code reviews, create developer documentation, and develop testing strategies for robustness and fault tolerance

Requirements

• 5+ years of demonstrated experience in building large scale, fault tolerant, distributed systems.
• Experience running serverless inference platforms, doing model bring-up on short notice, being on call, or running a cloud provider is a very big plus
• Good taste and ability to thoughtfully discuss how what you’ve built has failed over time
• Experience designing, analyzing and improving efficiency, scalability, and stability of various system resources
• Excellent understanding of low level operating systems concepts including concurrency, networking and storage, performance and scale
• Expert-level programmer in one or more of Python, Golang, Rust, C++, or Haskell
• Proficiency in writing and maintaining Infrastructure as Code (IaC) using tools like Terraform
• Experience with Kubernetes internals or other container orchestration systems
• Sound judgement for when to use and when to not use LLMs for code
• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience
• Writing-heavy roles or companies are a plus

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $160,000 - $250,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

About the Role

This is a research engineering role with direct production impact. You won’t be publishing ideas in isolation—you will translate new RL algorithms, scheduling methods, and inference optimizations into production-grade systems that power Together’s API. Success in this role means shipping measurable improvements in latency, throughput, cost, and model quality at scale. We are looking for researchers who enjoy owning systems end-to-end and turning frontier ideas into robust infrastructure.

The Core ML (Turbo) at Together AI team sits at the intersection of efficient inference (algorithms, architectures, engines) and post‑training / RL systems. We build and operate the systems behind Together’s API, including high‑performance inference and RL/post‑training engines that can run at production scale.

Our mandate is to push the frontier of efficient inference and RL‑driven training: making models dramatically faster and cheaper to run, while improving their capabilities through RL‑based post‑training (e.g., GRPO‑style objectives). This work lives at the interface of algorithms and systems: asynchronous RL, rollout collection, scheduling, and batching all interact with engine design, creating many knobs to tune across the RL algorithm, training loop, and inference stack. Much of the job is modifying production inference systems—for example, SGLang‑ or vLLM‑style serving stacks and speculative decoding systems such as ATLAS—grounded in a strong understanding of post‑training and inference theory, rather than purely theoretical algorithm design.

You’ll work across the stack—from RL algorithms and training engines to kernels and serving systems—to build and improve frontier models via RL pipelines. People on this team are often spiky: some are more RL‑first, some are more systems‑first. Depth in one of these areas plus appetite to collaborate across (and grow toward more full‑stack ownership over time) is ideal.

Responsibilities

• Advance inference efficiency end‑to‑end
• Design and prototype algorithms, architectures, and scheduling strategies for low‑latency, high‑throughput inference.
• Implement and maintain changes in high‑performance inference engines (e.g., SGLang‑ or vLLM‑style systems and Together’s inference stack), including kernel backends, speculative decoding (e.g., ATLAS), quantization, etc.
• Profile and optimize performance across GPU, networking, and memory layers to improve latency, throughput, and cost.
• Unify inference with RL / post‑training
• Design and operate RL and post‑training pipelines (e.g., RLHF, RLAIF, GRPO, DPO‑style methods, reward modeling) where 90+% of the cost is inference, jointly optimizing algorithms and systems.
• Make RL and post‑training workloads more efficient with inference‑aware training loops—for example, async RL rollouts, speculative decoding, and other techniques that make large‑scale rollout collection and evaluation cheaper.
• Use these pipelines to train, evaluate, and iterate on frontier models on top of our inference stack.
• Co‑design algorithms and infrastructure so that objectives, rollout collection, and evaluation are tightly coupled to efficient inference, and quickly identify bottlenecks across the training engine, inference engine, data pipeline, and user‑facing layers.
• Run ablations and scale‑up experiments to understand trade‑offs between model quality, latency, throughput, and cost, and feed these insights back into model, RL, and system design.
• Own critical systems at production scale
• Profile, debug, and optimize inference and post-training services under real production workloads, taking research ideas all the way to stable, measurable improvements in deployed systems.
• Drive roadmap items that require real engine modification—changing kernels, memory layouts, scheduling logic, and APIs as needed.
• Establish metrics, benchmarks, and experimentation frameworks to validate improvements rigorously.
• Provide technical leadership (Staff level)
• Set technical direction for cross‑team efforts at the intersection of inference, RL, and post‑training.
• Mentor other engineers and researchers on full‑stack ML systems work and performance engineering.

Requirements

We don’t expect anyone to check every box below. People on this team typically have deep expertise in one or more areas and enough breadth (or interest) to work effectively across the stack. The closer you are to full‑stack (inference + post‑training/RL + systems), the stronger the fit—but being spiky in one area and eager to grow is absolutely okay.

You might be a good fit if you:

• Have a bias toward implementation and shipping—you are excited to modify real engines and services, not just prototype in research code.
• Have strong expertise in at least one of the following, and are excited to collaborate across (and grow into) the others:
• Systems‑first profile: Large‑scale inference systems (e.g., SGLang, vLLM, FasterTransformer, TensorRT, custom engines, or similar), GPU performance, distributed serving.
• RL‑first profile: RL / post‑training for LLMs or large models (e.g., GRPO, RLHF/RLAIF, DPO‑like methods, reward modeling), and using these to train or fine‑tune real models.
• Model architecture design for Transformers or other large neural nets.
• Distributed systems / high‑performance computing for ML.
• Are comfortable working from algorithms to engines:
• Strong coding ability in Python
• Experience profiling and optimizing performance across GPU, networking, and memory layers.
• Able to take a new sampling method, scheduler, or RL update and turn it into a production‑grade implementation in the engine and/or training stack.
• Have a solid research foundation in your area(s) of depth:
• Track record of impactful work in ML systems, RL, or large‑scale model training (papers, open‑source projects, or production systems).
• Can read new RL / post‑training papers, understand their implications on the stack, and design minimal, correct changes in the right layer (training engine vs. inference engine vs. data / API).
• Operate well as a full‑stack problem solver:
• You naturally ask: “Where in the stack is this really bottlenecked?”
• You enjoy collaborating with infra, research, and product teams, and you care about both scientific quality and user‑visible wins.

Minimum qualifications

• 3+ years of experience working on ML systems, large‑scale model training, inference, or adjacent areas (or equivalent experience via research / open source).
• Advanced degree in Computer Science, EE, or a related field, or equivalent practical experience.
• Demonstrated experience owning complex technical projects end‑to‑end.

If you’re excited about the role and strong in some of these areas, we encourage you to apply even if you don’t meet every single requirement.

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $200,000 - $280,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy

About the Role

Together AI is building the Inference Platform that powers the world's most advanced generative AI models. Your role will be a critical bridge between cutting-edge research and real-world applications, focusing on making translating our internal model training research to production-ready deployment for our customers. This involves a deep commitment to data-centric development, meticulous hyperparameter tuning, and rigorous checkpoint evaluation before models ever hit production.

This role will involve understanding customer specific needs and fine-tuning models on our internal data recipe and their proprietary data. The goal is to transform general-purpose models into highly performant, specialized tools that solve real business problems. You will not be training foundation models from scratch but rather focusing on creating highly efficient, specialized models by working with dedicated GPU clusters.

Responsibilities

• Design and iterate on novel speculator algorithms, combining architectural innovations with carefully curated data to push the frontier of accuracy–efficiency tradeoffs.
• Be the critical link between raw data and a production-ready model, seeing your work directly impact our customers' success.
• Work in a fast-paced, high-impact role at the cutting edge of generative AI.
• Collaborate with a team of experts dedicated to solving real-world, high-performance challenges.
• You'll collaborate directly with customers to understand their needs, and work closely with our core inference and Applied ML research teams to integrate your work into the production platform.
• A culture of deep technical ownership where you are empowered to take on and solve challenging problems

Requirements

• A genuine love for data curation and processing, with a meticulous attention to detail. You believe that great models start with great data.
• Demonstrated ability to perform effective hyperparameter searches and understand the trade-offs involved in tuning models for specific tasks.
• Experience working with and building on top of existing training codebases. You are comfortable navigating complex code and contributing to its improvement.
• Strong attention-to-detail in evaluating model checkpoints to ensure they meet strict quality, performance, and reliability standards.
• Experience with Python and PyTorch.
• Familiarity with SLURM and/or Kubernetes clusters and experience submitting and managing jobs in a high-performance computing environment.
• Familiarity with modern LLMs and generative models.
• Basic understanding of distributed training frameworks (e.g., FSDP, DeepSpeed).
• Bachelor’s, Master’s degree, or Ph.D. in Computer Science, Computer Engineering, or a related field, or equivalent practical experience.

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, ATLAS, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $190,000 - $270,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy

About The Role

We are seeking a highly analytical and process-driven Sales and Marketing Operations Manager to join our Revenue Strategy and Operations team. In this pivotal role, you will bridge the gap between marketing strategy, sales execution, and data-driven decision-making. The ideal candidate will optimize the entire lead-to-revenue funnel, streamlining operations and leveraging data to enhance overall business performance.

Responsibilities

• Full-Funnel Reporting: Develop, maintain, and automate integrated dashboards that provide actionable insights into the entire customer journey, from initial marketing touchpoints to closed-won sales.
• Performance Analysis: Analyze data across the full tech stack (CRM, Marketing Automation, Web Analytics) to identify trends, conversion bottlenecks, and high-growth opportunities.
• Attribution & ROI: Collaborate with finance and leadership to refine attribution models, ensuring clear visibility into marketing's contribution to the sales pipeline and overall ROI.
• Forecasting: Define and track key performance indicators (MQLs, SQLs, Win Rates, CAC, LTV) to provide accurate revenue forecasts and identify potential risks.
• Tech Stack Management: Oversee and optimize our integrated technology stack, including Salesforce, marketing automation (e.g., HubSpot), and sales engagement tools (e.g., MixMax).
• Process Optimization: Design and implement scalable workflows for lead routing, lead scoring, and automated nurturing programs to ensure seamless handoffs between teams.
• Data Integrity: Maintain a "source of truth" by ensuring data cleanliness, implementing data enrichment strategies, and managing audience segmentation for targeted campaigns.
• Strategic Alignment: Act as the primary liaison between Sales and Marketing to ensure alignment on definitions, goals, and execution strategies.
  
  

Requirements

• Education: Bachelor’s degree in Marketing, Business, Statistics, Computer Science, or a related quantitative field.
• Experience: 5–7 years of experience in Sales/Marketing Operations or Business Intelligence, preferably within a B2B SaaS environment.
• Technical Proficiency: Expert-level experience with Marketing Automation Platforms (HubSpot, Marketo, Pardot) and CRMs (Salesforce).
• Data Visualization: Proven ability to create impactful dashboards using tools like Tableau, Power BI, Looker, or Google Data Studio.
• Analytical Skills: Exceptional ability to translate complex data sets into clear, actionable insights for non-technical stakeholders.
• Advanced Tools: Advanced Excel skills are required; proficiency in SQL, R, or Python for advanced data extraction is a strong plus.
• Strategic Mindset: Deep understanding of funnel mechanics, lead management, and the tactical requirements of sales and marketing alignment.
  
  

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $150,000 - $170,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy

About the Role

Together AI is building the Inference Platform that brings the most advanced generative AI models to the world. Our platform powers multi-tenant serverless workloads and dedicated endpoints, enabling developers, enterprises, and researchers to harness the latest LLMs, multimodal models, image, audio, video, and speech models at scale.

If you get a thrill from optimizing latency down to the last millisecond, this is your playground. You’ll work hands-on with tens of thousands of GPUs (H100s, H200s, GB200s, and beyond), figuring out how to fully utilize every FLOP and every gigabyte of memory.

You’ll collaborate directly with research teams to bring frontier models into production, making breakthroughs usable in the real world. Our team also works closely with the open source community, contributing to and leveraging projects like SGLang, vLLM, and NVIDIA Dynamo to push the boundaries of inference performance and efficiency.

• Shape the core inference backbone that powers Together AI’s frontier models.
• Solve performance-critical challenges in global request routing, load balancing, and large-scale resource allocation.
• Work with state-of-the-art accelerators (H100s, H200s, GB200s) at global scale.
• Partner with world-class researchers to bring new model architectures into production.
• Collaborate with and contribute to the open source community, shaping the tools that advance the industry.
• A culture of deep technical ownership and high impact — where your work makes models faster, cheaper, and more accessible.
• Competitive compensation, equity, and benefits.

Responsibilities 

• Build and optimize global and local request routing, ensuring low-latency load balancing across data centers and model engine pods.
• Develop auto-scaling systems to dynamically allocate resources and meet strict SLOs across dozens of data centers.
• Design systems for multi-tenant traffic shaping, tuning both resource allocation and request handling — including smart rate limiting and regulation — to ensure fairness and consistent experience across all users.
• Engineer trade-offs between latency and throughput to serve diverse workloads efficiently.
• Optimize prefix caching to reduce model compute and speed up responses.
• Collaborate with ML researchers to bring new model architectures into production at scale.
• Continuously profile and analyze system-level performance to identify bottlenecks and implement optimizations.

Requirements

• 5+ years of demonstrated experience building large-scale, fault-tolerant, distributed systems and API microservices.
• Strong background in designing, analyzing, and improving efficiency, scalability, and stability of complex systems.
• Excellent understanding of low-level OS concepts: multi-threading, memory management, networking, and storage performance.
• Expert-level programming in one or more of: Rust, Go, Python, or TypeScript.
• Knowledge of modern LLMs and generative models and how they are served in production is a plus.
• Experience working with the open source ecosystem around inference is highly valuable; familiarity with SGLang, vLLM, or NVIDIA Dynamo will be especially handy.
• Experience with Kubernetes or container orchestration is a strong plus.
• Familiarity with GPU software stacks (CUDA, Triton, NCCL) and HPC technologies (InfiniBand, NVLink, MPI) is a plus.
• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or related field, or equivalent practical experience.

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $160,000 - $250,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

About the Role

Together AI is looking for a Senior Data Engineer to help define, build, and operate the data infrastructure that handles millions of events every day to power Together’s mission-critical systems. As a Senior Data Engineer, you will work with our Data and Commerce engineering team to scale the data processing components of Together’s usage-based billing system, real-time customer-facing analytics product, and internal business intelligence tools. You will work across both cloud-native services and globally distributed data centers.

If you thrive in fast-paced environments and have a passion for defining and building early-stage data platforms for a rapidly scaling and data-intensive company, this is for you.

Requirements

• 5+ years of demonstrated experience in building large scale, fault tolerant, distributed data platforms, stream processing pipelines, ETLs, etc
• Expert-level skills in designing, building, and operating stream processing pipelines with services like AWS Kinesis, Apache Kafka, or Redpanda
• Expert-level knowledge of building real-time customer facing analytics systems using services like AWS TimeStream or Clickhouse
• Proficiency in writing and maintaining Infrastructure as Code (IaC) using tools like Terraform, AWS CDK, or Pulumi
• Proficiency in version control practices and integrating IaC with CI/CD pipelines.
• Proficiency in implementing and managing GitOps workflows with tools such as ArgoCD, Github Actions, TeamCity, or similar
• Proficiency in one or more of Golang, Rust, Python, Java, or TypeScript
• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience
• Experience with Kubernetes, or containers a plus

Responsibilities

• Identify, design, and develop foundational data infrastructure components capable of handling millions or billions of events daily
• Analyze and improve the robustness and scalability of existing data processing infrastructure
• Partner with product teams to understand functional requirements and deliver solutions that meet business needs
• Write clear, well-tested, and maintainable infra-as-code and software for both new and existing systems
• Conduct design and code reviews, create developer documentation, and develop testing strategies for robustness and fault tolerance
• Participate in an on-call rotation to address critical incidents when necessary

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $160,000 - $240,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

About the Role

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

As a Senior Developer Productivity Engineer at Together AI, you’ll own the systems and tooling that empower engineers to ship high-quality software faster. You’ll optimize workflows, enhance testing, enable reliable and reusable CI/CD, and work with developers to build out stable local environments. Your work will directly impact release velocity, developer happiness, and cross-cutting enablement ensuring engineers spend less time churning on infrastructure and more time building.

Responsibilities

• Automate CI/CD pipelines for zero-downtime deployments (e.g., Canary, Blue/Green).
• Create smart pipelines encouraging reusable workflows and simplicity
• Streamline build/test/deploy workflows.
• Build shared tooling (CLIs, codegen, IDE plugins) to accelerate teams.
• Reduce friction (e.g., faster builds, hot-reload, test tooling).
• Collaborate with developers to identify pain points and streamline workflows.
• Champion best practices through documentation.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or related field or 5+ years of industry experience in DevOps/SRE, developer tooling, or infrastructure engineering.
• Proficiency in Python, Go, and JavaScript/TypeScript (for tooling, automation, and FE enablement).
• Strong experience with CI/CD tools (GitHub Actions, ArgoCD, Gitops methodology) for building scalable, reusable pipelines.
• Experience with local dev environment tooling (e.g., Skaffold) and containerized development workflows
• Experience with creating starter templates in coordination with engineering for enabling rapid spin up of new services 
• Strong ownership and a builder mindset, you love creating tools others rely on.
• Problem-solving rigor and attention to detail (e.g., diagnosing flaky tests, build latency).

Nice to have

• Kubernetes expertise (EKS, K3s) and optimizing containerized builds.
• Infrastructure as Code (Terraform, Ansible, Pulumi).
• Front-end tooling familiarity (e.g., React, Next.js, Jest) to optimize FE dev workflows.
• Monitoring/observability (Prometheus, Grafana, Honeycomb) to debug bottlenecks.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $150,000 - $230,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy

About the Role

Together AI is building the best inference infrastructure for voice applications. Our Voice AI platform powers production-grade, real-time voice agents and applications — serving speech-to-text and text-to-speech models with best-in-class latency and reliability.

We're looking for a Senior ML Engineer to drive the model serving layer for voice workloads. You'll work hands-on with inference engines like TRT-LLM and SGLang to optimize how we serve models like Whisper, Parakeet, Orpheus, and Kokoro — pushing latency and throughput to the frontier. You'll profile GPU utilization, design batching strategies for streaming audio, and ensure new model architectures can go from research to production quickly.

This is a foundational hire on a small, high-impact team. Voice inference has unique challenges — streaming audio, tokenization, real-time latency budgets — that require dedicated ML engineering focus. You'll shape how Together serves voice models as the industry moves from pipeline architectures (ASR → LLM → TTS) toward end-to-end speech-to-speech.

• Own the model serving stack that powers Together's voice platform across STT, TTS, and speech-to-speech.
• Work directly with state-of-the-art accelerators (H100s, H200s, B200s) to optimize voice model inference.
• Collaborate with model partners (Cartesia, Deepgram, Rime, and others) to bring their models to production on Together's infrastructure.
• Build quality evaluation frameworks that guide model selection for customers and inform the roadmap.
• Join a small, early-stage team with outsized impact on a fast-growing product area.

Responsibilities

• Optimize inference performance for voice models (STT, TTS, speech-to-speech) — targeting best-in-class TTFB, throughput, and GPU utilization across our curated model set.
• Productionize voice models on serverless and dedicated endpoints, including batching strategies, streaming inference, and memory management tailored to audio workloads.
• Build and maintain a voice model evaluation framework — measuring WER across accents, languages, and noise conditions for STT; naturalness, latency, and pronunciation accuracy for TTS.
• Enable new model architectures in our serving stack as the field evolves, including audio-native LLMs, codec-based models (SNAC), and speech-to-speech systems.
• Collaborate with model partners to integrate and optimize their models (Cartesia, Deepgram, Rime, and others) running on Together's infrastructure.
• Profile and debug performance across the full inference stack — from GPU kernels to framework-level bottlenecks — and ship measurable improvements.
• Work with the platform engineering side of the team to ensure the serving layer meets the latency and reliability requirements of real-time voice APIs.
• Contribute to voice model fine-tuning capabilities (STT and TTS) as we enable customers to build differentiated voice experiences on Together.
• Lay the groundwork for multiple new products down the line.

Requirements

• 5+ years of experience in ML engineering, with a focus on model serving, inference optimization, or ML infrastructure.
• Hands-on experience with LLM serving engines (vLLM, SGLang, TensorRT-LLM, or similar) — comfortable reading and modifying engine internals, not just using APIs.
• Strong proficiency in Python and PyTorch; experience with GPU profiling and optimization (CUDA, memory management, kernel-level debugging).
• Track record of shipping ML systems to production with measurable performance improvements.
• Strong product sense — you think about what developers building voice apps actually need, not just what's technically interesting.
• Comfort working on a small, early-stage team where you'll wear multiple hats and move fast.
• Experience with speech and audio ML (ASR, TTS architectures, audio signal processing) is a strong plus but not required — you can learn this quickly if you have strong ML engineering fundamentals.
• Familiarity with audio codecs and tokenization schemes (SNAC, Encodec, DAC) is a plus.
• Experience training or fine-tuning speech models is a plus.
• Bachelor's or Master's degree in Computer Science, Electrical Engineering, or related field, or equivalent practical experience

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $200,000 - $260,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

About the Role

As a Senior Network Engineer at Together, you are responsible for designing, implementing, and maintaining our network infrastructure to ensure seamless connectivity and optimal performance for all user-facing services and production systems. As both a strategic planner and a hands-on engineer, you apply sound networking principles, operational discipline, and advanced automation to our network environments.

You specialize in networking systems—including routing, switching, network security, and protocols—implementing best practices for availability, reliability, and scalability. You have a keen interest in network design, optimization, and emerging technologies in HPC-based data center networking.

Outstanding problem-solving abilities and a comprehensive understanding of fundamental network theory are also critical to your success.

Requirements

• 8+ years of professional experience building, managing, and supporting large-scale hybrid data center networks (excluding enterprise networks).
• High level of proficiency with TCP/IP networking architecture and technologies such as BGP, OSPF, VXLAN, EVPN, and QoS.
• Experience developing network automation pipelines using Python, Ansible, or other languages/tools utilized in infrastructure automation.
• Proficient in using tools such as Wireshark, tcpdump, nmap, MTR, and curl to identify connectivity issues, latency problems, and network bottlenecks.
• Experience designing and supporting multi-tenant networks
• Hands-on experience deploying and supporting network devices from Cisco, Arista, Juniper, and Mellanox.
• Experience working with cloud networks such as AWS, GCP, and Azure.
• Solid experience working in and troubleshooting within a Linux environment.

Responsibilities

• Design, deploy, manage and maintain global multi-vendor, multi-protocol high performance compute networks.
• Analyze data to diagnose and identify root causes to network issues to minimize downtime
• Evaluate and recommend network technologies, hardware, and software solutions.

• Participate in design reviews to ensure the proposed network architecture aligns with business needs and is optimized for performance, scalability, and reliability. 
• Manage relationships with external vendors and partners to test and verify hardware and software selections.

• Develop, and deploy systems and tools to keep all networks running reliably and efficiently
• Establish and implement industry best practices and contribute to the design of new scalable network solutions
• Ensure compliance with IT governance standards and best practices.
• Lead projects to address complex technical challenges, directly contributing to roadmaps and partner alongside the best engineers in the industry to develop world-class solutions

Preferred

• Knowledge of RoCE and Infiniband protocols a plus
• Experience with Docker, Kubernetes, or Slurm a plus 
• Understanding of AI training workloads and the demands they exert on networks a plus

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $190,000 - $250,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

About the Role

As a Senior Network Engineer at Together, you are responsible for designing, implementing, and maintaining our network infrastructure to ensure seamless connectivity and optimal performance for all user-facing services and production systems. As both a strategic planner and a hands-on engineer, you apply sound networking principles, operational discipline, and advanced automation to our network environments.

You specialize in networking systems—including routing, switching, network security, and protocols—implementing best practices for availability, reliability, and scalability. You have a keen interest in network design, optimization, and emerging technologies in HPC-based data center networking.

Outstanding problem-solving abilities and a comprehensive understanding of fundamental network theory are also critical to your success.

Responsibilities

• Design, deploy, manage and maintain global multi-vendor, multi-protocol high performance compute networks.
• Analyze data to diagnose and identify root causes to network issues to minimize downtime
• Evaluate and recommend network technologies, hardware, and software solutions.

• Participate in design reviews to ensure the proposed network architecture aligns with business needs and is optimized for performance, scalability, and reliability. 
• Manage relationships with external vendors and partners to test and verify hardware and software selections.

• Develop, and deploy systems and tools to keep all networks running reliably and efficiently
• Establish and implement industry best practices and contribute to the design of new scalable network solutions
• Ensure compliance with IT governance standards and best practices.
• Lead projects to address complex technical challenges, directly contributing to roadmaps and partner alongside the best engineers in the industry to develop world-class solutions

Requirements

• 8+ years of professional experience building, managing, and supporting large-scale hybrid data center networks (excluding enterprise networks).
• High level of proficiency with TCP/IP networking architecture and technologies such as BGP, OSPF, VXLAN, EVPN, and QoS.
• Experience developing network automation pipelines using Python, Ansible, or other languages/tools utilized in infrastructure automation.
• Proficient in using tools such as Wireshark, tcpdump, nmap, MTR, and curl to identify connectivity issues, latency problems, and network bottlenecks.
• Experience designing and supporting multi-tenant networks
• Hands-on experience deploying and supporting network devices from Cisco, Arista, Juniper, and Mellanox.
• Experience working with cloud networks such as AWS, GCP, and Azure.
• Solid experience working in and troubleshooting within a Linux environment.
• Must have either RoCE or Infiniband real work experience.

Preferred

• Experience with Docker, Kubernetes, or Slurm a plus 
• Understanding of AI training workloads and the demands they exert on networks a plus

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

About the Role

Together AI is building the best inference infrastructure for voice applications. Our Voice AI platform powers production-grade, real-time voice agents and applications — serving speech-to-text and text-to-speech models with best-in-class latency and reliability.

We're looking for a Senior Platform Engineer to own the API and infrastructure layer for voice workloads. You'll build the real-time WebSocket and HTTP APIs that developers use to ship voice experiences, design autoscaling for latency-sensitive streaming workloads, and ensure our multi-provider voice platform is reliable enough for production voice agents handling millions of calls.

This is a foundational hire on a small, high-impact team. Voice APIs have fundamentally different infrastructure requirements than text-based inference — bidirectional audio streaming, stateful connections, tight latency SLOs, and complex multi-model routing. You'll define how developers interact with Together's voice platform as we grow from early customers to the default infrastructure for voice AI.

• Own the real-time API layer (WebSocket + HTTP streaming) that powers Together's voice platform.
• Design autoscaling and orchestration for voice workloads running on tens of thousands of GPUs.
• Build the developer experience — APIs, observability, and tooling — for a fast-growing product area.
• Work with production voice customers (contact centers, AI agents, communication platforms) to ship what they actually need.
• Join a small, early-stage team with outsized impact on a new product line.

Responsibilities

• Build and harden real-time WebSocket and HTTP streaming APIs for STT and TTS — including connection lifecycle management, backpressure, error handling, and reconnection, at the reliability bar needed for production voice agents.
• Design and ship autoscaling for voice model endpoints that handles bursty, real-time traffic patterns — accounting for concurrent connection limits, streaming state, and hard latency ceilings.
• Implement voice-specific API features: word-level alignment, speaker diarization in realtime, audio format flexibility (g711/mulaw for telephony, PCM, WebRTC formats), pronunciation controls, and multi-context WebSocket support.
• Build voice-specific observability — latency breakdowns, audio quality signals, and dashboards that help both the team and customers debug issues.
• Own multi-model normalization across our model partners (Cartesia, Deepgram, Rime, and others), ensuring consistent API behavior regardless of the underlying provider.
• Collaborate with the ML engineering side of the team on the interface between the API layer and the model serving stack, ensuring latency and reliability requirements are met end-to-end.
• Contribute to developer experience — API design, documentation, integration cookbooks, playground and showcasing how best-in-class voice agents are built.
• Lay the groundwork for multiple new products down the line.

Requirements

• 5+ years of experience building large-scale, real-time distributed systems and API services.
• Deep expertise in real-time streaming infrastructure — WebSocket server architecture, Server-Sent Events, bidirectional streaming, connection multiplexing, and stateful protocol design.
• Expert-level programming in TypeScript and Python; experience with Rust is a plus.
• Strong distributed systems fundamentals: load balancing, autoscaling, rate limiting, and traffic shaping for latency-sensitive workloads.
• Experience with Kubernetes — including custom autoscalers, resource management, and health checking for stateful services.
• Strong product sense — you care about API ergonomics and think about what developers building voice apps actually need.
• Comfort working on a small, early-stage team where you'll wear multiple hats and move fast.
• Experience with audio or media protocols (WebRTC, g711, PCM encoding) is a strong plus.
• Familiarity with ML model serving infrastructure and how inference engines work is a plus — you'll interface with the serving layer regularly.
• Full-stack experience (React, Next.js) is a nice-to-have for contributing to developer-facing tooling.
• Bachelor's or Master's degree in Computer Science, Computer Engineering, or related field, or equivalent practical experience.

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $200,000 - $260,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

About The Role

Together AI is scaling its own data center infrastructure to power the next generation of AI workloads. We are looking for a Sr. Program Manager, Data Center Build to serve as our representative across our physical infrastructure builds. In this role, you will manage critical data center builds, coordinate infrastructure deployment, and drive projects from contract negotiation through commissioning and data center fit out. You will own the full deployment lifecycle, ensuring builds are delivered on time, on budget, and to the quality standards required for high-density AI compute environments.

Responsibilities

• Serve as Together’s representative on data center construction and expansion projects, managing data center providers, sub-contractors, and other third-party vendors from planning through fit-out.
• Oversee all phases of physical infrastructure delivery at data center sites, including site preparation, MEP installation, commissioning, facility readiness, white space fit out, and turnover to operations teams.
• Manage partner contracts, service level agreements (SLAs), schedules, and change orders; track progress against milestones and hold partners accountable to performance, cost, and timeline commitments.
• Coordinate with external partners, including data center providers, owner’s reps, GCs, design consultants, and commissioning agents, to resolve field issues and keep builds on track.
• Track equipment deliveries from vendors, coordinating delivery schedules with construction milestones to ensure materials arrive on time.
• Provide regular project status reporting to leadership, including schedule updates, risk registers, budget forecasts, and key decision points.
• Drive process improvements across the data center build-out and infrastructure deployment program, establishing scalable workflows for tracking, documentation, and vendor management as the portfolio of builds grows.
• Ensure all deployment activities comply with codes, security policies, and safety standards.

Requirements

• 7+ years of experience in technical project or program management or construction management, with at least 5 years focused on data center, mission-critical, or high-density infrastructure builds.
• Direct experience managing data center providers or general contractors on behalf of an owner or developer, including contract administration, schedule oversight, and scope amendment.
• Strong understanding of data center MEP systems, data hall fit out, structured cabling, and white space delivery. 
• Experience managing multi-million infrastructure budgets and tracking costs and timelines across multiple concurrent projects.
• Excellent communication skills with the ability to translate technical construction and delivery details for non-technical stakeholders and senior leadership.
• Familiarity with high-density GPU compute environments, liquid cooling systems, or AI infrastructure requirements.
• Bachelor’s degree in Construction Management, Engineering, Architecture, Business or a related field.
• PMP certification or equivalent project management credential.
• Travel required about 20% of the time.  

Nice to Have

• Experience with fast-track or modular delivery methods for data center or mission-critical facilities.

About Together AI

Together AI is an AI-native cloud company building the infrastructure to make AI faster, cheaper, and more accessible. We’re rapidly scaling our GPU footprint: signing our own data center leases, building large-scale clusters, and expanding toward a global owned-infrastructure presence. Our research team has contributed to breakthroughs like FlashAttention, Hyena, and RedPajama, and we co-design across software, hardware, and algorithms to push the frontier of AI efficiency.

Compensation

We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $190-240K + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more. Please see our Privacy Policy at https://www.together.ai/privacy

About the Role

Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure.

As a Senior AI Infrastructure Engineer, you will play a key role in building the next generation AI cloud platform – a highly available, global, blazing-fast cloud infrastructure that virtualizes cutting-edge ML hardware (GB200s/GB300s, BlueField DPUs) and enables state-of-the-art ML practitioners with self-serve AI cloud services, such as on-demand + managed Kubernetes and Slurm clusters. This platform serves both our internal SaaS products (inference, fine-tuning) and our external cloud customers, spanning dozens of data centers across the world.

Responsibilities

• Design, build, and maintain performant, secure, and highly-available backend services/operators that run in our data centers and automate hardware management, such as Infiniband partitioning, in-DC parallel storage provisioning, and VM provisioning.
• Design and build out the IaaS software layer for a new GB200 data center with thousands of GPUs.
• Work on a global multi-exabyte high-performance object store, serving massive datasets for pretraining.
• Build advanced observability stacks for our customers with automated node lifecycle management for fault-tolerant distributed pretraining.
• Perform architecture and research work for decentralized AI workloads
• Work on the core, open-source Together AI platform
• Create services, tools, and developer documentation
• Create testing frameworks for robustness and fault-tolerance

To be successful, you’ll need to be deeply technical and possess excellent communication, collaboration, and diplomacy skills. You have strong fundamental software development skills. In addition, you have strong systems knowledge and troubleshooting abilities. 

Requirements

• 5+ years of professional software development experience and proficiency in at least one backend programming language (Golang desired)
• 5+ years experience writing high-performance, well-tested, production quality code
• Demonstrated experience with building and operating high-performance and/or globally distributed micro-service architectures across one or more cloud providers (AWS, Azure, GCP)
• Excellent communication skills – able to write clear design docs and work effectively with both technical and non-technical team members
• Deep experience with Kubernetes internals a big plus, such as implementing non-trivial Kubernetes operators, device/storage/network plugins, custom schedulers, or patches thereon or Kubernetes itself
• Deep experience with VMs/hypervisors a big plus, such as QEMU/KVM, cloud-hypervisor, VFIO, virtio, PCIE passthrough, Kubevirt, SR-IOV
• Deep experience with DC networking tech + solutions a big plus, such as VLAN, VXLAN, VPN, VPC, OVS/OVN
• Experience with Cluster API or similar a big plus
• Experience working on high-performance compute, networking, and/or storage a big plus
• Experience virtualizing GPUs and/or Infiniband a big plus
• Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale
• Experience with infrastructure automation tools (Terraform, Ansible), monitoring/observability stacks (Prometheus, Grafana), and CI/CD pipelines (GitHub Actions, ArgoCD)
• Experience building IaaS or PaaS systems at scale a plus
• Experience with DPUs/SmartNICs a plus
• GPU programming, NCCL, CUDA knowledge a plus 

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $160,000 - $230,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

About the Role

Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure.

As a Senior Backend Engineer, you will play a key role in building the next generation AI cloud platform – a highly available, global, blazing-fast cloud infrastructure that virtualizes cutting-edge ML hardware (GB200s/GB300s, BlueField DPUs) and enables state-of-the-art ML practitioners with self-serve AI cloud services, such as on-demand + managed Kubernetes and Slurm clusters. This platform serves both our internal StaaS products (inference, fine-tuning) and our external cloud customers, spanning dozens of data centers across the world.

Some of what you’ll work on:

• Work on a distributed GPU scheduling system for the on-demand clusters product, Instant Clusters.
• Build out a global management plane for managing our data center compute, networking, and storage.
• Design and build new customer-facing cloud platform services, delivering killer enterprise AI cloud features.

Responsibilities

• Identify, design, and develop foundational backend services that power Together’s cloud platform
• Analyze and improve the robustness and scalability of existing distributed systems, APIs, databases, and infrastructure
• Partner with product teams to understand functional requirements and deliver solutions that meet business needs
• Write clear, well-tested, and maintainable software and IaC for both new and existing systems
• Conduct design and code reviews, create developer documentation, and develop testing strategies for robustness and fault tolerance
• Participate in an on-call rotation to address critical incidents when necessary

Requirements

• 5+ years of demonstrated experience in building large scale, fault tolerant, distributed systems and API microservices
• Experience designing, analyzing and improving efficiency, scalability, and stability of various system resources
• Excellent communication skills – able to write clear design docs and work effectively with both technical and non-technical team members
• Demonstrated experience with building and operating high-performance and/or globally distributed microservice architectures across one or more cloud providers (AWS, Azure, GCP)
• Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale
• Experience developing against and managing a relational database, such as PostgreSQL
• Expert-level programmer in one or more of programming language (Golang preferred)
• Proficiency in version control practices and integrating IaC with CI/CD pipelines.
• Experience with Kubernetes and containers preferred
• Experience building and operating data infrastructure (Kinesis, Airflow, Kafka, etc) a plus
• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $160,000 - $230,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

About the Role

As a Solutions Architect at Together AI, you will work with customers and prospects to create business value through Generative AI applications. Solutions Architects at Together are trusted advisors to our customers that evaluate, identify and demonstrate how Together can solve their AI needs. As key contributors to our sales organization, Solution Engineers add tremendous value to the customer journey and directly impact company growth and revenue. This is an exciting opportunity for a deeply technical professional passionate about AI and customer success to make a significant impact in a fast-paced, innovative environment.

Responsibilities

• Act as a technical advisor to our most strategic customers, deeply embedding with them to support the ideation and development of innovative applications using OSS models on Together AI
• Run complex demonstrations and POCs of Together’s entire stack, including both hardware and software solutions
• Collaborate with sales to qualify new prospects and support existing customers along their journey to build cutting-edge Generative AI solutions
• Build and maintain strong relationships with customer leadership and stakeholders, ensuring the successful deployment and scaling of their applications
• Deliver high-value feedback to our Product, Engineering, and Research teams, ensuring our platform continues to evolve to meet customer needs
• Build educational content and tooling for both internal and external use around Together’s solutions (i.e., playbooks, blogs, demos, etc.)

Qualifications

• 5+ years of experience in a customer-facing technical role with at least 2 years in a pre-sales function 
• Excellent communication and interpersonal skills, with the ability to explain complex technical concepts to non-technical stakeholders.
• Ability to consult with new and existing customers to map business needs to technical solutions
• Strong technical background, with knowledge of AI, ML, GPU technologies and their integration into high-performance computing (HPC) environments.
• Strong understanding of training, fine-tuning and inference in the context of open source LLMs
• Proficiency in Python and JavaScript, with experience building and delivering prototypes on API platforms.
• Familiarity with infrastructure services (e.g., Kubernetes, SLURM), infrastructure as code solutions (e.g., Ansible), container infrastructure Docker), and scripting and programming languages (Python, Javascript)
• Strong sense of ownership and willingness to learn new skills to ensure both team and customer success.
• Ability to operate in dynamic environments, adept at managing multiple projects, and comfortable with frequent context switching and prioritization.

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure. 

Compensation

We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US salary range for this full-time position is: $180-260K OTE + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our Privacy Policy at https://www.together.ai/privacy

About the Role

As the Partnerships Manager for our Model Ecosystem, you will be the primary architect of Together AI’s model library. This is a high-impact, cross-functional role focused on bringing the world’s leading proprietary and open-source models onto the Together platform. You will navigate an ever-evolving landscape to negotiate non-standard, creative deals that provide developers with the best possible building blocks for AI applications.

You are a "deal-maker" who thrives in ambiguity. You will sit at the intersection of Product, Finance, and Marketing, ensuring that our model roadmap is not only technically superior but commercially viable and market-facing.

Responsibilities

• Negotiate & Manage Partnerships: Lead end-to-end deal cycles with model builders across all modalities (text, image, video, etc.). You will handle everything from initial outreach to negotiating complex, creative commercial terms for both proprietary and open-source models.
• Curate the Model Library: Act as the internal champion for our "Model Library," identifying which frontier and specialized models we should bring to Together AI to maintain our competitive edge.
• Product & Engineering Alignment: Work closely with the Product team to define "bring-up" requirements and ensure new models are integrated seamlessly into our inference and fine-tuning stacks.
• Commercial Strategy: Partner with Finance to construct deal structures that balance aggressive growth with sustainable unit economics, often involving non-standard incentive structures.
• Go-to-Market & Co-Selling: Collaborate with Partner Marketing to announce new integrations and create momentum. You will also engage in co-selling efforts, helping our Sales team understand how to leverage specific partner models to win enterprise deals.

Requirements

• Creative Deal Maker: You have a track record of constructing partnership agreements that don’t follow a standard template. You can navigate complex IP, revenue-share, and exclusivity discussions with ease.
• High EQ & Collaborative: You are partner-oriented. You know how to build trust quickly and find the "win-win" in a competitive environment.
• Technical Curiosity: While you don’t need to be an ML researcher, you should have the technical depth to discuss model architecture, context windows, and inference requirements with product teams.
• Relevant Experience: 5-7+ years in Business Development or Strategic Partnerships. We value experience from high-growth API, cloud infrastructure, or developer platform companies (think Stripe, MongoDB, or Twilio) where you managed complex ecosystems.
• AI-Native Mindset: You work at pace with a relentless sense of urgency. You prefer "done and iterating" over "perfect and stagnant."

Preferred Qualifications

• Direct experience working with LLM labs or open-source AI communities.
• Experience in "co-selling" motions where partnerships directly drove revenue.

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $270K - 300K OTE + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy.  

About the Role

As a Senior Infrastructure Technical Program Manager (TPM) at Together AI, you will be at the core of building, optimizing, and scaling the global GPU resources needed for a pioneering AI infrastructure company. Your role is crucial in ensuring that the backbone of our AI models, thousands of GPUs distributed around the world, operates efficiently and reliably, enabling cutting-edge AI advancements that democratize access to AI technology globally.  You will drive cross-functional excellence by streamlining critical workflows and enhancing communication across internal and external teams. Join top engineers, researchers, and innovators to shape the future of AI infrastructure and power the next generation of AI-driven solutions.

Responsibilities

• Product Development: Design and build products for AI researchers, developers, and enterprise customers, translating technical requirements into product features and collaborating with research, engineering, and design teams. Develop and execute strategic plans for the Observability, Storage, Network Engineering, and Security infrastructure teams.
• End-to-End Product Ownership: Own a comprehensive product roadmap, detailing key features, enhancements, and releases. Drive end-to-end product development, manage development and testing, and lead launches.
• Stakeholder Engagement: Engage with stakeholders to understand their needs, pain points, and feedback. Drive initiatives to enhance customer satisfaction and loyalty through product improvements and innovative solutions.
• Cross-Functional Execution: Lead and align diverse cross-functional teams — including Research, Engineering, DevOps, SRE, and Go-to-Market — to ensure seamless project delivery and organizational success.

Requirements

• ML Product or Infrastructure Experience: 5+ years of experience building and scaling AI/ML-powered products and infrastructure, specifically collaborating with research and engineering teams.
• Proven experience with large-scale technology deployments, including cloud computing platforms, decentralized cloud infrastructure, and distributed systems (e.g., containerization and orchestration tools).
• Familiarity with the technical domains of Observability, Storage, Network Engineering, and Security for infrastructure.Experience with cloud computing platforms, decentralized cloud infrastructure, and/or similar large-scale technology deployments.
• Familiarity with cloud-based technologies (e.g., AWS, Google Cloud, or Azure)
• Technical Foundation: Bachelor's or Master's degree in Machine Learning, Computer Science, Engineering, or a related field.  
• Exceptional analytical and problem-solving skills, with a demonstrated ability to identify and proactively mitigate technical risks
• Experience using AI tools, such as ClaudeCode or similar, to accelerate analytical progress.
• Executive and Organizational Acumen
• Proven ability to thrive in a fast-paced, ambiguous startup environment, prioritizing complex tasks and managing multiple simultaneous projects.
• Strong organizational abilities to build cross-functional alignment and establish clear, focused priorities.
• A proactive and collaborative team-oriented approach, demonstrating a willingness to drive necessary outcomes across the company.
• Excellent communication and program management skills for effective collaboration with both internal stakeholders and external vendors.

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $225k to 265k + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge. This is a hybrid role based in the Bay Area.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy

About the Role

Together AI is building high-performance AI inference infrastructure and the software platform around it. We're looking for a senior Analytics Engineer who sits at the intersection of data engineering and business intelligence — someone who can turn raw, complex data into clean, trusted, well-documented models that the whole company can reason from.

You'll own the transformation layer of our data warehouse: shaping bronze/silver/gold models, designing dimensional schemas, and acting as the connective tissue between engineering systems and business stakeholders. You are equally comfortable deep in a dbt project and in a room with Finance, GTM, and Product aligning on definitions.

Requirements

• Expert SQL: window functions, complex aggregations, query optimization, cost-aware pattern selection, proficiency in Snowflake or equivalent cloud warehouse.
• dbt: deep, production-grade experience — models, tests (singular + generic), docs, snapshots, macros, packages, and incremental strategies. You've designed a dbt project from scratch and maintained it in production.
• Airflow / Astronomer: production DAG authoring, backfill handling, reliability patterns, and the Cosmos dbt integration.
• Dimensional modeling: you've read Kimball (or absorbed the equivalent), know the difference between star and snowflake schemas by feel, understand slowly changing dimensions, and can explain why a fact table's grain matters.
• Stakeholder management: demonstrated experience partnering with non-technical stakeholders, driving metric alignment, and delivering trusted data products — not just pipelines.
• Strong written communication: your documentation and async updates are clear enough that people don't need to ask follow-up questions.

Strong plus

• Experience with financial data or billing data — ARR, usage-based billing, invoice reconciliation, revenue recognition patterns. We operate a usage-based inference billing system and this context transfers directly.
• Experience with PII handling, data masking, access-tier modeling, or compliance work (SOC 2, ISO 27001, GDPR, CCPA).
• Familiarity with lakehouse patterns (Iceberg, Delta, Hudi) and hybrid warehouse/lake architectures.
• Python for data tooling: automation, data quality frameworks, custom dbt macros or operators.
• Experience with Hex, Metabase, or similar notebook/BI tooling that sits on top of your dbt models.
• Prior experience in a high-growth AI/ML infrastructure or platform company.

Responsibilities

Modeling & transformation

• Own and evolve the dbt transformation layer: design, implement, test, document, and maintain modular dbt projects that cover billing, product usage, financial data, and operational metrics.
• Build analytics-ready dimensional models following Kimball methodology: star schemas, conformed dimensions, fact tables with the right grain, and SCD Type 2 for slowly changing entities.
• Design for correctness, performance, and cost — partition strategies, incremental models, and avoiding full-table scans.
• Build and maintain a semantic/metrics layer with consistent, auditable metric definitions reused across notebooks, BI, and APIs.

Pipeline orchestration

• Author and maintain Airflow DAGs (Astronomer-managed) that orchestrate dbt runs, data quality checks, and downstream dependencies reliably.
• Apply solid DAG design: idempotent tasks, proper backfill strategies, SLA alerting, and clean dependency graphs.
• Work in our Cosmos (dbt + Airflow) integration — you know when to use a DbtTaskGroup vs a custom operator.

Data quality & governance

• Implement data quality checks at every layer: freshness, null/uniqueness tests, referential integrity, distribution drift, and business-rule assertions.
• Drive data stewardship practices: ownership, SLAs, clear "source of truth" definitions, and change communication.
• Handle PII fields correctly — masking, anonymization, and access-tier alignment. Compliance experience (SOC 2, ISO 27001, or similar) is a meaningful plus.

Stakeholder management

• Be the analytical partner to Finance, GTM, Product, and Engineering — translate business questions into durable data models, not one-off queries.
• Drive alignment on metric definitions, data ownership, and delivery tradeoffs across stakeholders with competing priorities.
• Communicate data quality issues, model changes, and breaking changes proactively. You treat downstream consumers as customers.
• Write clear documentation — model descriptions, column-level lineage, and business context — so analysts can self-serve with confidence.
• Run or contribute to data reviews, data-driven planning discussions, and architecture reviews involving the warehouse.

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $240,000 - $275,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

About the Role

Together AI is seeking a Staff Backend Engineer to own the technical vision, architecture, and execution of the commerce platform powering Together's Cloud products. As a staff engineer on the Commerce Engineering team, you will set the engineering direction for mission-critical capabilities — including usage-based billing, payment processing, customer-facing analytics, and product entitlements — while raising the bar for the engineers around you.

This role is ideal for a seasoned engineer who can operate at multiple altitudes: driving system design and long-term architecture decisions while staying hands-on in code. You'll be the connective tissue between engineering, product, finance, and go-to-market — translating complex business requirements into durable, scalable backend primitives that directly impact revenue and customer experience. You'll be expected to define not just what we build, but how we build it well.

Requirements

• 8+ years of experience building large-scale, fault-tolerant API-driven services and backend systems
• Demonstrated track record of tech lead or staff-level scope — owning system architecture decisions, influencing team direction, and delivering multi-quarter initiatives
• Deep expertise in designing relational database schemas and backend APIs that support complex product and business requirements at scale
• Strong experience leading and influencing cross-functional teams — comfortable partnering with product, finance, and non-technical stakeholders
• Expert-level proficiency in one or more of Golang, TypeScript, Python, C++, or Java
• Deep knowledge of distributed systems tradeoffs: consistency, availability, fault tolerance, and performance at scale
• Strong understanding of low-level systems concepts: multi-threading, memory management, networking, storage, and I/O
• Experience with infrastructure as code (Terraform, AWS CDK, Pulumi) and mature CI/CD workflows
• Experience with payment processors (e.g. Stripe) and billing systems strongly preferred
• Experience with Kubernetes and containerized deployments a plus
• Bachelor's or Master's degree in Computer Science, Computer Engineering, or equivalent practical experience

Responsibilities

• Define and own the technical roadmap for Together's monetization and billing pipeline infrastructure, spanning usage metering, contract billing, entitlements, spend governance, and payments processing
• Lead architecture reviews for major systems investments, ensuring long-term scalability, correctness, and maintainability across the commerce stack
• Drive cross-functional alignment with Product, Finance, and Go-To-Market teams — translating business strategy into clear engineering requirements and system designs
• Mentor and grow engineers on the team through design feedback, code reviews, technical coaching, and setting high standards for craft
• Own data modeling and schema design for core commerce entities, making principled tradeoffs between flexibility, performance, and correctness
• Establish and evolve API contracts in collaboration with client engineering teams, enabling high-quality customer-facing product experiences
• Champion reliability and scalability — lead incident response, drive postmortems, and systematically improve the resilience of commerce APIs and distributed systems
• Identify and reduce technical debt proactively, balancing pragmatic delivery with sustainable engineering practices

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $230,000 - $270,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy

About the Role

Together AI is building high-performance inference compute and the software platform around it. We’re looking for a Staff Data Warehouse Engineer with strong fundamentals and high growth potential to evolve into a technical lead. You’ll design and operate the warehouse from bronze → silver → gold, own core data models and metrics, and raise the bar on data quality and governance across the org.

Responsibilities

• Architect and operate a medallion/curated data warehouse stack (bronze/silver/gold) for product, usage, billing, and operational data.
• Build and maintain Airflow orchestrated pipelines and dbt transformation projects (modular, tested, documented).
• Design analytics-ready models: SCD Type 2, star schemas, and appropriate normalization for upstream canonical layers.
• Lead Master Data Management (MDM) patterns (golden records, reference data, deduping, identity resolution).
• Implement and automate data quality checks (freshness, nulls, referential integrity, distribution drift, anomaly detection).
• Establish data governance habits: data stewardship, ownership, SLAs, and clear definitions for “source of truth.”
• Build and maintain a business semantic layer (consistent metric definitions, dimensions, and reusable logic) used by notebooks/BI.
• Partner with stakeholders (Product, Engineering, Finance, GTM, Ops) to translate questions into durable datasets and metrics.
• Use SQL, Python, and Spark where scale demands it; optimize for correctness, performance, and cost.
• Mentor engineers and contribute to standards (code review, design docs, runbooks), paving the path to tech lead.

Requirements

• Strong warehouse fundamentals and production experience delivering trusted datasets and metrics.
• Expert SQL (window functions, dimensional modeling, performance tuning).
• Hands-on with dbt (models, tests, docs, snapshots, macros) and Airflow (DAG design, backfills, reliability).
• Solid Python for data tooling and automation; experience with Spark (PySpark/SQL) is a plus.
• Practical experience with SCD2, star schemas, and handling slowly changing business entities.
• Strong stakeholder management: you can drive alignment on definitions, tradeoffs, and delivery timelines.
• High standards for data quality, reliability, and maintainability.

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $240,000 - $275,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

Staff Engineer — API Core Platform

About the role

Together AI is seeking an experienced Backend Engineer to found Together’s API Platform team within the Production Foundations organization. In this role, you will define, build, and scale the core systems and architecture that power Together’s mission-critical APIs — including public customer APIs used directly by customers and via SDKs, CLIs, as well as the client APIs powering Together’s Cloud UI.

In the near term, you will improve and standardize the backend API layer within our primary Next.js monolith, raising the bar on reliability, performance, and consistency. In parallel, you will design and lead the evolution toward scalable, purpose-built next-gen API platform solutions optimized for different Public API and Client API use cases and traffic patterns — defining the long-term architecture and driving its incremental rollout.

This is a deeply hands-on role for an engineer who thrives on writing critical-path code and building platforms that unify engineering efforts across teams. You will work across backend systems, infrastructure layers, identity and access flows, and developer tooling to establish a cohesive API strategy that supports Together’s rapidly growing AI Cloud.

Responsibilities

• Design and drive the evolution of Together’s API platform, defining how APIs are built, versioned, secured, tested, and operated across the company
• Own and improve the backend API layer within our primary Next.js monolith, raising the bar on consistency, reliability, and performance
• Architect and lead the transition toward scalable, purpose-built API platforms optimized for different traffic patterns and product surfaces
• Write and maintain critical-path platform code that multiple services and product teams depend on
• Design and implement robust authentication, authorization, and identity-aware access patterns across public and internal APIs
• Establish performance standards for high-throughput APIs, implementing caching, rate limiting, fan-out control, and graceful degradation strategies
• Raise the bar on API observability and reliability, defining SLOs, monitoring, alerting, and incident response practices
• Drive API data modeling and schema generation strategies to ensure long-term maintainability and developer ergonomics
• Partner with infrastructure and security teams to maintain a strong security posture and evolve toward zero-trust architectures
• Mentor engineers, influence architectural direction across teams, and help define hiring standards as the API Platform grows

Required Qualifications

• 8+ years of experience building and operating large-scale, distributed backend systems in production environments
• Proven experience building or significantly evolving an API platform used by multiple teams or customer-facing products
• Expert-level proficiency in one or more of Golang, TypeScript, C++, or Java
• Deep expertise in API performance and scalability, including caching strategies, rate limiting, parallelization, fan-out control, and graceful degradation
• Strong experience designing and implementing production-grade authentication and authorization systems for customer-facing APIs
• Demonstrated ability to drive cross-team architectural initiatives without formal authority, aligning multiple stakeholders around long-term platform direction
• Experience building and operating systems using Infrastructure as Code (Terraform, AWS CDK, Pulumi) and modern CI/CD workflows
• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or equivalent practical experience

Nice to Have

• Experience with GraphQL or schema-based API federation systems
• Experience evolving APIs from monoliths to modular, platform-oriented architectures
• Experience designing and operating API schema generation and validation systems
• Experience building developer-facing SDKs or command-line tools
• Experience designing and operating multi-region, globally distributed API systems
• Experience designing horizontally scalable API systems capable of handling high request volume and burst traffic patterns
• Experience running production workloads in Kubernetes-based environments
• Experience building services in zero-trust or identity-aware architectures
• Experience with AWS networking, traffic management, and load balancing
• Experience with Cloudflare or CDN-level API performance optimization

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $240,000 - $275,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy 

Staff Engineer, Customer Insights

About the role

Together AI is seeking an experienced Staff Engineer to help found, build, and scale Customer Insights, the team responsible for the customer-facing visibility layer of Together’s Cloud. This role will shape how customers understand their activity, investigate what happened, respond when something needs attention, and govern their AI workloads with confidence.

In the near term, you will turn today’s fragmented visibility patterns into coherent product and platform foundations: historical analytics, activity history, audit logs, event timelines, notifications, and investigation workflows. You will partner closely with Together’s cloud product engineering teams and data platform team to make high-quality customer visibility a built-in capability across Together Cloud rather than a bespoke effort for each surface. Longer term, you will shape how these foundations evolve beyond dashboards and static views into AI-first investigation and insight workflows: systems that can summarize activity, explain anomalies, correlate events across surfaces, recommend actions, and provide trustworthy context to both human operators and autonomous agents.

This is a deeply hands-on role for an engineer who enjoys critical-path product and platform work. You will design the event, query, delivery, and governance systems behind customer insights while also building the user-facing workflows that help enterprise customers answer: what happened, who acted, when it happened, what matters now, and whether they need to act.

Responsibilities

• Design and drive the architecture for Together's Customer Insights platform, including customer-visible events, activity history, audit logs, timelines, notifications, and historical analytics and dashboards views.
• Build and operate the shared event and historical analytics visibility layer that helps product teams define important customer-facing events once and surface them consistently across analytics, logs, timelines, notifications, and governance views.
• Write and maintain critical-path backend and product code used by multiple teams and customer-facing surfaces.
• Partner with Data Platform and Observability engineering teams to leverage Together’s core data stack and capabilities to build out Customers Insights data collection and processing systems.
• Create customer workflows that connect summaries, timelines, evidence, actors, related objects, and next steps so users can investigate operational questions without relying on support or ad hoc analysis.
• Establish standards and review patterns for which events, evidence trails, notification hooks, and governance signals must exist before new product capabilities launch.
• Define reliability, freshness, completeness, and correctness measures for customer-facing visibility systems, then build the checks and operating loops needed to maintain trust at scale.
• Mentor engineers, influence architectural direction across teams, and help define the hiring bar as the Customer Insights area grows.
•  

Requirements

• 8+ years of experience building and operating large-scale distributed systems, product platforms, or customer-facing backend systems in production environments.
• Proven experience designing platforms or product systems used by multiple engineering teams or enterprise customers.
• Strong backend engineering skills in one or more of TypeScript, Go, Python, Java, C++, or similar production languages.
• Deep experience with event-driven systems, audit trails, activity feeds, analytics platforms, observability systems, notification systems, or investigation workflows.
• Strong data modeling and systems design judgment, including schemas, retention, indexing, query performance, access control, and correctness tradeoffs.
• Demonstrated ability to turn ambiguous customer and operational needs into clear technical architecture, incremental delivery plans, and durable product foundations.
• Experience partnering across product, infrastructure, data, security, and customer-facing teams to land cross-cutting architecture without relying on formal authority.
• Comfort writing critical production code while also setting technical direction, mentoring senior engineers, and raising engineering standards.
• Bachelor's or Master's degree in Computer Science, Computer Engineering, a related technical field, or equivalent practical experience.

Preferred Qualifications

• Experience building enterprise SaaS audit logs, governance tooling, compliance evidence systems, data lineage, or incident investigation products.
• Experience with high-volume event pipelines, streaming systems, OLAP or time-series storage, search systems, or large-scale analytical query engines.
• Experience building notification, alert routing, escalation, or workflow automation systems.
• Experience designing customer-facing analytics, reporting, dashboards, or operational intelligence products.
• Experience with multi-tenant cloud platforms, identity-aware access patterns, sensitive data handling, and retention controls.
• Experience with AI infrastructure, developer platforms, observability, or systems that support mission-critical enterprise workloads.
• Experience running production workloads on Kubernetes or cloud infrastructure and using Infrastructure as Code and modern CI/CD workflows.
• Experience building product surfaces in addition to backend platforms, especially where UX quality and technical correctness both matter.

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $200k-270k+ equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy.  

About the Role

In this role, you will design and deliver multi-petabyte storage systems purpose-built for the world’s largest AI training and inference workloads. You’ll architect high-performance parallel filesystems and object stores, evaluate and integrate cutting-edge technologies such as WekaFS, Ceph, and Lustre, and drive aggressive cost optimization-routinely achieving 30-50% savings through intelligent tiering, lifecycle policies, capacity forecasting, and right-sizing. 

You will also build Kubernetes-native storage operators and self-service platforms that provide automated provisioning, strict multi-tenancy, performance isolation, and quota enforcement at cluster scale. Day-to-day, you’ll optimize end-to-end data paths for 10-50 GB/s per node, design multi-tier caching architectures, implement intelligent prefetching and model-weight distribution, and tune parallel filesystems for AI workloads. 

Hybrid Working 2 days a week at our offices in Amsterdam

Responsibilities

• Design multi-petabyte AI/ML storage systems; integrate WekaFS, Ceph, etc.; lead capacity planning and cost optimization (30-50% savings via tiering, lifecycle policies, right-sizing).
• Design/optimize RDMA, InfiniBand, 400GbE networks; tune for max throughput/min latency; implement NVMe-oF/iSCSI; troubleshoot bottlenecks; optimize TCP/IP for storage.
• Build Kubernetes storage operators/controllers; enable automated provisioning, self-service abstractions, multi-tenant isolation, quotas; create reusable Helm/Terraform patterns.
• Deliver 10-50 GB/s per GPU node; optimize caching (weights/datasets/checkpoints), parallel filesystems, and data paths; troubleshoot with profiling tools; scale to thousands of nodes.
• Build multi-tier caches (local NVMe, distributed, object); optimize data locality and model-weight distribution; implement smart prefetching/eviction.
• Implement monitoring, alerting, SLOs; design DR/backups with runbooks; run chaos engineering; ensure 99.9%+ uptime via proactive/automated remediation.
• Partner with ML/SRE teams; mentor on storage best practices; contribute to open-source; write docs, postmortems, and public learnings.

Requirements

• 8+ years in storage engineering with 3+ years managing distributed storage at multi-petabyte scale

• Proven track record deploying and operating high-performance storage for GPU/HPC clusters

• Deep Kubernetes and cloud-native storage experience in production environments

• Strong coding skills in Go and Python with demonstrated ability to build production-grade tools

• BS/MS in Computer Science, Engineering, or equivalent practical experience

• History of technical leadership: designing systems that significantly improved performance (>3x), reliability (99.9%+ uptime), or cost efficiency

• Distributed Storage Systems: Deep expertise in WekaFS, Lustre, GPFS, BeeGFS, or similar parallel filesystems at multi-petabyte scale

• Object Storage: Production experience with S3, MinIO, Ceph, or R2 including performance optimization and cost management

• Kubernetes Storage: CSI drivers, StatefulSets, PersistentVolumes, storage operators, and custom controllers

• Storage optimization for GPU workloads, RDMA/InfiniBand networking, parallel filesystem optimization (100+ GB/s aggregate cluster throughput)

• Programming: Go and Python for automation, operators, and tooling

• Infrastructure as Code: Terraform, Ansible, Helm, GitOps (ArgoCD)

• Linux Storage Stack: Advanced knowledge of filesystems (ext4, xfs), LVM, NVMe optimization, RAID configurations

• Observability: Prometheus, Grafana, Thanos architecture and operations

Nice to Have Skills

• GPU Direct Storage (GDS), NVMe-oF, storage networking (100GbE/400GbE)

• ML/AI storage patterns (model weights, checkpointing, dataset caching)

• Kubernetes operator development (controller-runtime, kubebuilder)

• Storage snapshots, cloning, and thin provisioning

• Backup and disaster recovery (Velero, Restic, cross-region replication)

• Storage encryption (at-rest and in-transit), security and compliance
• Storage benchmarking and profiling tools (fio, iperf3, iostat, blktrace)

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

About the Role

Together AI is seeking a highly experienced Staff Engineer to join the Product Engineering team, to own and evolve the Product UI Platform — the architectural foundation that powers how product teams build full-stack features across our web surface.This role is responsible for evolving the product runtime from its current monolithic growth architecture to a scalable, modular, and high-leverage platform that supports increasing scale, reliability requirements, and a growing number of feature engineers. You will define and drive the technical direction of the Next.js/typescript/nodejs web runtime, BFF layer, and application integration patterns, partnering peer-to-peer with Backend and API Platform leaders to ensure cohesive architectural evolution across layers. This is a deeply hands-on role for and experienced engineer with real life experience leading and implementing architectural evolution and is ready to take full ownership of a critical technical domain.

Responsibilities

• Lead the next phase of architectural evolution for the product application platform
• Design and implement foundational platform primitives used across product teams
• Reduce architectural entropy and duplication across the web surface
• Improve application-level performance and reliability metrics
• Drive incremental modularization without disrupting feature velocity
• Establish performance budgets and enforce application-layer guardrails
• Partner with Backend Platform to shape API ergonomics and integration boundaries
• Collaborate with SRE to ensure runtime stability and production readiness
• Write and maintain critical-path platform code
• Establish durable standards for how full-stack features are built
• Mentor engineers and help scale the platform capability over time

Requirements

• 8+ years building production-grade web applications and backend systems
• Demonstrated ownership of a product application platform used by multiple teams
• Deep expertise in React/Next.js/TypeScript and server-side application architecture
• Strong backend experience with TypeScript
• Experience evolving monolith architectures into modular systems
• Web Vitals performance optimization experience across browser → API → data layers
• Proven ability to drive and implement architectural change in a cross functional collaborative environment
• Experience establishing technical standards and scaling developer velocity
• History of owning complex technical decisions and their outcomes

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $200,000 - $275,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

Role

As a Strategic Finance Senior Manager at Together, you will be a key member of the Finance team, working to provide critical financial insights, drive strategic decision-making, and optimize business performance. You will be a strategic business partner to multiple functions across the business, including the Engineering, Product, Business Operations and GTM teams. A meaningful area of focus will be on providing financial and strategic guidance to help Together optimize and scale our compute infrastructure. The ideal candidate will have exceptional business judgment and intuition, strong financial modeling skills and thrive in a fast-paced, high-growth environment.  You will have the opportunity to help drive strategic initiatives across the business as well as shape the strategic finance function of a rapidly growing AI startup.

Responsibilities

• Lead and drive strategic finance initiatives across the business, conducting complex financial analysis to deliver critical insights that empower cross-functional business partners to make data-driven decisions and enhance overall business performance
• You should expect to spend a meaningful amount of time on strategic and financial analysis related to scaling Together’s compute infrastructure, including building compute capacity, cost and cash flow forecasts, as well as tracking and driving towards optimal utilization of compute infrastructure
• Partner with Engineering, Product, Business Operations and GTM teams on financial analysis to support key value creation initiatives such as new product launches, assessment of unit economics, strategic business partnerships and resource allocation decisions
• Instill capital allocation oriented thinking across the business, with an emphasis of ROI-based decision making
• Design and build dashboards and processes to report on key financial and operational metrics to monitor and drive business performance on an ongoing basis
• Assist with forecasting, financial planning and analysis and building the company’s overall financial strategy.  Prepare and deliver clear, concise and insightful financial analyses and forecasts
• Be ready to roll up your sleeves and assist with other strategic finance initiatives and priorities to drive business impact and help the company grow
• Build expertise to deeply understand the company’s product offerings, product portfolio and associated nuances

Requirements

• 7+ years of experience, including 2+ years in strategic finance paired with prior experience across private equity, growth equity, venture capital, consulting, and/or investment banking
• Exceptional business judgment and intuition, coupled with strong problem-solving abilities, creativity, and critical thinking skills to tackle novel and complex challenges across the business
• Exceptional financial modeling skills and a deep understanding of financial concepts, with the ability to distill complex analyses and synthesize data into clear, actionable insights that highlight the key drivers for decision-making
• Ability to build relationships, collaborate with cross-functional business partners and communicate financial information to non-financial audiences clearly and concisely
• Strong work ethic and self-directed with ability to manage multiple projects, prioritize and work under tight timelines with close attention to detail

About Together AI

Together AI is a research-driven AI infrastructure company building the go-to platform for developers to build and deliver their AI applications. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join us in our journey in building the next generation AI infrastructure.

Together AI's investors include leading venture and growth investors such as General Catalyst, Kleiner Perkins, Salesforce Ventures, NVIDIA, Emergence Capital and Lux Capital.  Together is one of the fastest growing AI startups and has been named to the Forbes AI 50 list of Top Artificial Intelligence Startups.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $210k - $260k + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

About the Role

As a Systems Research Engineer specialized in GPU Programming, you will play a crucial role in developing and optimizing GPU-accelerated kernels and algorithms for ML/AI applications. Working closely with the modeling and algorithm team, you will co-design GPU kernels and model architecture to enhance the performance and efficiency of our AI systems. Collaborating with the hardware and software teams, you will contribute to the co-design of efficient GPU architectures and programming models, leveraging your expertise in GPU programming and parallel computing. Your research skills will be vital in staying up-to-date with the latest advancements in GPU programming techniques, ensuring that our AI infrastructure remains at the forefront of innovation.

Requirements

• Strong background in GPU programming and parallel computing, such as CUDA and/or Triton.
• Knowledge of ML/AI applications and models
• Knowledge of performance profiling and optimization tools for GPU programming
• Excellent problem-solving and analytical skills
• Bachelor's, Master's, or Ph.D. degree in Computer Science, Electrical Engineering, or equivalent practical experiences

Responsibilities

• Optimize and fine-tune GPU code to achieve better performance and scalability
• Collaborate with cross-functional teams to integrate GPU-accelerated solutions into existing software systems
• Stay up-to-date with the latest advancements in GPU programming techniques and technologies

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $160,000 - $230,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy