About the Team

Roku pioneered TV streaming and continues to innovate and lead the industry. Continued success relies on investing in the Roku Content Platform, so we deliver high quality streaming TV experience at a global scale. As part of our Content Platform team you join a small group of highly skilled engineers, that own significant responsibility in crafting, developing and maintaining our large-scale backend systems, data pipelines, storage, and processing services. We provide all insights in regard to all content on Roku Devices. 

About the Role

We are looking for a Senior Software Engineer with vast experience in backend development, Data Engineering and Data Analytics to focus on building next level content platform and data intelligence, which empowers Search, Recommendation, and many more critical systems across Roku Platform. This is an excellent role for a senior professional who enjoys a high level of visibility, thrives on having a critical business impact, able to make critical decisions and is excited to work on a core data platform component which is crucial for many streaming components at Roku.

What You’ll Be Doing

• Work closely with product management team, content data platform services, and other internal consumer teams to contribute extensively to our content data platform and underlying architecture.
• Build low-latency and optimized streaming and batch data pipelines to enable downstream services.
• Build and support our Micro-services based Event-Driven Backend Systems & Data Platform.
• Design and build data pipelines for batch, near-real-time, and real-time processing.
• Participate in architecture discussions, influence product roadmap, and take ownership and responsibility over new projects.

We’re excited if you have

• 8+ years professional experience as a Software Engineer.
• Proficiency in Java/Scala/Python.
• Deep understanding of backend technologies, architecture patterns, and best practices, including microservices, RESTful APIs, message queues, caching, and databases.
• Strong analytical and problem-solving skills, data structures and algorithms, with the ability to translate complex technical requirements into scalable and efficient solutions.
• Experience with Micro-service and event-driven architectures.
• Experience with Apache Spark and Apache Flink.
• Experience with Big Data Frameworks and Tools: MapReduce, Hive, Presto, HDFS, YARN, Kafka, etc.
• Experience with Apache Airflow or similar workflow orchestration tooling for ETL.
• Experience with cloud platforms: AWS (preferred), GCP, etc.
• Strong communication and presentation skills.
• BS in Computer Science; MS in Computer Science preferred.
• AI literacy and curiosity.You have either tried Gen AI in your previous work or outside of work or are curious about Gen AI and have explored it.

#LI-SJ1

About the team

• ML infrastructure: Help build a first-class machine learning platform from the ground up which manages the entire model lifecycle - feature engineering, model training, versioning, deployment, online serving/evaluation, and monitoring prediction quality.
• Data analysis and feature engineering: Apply your expertise to identify and generate features that can be leveraged by multiple use cases and models.
• Model training with batch and real-time prediction scenarios: Use machine learning and statistical modelling techniques such as Decision Trees, Logistic Regression, Neural Networks, Bayesian Analysis and others to develop and evaluate algorithms for improving product/system performance, quality, and accuracy.
• Production operations: Low-level systems debugging, performance measurement, and optimisation on large production clusters.
  Collaboration with cross-functional teams: Partner with product managers, data scientists, and other engineers to deliver impactful solutions.
  Staying ahead of the curve: Continuously learn and adapt to emerging technologies and industry trends.

• Bachelors, Masters, or PhD in Computer Science, Statistics, or a related field.
• Experience in applied machine learning on real use cases (bonus points for ad tech-related use cases). Min 5 years of total experience.
• Great coding skills and strong software development experience (we use Spark, Python, Java).
• Familiarity with real-time evaluation of models with low latency constraints.
• Familiarity with distributed ML frameworks such as Spark-MLlib, TensorFlow, etc.
• Ability to work with large scale computing frameworks, data analysis systems, and modelling environments. Examples include Spark, Hive, NoSQL stores such as Aerospike and ScyllaDB.
• Ad tech background is a plus.
• AI growth mindset / AI Literacy
  
  
  

About the team 

A reliable, privacy-safe, and scalable data foundation is critical to Roku’s rapidly growing advertising business. The Ad Data Activation organization builds the identity systems, device graph pipelines, audience platforms, insights tooling, and data collaboration capabilities that power targeting, measurement, and reporting across Roku Ads. 

We are hiring a Senior Machine Learning Engineer to help drive intelligence across these systems. You will work at the intersection of large-scale data platforms, applied machine learning, and generative AI — building capabilities that make Roku's advertising data more actionable for internal teams and advertisers. This includes building core generative AI platform features for Roku Advertising, while also applying traditional ML techniques to improve accuracy, automation, and decisioning across the ecosystem. If you enjoy working across data, ML, and new Gen-AI patterns — and want to shape how intelligence shows up inside Roku Ads — this role is for you. 

About the role 

In this role, you will design, build, and productionize intelligent capabilities that combine agentic Gen-AI systems with conventional ML pipelines across identity resolution, audience modeling, attribution, and optimization workflows. You will work with massive datasets, develop pipelines that transform raw signals into actionable features, and partner closely with product, data science, and platform teams. 

What you will be doing 

• Develop scalable and effective ML models and data pipelines to power identity, graph enrichment, audience segmentation, and campaign performance intelligence 

• Design and run experiments, measure impact, and translate results into product decisions and customer outcomes 

• Build and productionize agentic, generative-AI features — including reporting and insights agents, campaign-monitoring agents (with human-in-the-loop controls), and a semantic layer for reliable, natural-language analytics 

• Improve automation, reliability, and scalability across model training, feature engineering, deployment, and monitoring frameworks 

• Work closely with software and ML engineers to deliver end-to-end solutions from data ingestion through downstream systems 

• Partner with senior stakeholders to shape ML and Gen-AI strategy for Ad Data Activation — identifying the right problems for AI, ensuring safety, and driving advertiser productivity. 

We’re excited if you have 

• 5+ years of experience applying ML or data science to real business problems at scale 

• Master’s degree (or higher) and 4+ years of experience in CS, CE, ML, or a related field 

• Strong CS fundamentals and ability to design efficient algorithms and production systems 

• Experience with ML approaches used in large-scale data problems (e.g., regression, classification, tree-based methods, embeddings, sequence models, or basic NLP) 

• Strong intuition for defining KPIs, objective functions, and evaluation frameworks for ML-driven systems 

PREFERRED QUALIFICATIONS 

• Knowledge of programming languages such as Python, Scala/Java, C/C++, or similar 

• Experience working with large-scale data platforms (Spark, Presto/Trino, feature stores, data lakes, etc.) 

• Experience building or integrating with LLM/Gen-AI pipelines (prompting, evaluation, retrieval, safety) is a plus 

• Prior publications, patents, or open-source contributions are a plus 

About the team

Roku runs one of the largest data lakes in the world. We store over 70 PB of data, run 10+M queries per month, scan over 100 PB of data per month. 
Big Data team is the one responsible for building, running, and supporting the platform that makes this possible. We provide all the tools needed to acquire, generate, process, monitor, validate and access the data in the lake for both streaming data and batch. We are also responsible for generating the foundational data. The systems we provide include Scribe, Kafka, Hive, Presto, Spark, Flink, Pinot, and others. The team is actively involved in the Open Source, and we are planning to increase our engagement over time. 

About the Role 

Roku is in the process of modernizing its Big Data Platform. We are working on defining the new architecture to improve user experience, minimize the cost and increase efficiency. Are you interested in helping us build this state-of-the-art big data platform? Are you an expert with Big Data Technologies? Have you looked under the hood of these systems? Are you interested in Open Source? If you answered “Yes” to these questions, this role is for you! 

What you will be doing 

• You will be responsible for streamlining and tuning existing Big Data systems and pipelines and building new ones. Making sure the systems run efficiently and with minimal cost is a top priority 
• You will be making changes to the underlying systems and if an opportunity arises, you can contribute your work back into the open source 
• You will also be responsible for supporting internal customers and on-call services for the systems we host. Making sure we provided stable environment and great user experience is another top priority for the team 

We are excited if you have 

• 10+ years of production experience building big data platforms based upon Spark, Trino or equivalent 
• Strong programming expertise in Java, Scala, Kotlin or another JVM language. 
• A robust grasp of distributed systems concepts, algorithms, and data structures 
• Strong familiarity with the Apache Hadoop ecosystem: Spark, Kafka, Hive/Iceberg/Delta Lake, Presto/Trino, Pinot, etc. 
• Experience working with at least 3 of the technologies/tools mentioned here: Big Data / Hadoop, Kafka, Spark, Trino, Flink, Airflow, Druid, Hive, Iceberg, Delta Lake, Pinot, Storm etc 
• Extensive hands-on experience with public cloud AWS or GCP 
• BS/MS degree in CS or equivalent
• AI Literacy /AI growth mindset

About the team

Roku pioneered streaming to the TV and continues to innovate and lead the industry. While we are well-positioned to help shape the future of television – including TV advertising – around the world, continued success relies on its investment in our machine learning capabilities. Roku offers millions of options to our users: movies, episodes, news, sports, and channels from all around the world. The Roku Content Platform is key to onboarding content into the Roku ecosystem, delighting our customers. Building a content knowledge platform that provides insights to downstream systems like Search, Recommendations, Ads, and Voice to shape customers' experiences is why we’re actively looking for a Senior Machine Learning / AI Engineer, Content Platform who can drive further innovation.

About the role

Roku pioneered streaming to the TV and continues to innovate and lead the industry. While we are well-positioned to help shape the future of television – including TV advertising – around the world, continued success relies on its investment in our machine learning capabilities.

Roku offers millions of options to our users: movies, shows, news, sports, and channels from all around the world. The Roku Content Platform is key to onboarding content into the Roku ecosystem, delighting our customers. Building a content knowledge platform that provides insights to downstream systems like Search, Recommendations, Ads, and Voice to shape customers' experiences is why we’re actively looking for a Senior Machine Learning / AI Engineering Manager who can drive further innovation.

The person in this role will leverage their technical skills, business intuition, and analytical thinking to build best-in-class machine learning products. This includes integrating Generative AI capabilities and Vision Models to enrich content quality and user engagement. This is a role for a hardened ML practitioner and a highly skilled organizational leader. You will be the architectural and operational bridge between deep AI research and fast-paced product delivery. If you know how to build a 3-year vision for content discovery and translate it into 2-week shipping cycles, this is your team.

What you’ll be doing

• Vision & Strategy: Define the roadmap for ML within the Content Platform..
• Technical Leadership: Provide high-level guidance on model architecture and MLOps infrastructure to ensure models are scalable and production-ready.
• People Management: Lead and grow a high-performing team of ML Engineers. You will be responsible for career development, performance management, and maintaining a culture of rigorous experimentation.
• Cross-Functional Execution: Partner with Product, Engineering, and Content Strategy to align ML initiatives with business goals.
• Delivery: Champion a culture of incremental delivery. Balance long-term R&D with the need to deliver measurable improvements to the production environment.

We’re excited if you have

• 10+ years of total experience in software/ML engineering, with at least 5 years in a dedicated people management leadership role.
• MS or BS in Computer Science, Mathematics, or a related quantitative field.
• You possess a deep theoretical and practical understanding of Machine Learning. 
• You understand the business of streaming and how ML directly impacts the bottom line.
• You can explain complex model to a non-technical executive just as easily as you can debate architecture with a seasoned engineer.
• Proven track record of deploying large-scale ML models into production environments.
• Experience with modern ML stacks (e.g., LLMs, PyTorch, TensorFlow, Spark, and cloud-native MLOps tools).

Roku is the #1 TV streaming platform in the US, and we’ve set our sights on powering every television in the world. Roku pioneered streaming to the TV. Our mission is to be the TV streaming platform that connects the entire TV ecosystem. We connect consumers to the content they love, enable content publishers to build and monetize large audiences, and provide advertisers with unique capabilities to engage consumers.   

From your first day at Roku, you’ll make a valuable — and valued — contribution. We’re a fast-growing public company where no one is a bystander. We offer you the opportunity to delight millions of TV streamers worldwide while gaining meaningful experience across various disciplines. 

About the team 

Our team’s mission is to build cutting-edge advertising technology to support and help grow sustainable advertising business. The team owns server technologies, reporting infrastructure, data, cloud services, and test engineering for the advertising platforms within Roku. We also work closely with internal and external customers to help them achieve their advertising goals. 

About the role 

We are looking for an experienced manager to help grow the team, manage priorities, and communicate with stakeholders in an effective way. The role requires excellent communication skills in addition to a strong engineering background. The ideal candidate will have endless curiosity and can pair a global mindset with locally relevant execution. You should be a gritty problem solver and self-starter who can drive programs with the product and commercial teams within Roku and across external strategic partner organizations. The successful candidate will display a balance of hard and soft skills, including the ability to respond quickly to changing business needs. 
 

What you’ll be doing 

• Help grow the engineering team 

• Build scalable, resilient, and performant distributed systems for data processing, reporting and analytics 

• Work across engineering teams, data science, and product management to influence the direction of work and architecture 

• Communicate with internal stakeholders to inform and influence requirements and delivery  

• Take complete ownership of impactful initiatives and make pragmatic technical decisions. 

• Stakeholder management, developing good understanding of advertising business needs, building domain knowledge to understand systems and data better 

We’re excited if you have 
 

• 15+ years engineering experience working with modern big data technologies: Spark, Airflow, Scala, Java python, relational databases and related technologies 

• 6+ years’ experience leading technical teams and large-scale data processing systems 

• Experience building, growing and managing teams 

• Subject matter expertise in advertising and data processing 

• Solid understanding of data engineering, big data technologies, analytics and data science 

• Strong communication skills 

• Self-motivated individual with a high level of accountability and ownership 

• Critical thinker and practical decision maker 

• Can do, results-oriented mindset 

• Nonpolitical, collaborative, and team oriented 

About the role  

Our Search Platform sits at the heart of the Roku experience, powering voice, text, and visual discovery across 100M+ active accounts and every Roku-powered device worldwide.
 We own the entire stack —from ingesting & enriching a multi-million-title knowledge graph, to low-latency retrieval services and large-scale machine-learning systems that personalize results in real time. Our work doesn’t just help users find shows; it drives core product surfaces (home-screen rows, browse hubs, Roku Voice, mobile app search) and fuels partner monetization. If you enjoy turning cutting-edge research into products used billions of times a day, you’ll thrive here.

Roku’s footprint has more than quadrupled in the past five years, and user expectations have leaped just as fast—think LLM-based query understanding, vector-DB retrieval, on-device models, and multimodal search (voice, text, image). We’re now rebuilding our relevance stack for the next decade, blending classic IR with generative-AI techniques. You will be a technical leader spearheading that transformation. 

What you'll be doing 

• Apply state of the art ML on search using techniques in deep learning, bandits, transformers, LLMs, causal inference, and optimizations to make our users more delighted and engaged on the platform 
• Run online AB tests and analyze them against the critical business KPIs 
• Collaborate with US engineering teams as well as cross-functional teams to translate business requirements into technical specifications 
• Nurture our ML ecosystem to make it withstand scale, developer velocity and future business shifts 
• Provide technical leadership to drive technical and ML roadmap for search ranking and monetization 
• Help recruiting new engineers. Interview, train, and mentor new team members 
  
  We're excited if you have 
  
  
• 7+ years of experience (or PhD with 5 years of experience) applying Machine Learning to concrete problems at large-scale in domains like recommendation or search or ads 
• Strong CS fundamentals. Should be able covert ideas to code with ease 
• Good understanding of machine learning fundamentals like classification, deep neural nets, and sequence-based models. Familiarity with modern NLP stack and multi-modal representation learning is a plus 
• We'd love to see that you've worked with big data systems (Spark, S3, and Airflow) and can program (Java, Scala, or Python)  
• Good understanding of system architecture 
• Experience in big data technologies and streaming architecture, data pipelines, etc. 
• MS in Computer Science, Statistics, or related field, but a Ph.D. in CS or related fields is preferred 
  
• AI literacy and curiosity.You have either tried Gen AI in your previous work or outside of work or are curious about Gen AI and have explored it. 

#LI-AK1

About the Team 

The DMP team plays a critical role in Roku’s Advertising organization, leading initiatives around audience management that power decision-making across the advertising ecosystem. We develop and manage products that enable advanced segmentation and audience management for advertisers while meeting the operational needs of internal teams. We work closely with Product Managers, Machine Learning, Ad Sales, Ads Operations, and multiple groups within Advertising Engineering to deliver high-impact solutions.Looking ahead, we are exploring AI-driven capabilities to further enhance the effectiveness of advertising campaigns and improve operational efficiency of our platforms. 

About the Role 

We are seeking a highly skilled Senior Software Engineer with deep expertise in big data technologies, including Apache Spark and Apache Airflow. This hybrid position bridges software engineering and data engineering, requiring the ability to design, build, and maintain scalable systems for both application development and large-scale data processing.In this role, you will collaborate with cross-functional teams to architect and manage robust, production-grade data products and APIs that power critical capabilities across the advertising platform. You will work with technologies such as Apache Spark, Apache Airflow, ScyllaDB/Cassandra, Aerospike, Kubernetes, and SpringBoot to deliver reliable, high-performance solutions. The ideal candidate is a proactive, self-motivated professional with a strong track record in building high-scale data services and a dedication to delivering exceptional results. 

What You’ll Be Doing 

Software Development 

• Design and build APIs and backend services using Spring Boot to support data products and audience management workflows. 

• Write clean, maintainable, and efficient code, ensuring adherence to best practices through code reviews. 

Big Data Engineering 

• Design, develop, and maintain data pipelines and ETL workflows using Apache Spark and Apache Airflow. 

• Optimize data storage, retrieval, and processing systems to ensure reliability, scalability, and performance. 

• Develop and fine-tune complex queries using Apache Spark for large-scale datasets. 

• Monitor, troubleshoot, and improve data systems to minimize downtime and maximize efficiency. 

API and Platform Development

• Design, Development, and maintain large scale, low latency API systems using SpringBoot and Kubernetes

• Maintain NoSQL Infrastructure including ScyllaDB and Aerospike

Collaboration & Mentorship 

• Partner with the machine learning team, software engineers, and other teams to deliver integrated, high-quality solutions. 

• Provide technical guidance and mentorship to junior engineers, promoting best practices in software and data engineering.

We’re Excited If You Have 

• Bachelor's degree in computer science, Engineering, or a related field (or equivalent experience). 

• 8+ years of experience in software and/or data engineering with expertise in big data technologies such as Apache Spark, Apache Airflow.

• Expertise in developing low latency APIs
  

• Strong understanding of SOLID principles and distributed systems architecture. 

• Proven experience in distributed data processing, data warehousing, and real-time data pipelines. 

• Advanced SQL skills, with expertise in query optimization for large datasets. 

• Exceptional problem-solving abilities and the capacity to work independently or collaboratively. 

• Excellent verbal and written communication skills. 

• Experience with cloud platforms such as AWS, GCP, or Azure, and containerization tools like Docker and Kubernetes. (preferred) 

• Experience in AdTech, in advertising data platforms and audience management. (preferred)

• Strong programming skills in Python, Java, and/or Scala. (preferred) 

• Knowledge of CI/CD pipelines, DevOps practices, and infrastructure-as-code tools (e.g., Jenkins & Terraform). (preferred) 

• Expertise in developing low latency APIs

•  Experience with building Agentic AI systems to automate decision-making and enhance analytics workflows. (preferred)

• Experience in AdTech, in advertising data platforms and audience management. (preferred)
  

About the Team 

The Data Insights team plays a critical role in Roku’s Advertising organization, leading measurement and analytics initiatives that power decision-making across the advertising ecosystem. We develop and manage products that deliver actionable insights for advertisers while meeting the operational and analytical needs of internal teams.We work closely with Product Managers, Data Science, Ad Sales, Ads Operations, and multiple groups within Advertising Engineering to deliver high-impact solutions. Looking ahead, we are exploring AI-driven measurement capabilities to further enhance the effectiveness of advertising campaigns and strengthen internal analytics. 

About the Role 

We are seeking a highly skilled Senior Software Engineer with deep expertise in big data technologies, including Apache Spark and Apache Airflow. This hybrid position bridges software engineering and data engineering, requiring the ability to design, build, and maintain scalable systems for both application development and large-scale data processing.In this role, you will collaborate with cross-functional teams to architect and manage robust, production-grade data products that power critical analytics and measurement capabilities. You will work with technologies such as Apache Spark, Apache Airflow, Trino, Druid, Spring Boot, StarRocks, and Looker to deliver reliable, high-performance solutions.The ideal candidate is a proactive, self-motivated professional with a strong track record in building high-scale data services and a dedication to delivering exceptional results.

What You’ll Be Doing 

Software Development 

• Design and build APIs and backend services using Spring Boot to support data products and analytics workflows. 

• Write clean, maintainable, and efficient code, ensuring adherence to best practices through code reviews. 

Big Data Engineering 

• Design, develop, and maintain data pipelines and ETL workflows using Apache Spark and Apache Airflow. 

• Optimize data storage, retrieval, and processing systems to ensure reliability, scalability, and performance. 

• Develop and fine-tune complex queries and analytics solutions using Druid, Trino, and StarRocks for large-scale datasets. 

• Monitor, troubleshoot, and improve data systems to minimize downtime and maximize efficiency. 

Collaboration & Mentorship 

• Partner with data scientists, software engineers, and other teams to deliver integrated, high-quality solutions. 

• Provide technical guidance and mentorship to junior engineers, promoting best practices in software and data engineering. 

We’re Excited If You Have 

• Bachelor's degree in computer science, Engineering, or a related field (or equivalent experience). 

• 8+ years of experience in software and/or data engineering with expertise in big data technologies such as Apache Spark, Apache Airflow. 

• Expertise with atleast one of the following Apache Druid, StarRocks, and Trino. 

• Strong understanding of SOLID principles and distributed systems architecture. 

• Proven experience in distributed data processing, data warehousing, and real-time data pipelines. 

• Advanced SQL skills, with expertise in query optimization for large datasets. 

• Exceptional problem-solving abilities and the capacity to work independently or collaboratively. 

• Excellent verbal and written communication skills. 

• Experience with cloud platforms such as AWS, GCP, or Azure, and containerization tools like Docker and Kubernetes. (preferred) 

• Familiarity with additional big data technologies, including Hadoop and Kafka.  

• Experience in AdTech, in advertising data platforms and campaign measurement. (preferred)

• Strong programming skills in Python, Java, or Scala. (preferred) 

• Knowledge of CI/CD pipelines, DevOps practices, and infrastructure-as-code tools (e.g., Terraform). (preferred) 

• Expertise in data modeling, schema design, and data visualization tools.

• Experience with building Agentic AI systems to automate decision-making and enhance analytics workflows. (preferred) 

About the team

The mission of Roku's Data Engineering team is to develop a world-class big data platform so that internal and external customers can leverage data to grow their businesses. Data Engineering works closely with business partners and Engineering teams to collect metrics on existing and new initiatives that are critical to business success. As Senior Data Engineer working on Device metrics, you will design data models & develop scalable data pipelines to capturing different business metrics across different Roku Devices.

About the role

Roku pioneered streaming to the TV. We connect users to the streaming content they love, enable content publishers to build and monetise large audiences, and provide advertisers with unique capabilities to engage consumers. Roku streaming players and Roku TV™ models are available around the world through direct retail sales and licensing arrangements with TV brands and pay-TV operators.With tens of million players sold across many countries, thousands of streaming channels and billions of hours watched over the platform, building scalable, highly available, fault-tolerant, big data platform is critical for our success.This role is based in Bangalore, India and requires hybrid working, with 3 days in the office.

What you'll be doing

• Build highly scalable, available, fault-tolerant distributed data processing systems (batch and streaming systems) processing over 10s of terabytes of data ingested every day and petabyte-sized data warehouse
• Build quality data solutions and refine existing diverse datasets to simplified data models encouraging self-service
• Build data pipelines that optimise on data quality and are resilient to poor quality data sources
• Own the data mapping, business logic, transformations and data quality
• Low level systems debugging, performance measurement & optimization on large production clusters
• Participate in architecture discussions, influence product roadmap, and take ownership and responsibility over new projects
• Maintain and support existing platforms and evolve to newer technology stacks and architectures

We're excited if you have

• Extensive SQL Skills
• Proficiency in at least one scripting language, Python is required
• Experience in big data technologies like HDFS, YARN, Map-Reduce, Hive, Kafka, Spark, Airflow, Presto, etc.
• Proficiency in data modeling, including designing, implementing, and optimizing conceptual, logical, and physical data models to support scalable and efficient data architectures.
• Experience with AWS, GCP, Looker is a plus
• Collaborate with cross-functional teams such as developers, analysts, and operations to execute deliverables
• 8+ years professional experience as a data Engineer 
• BS in Computer Science; MS in Computer Science preferred
• AI Literacy / AI growth mindset

Who We Are

About Stripe

Stripe is a financial infrastructure platform for businesses. Millions of companies - from the world’s largest enterprises to the most ambitious startups - use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career.

About the Team

The Batch Compute Infrastructure team at Stripe manages the foundational infrastructure, tooling, and distributed systems behind Stripe's massive-scale batch processing environments, currently encompassing over 5,000 computational nodes. Powered primarily by Hadoop, Spark, and Celeborn, these systems are the backbone for several core asynchronous financial, analytical, and regulatory workflows at Stripe, operating at petabyte scale.

What you’ll do -
You will support a team of engineers focused on building the tooling, infra and systems for operating Spark, Hadoop and Celeborn at Stripe. In addition to helping define the roadmap for these systems, you will be interacting with many other managers and their teams at Stripe, who rely on the Data processing Infra team to deliver efficient and scalable services to our customers. You will work with both the finance and engineering organization (infrastructure & product) to define, measure and monitor the cost efficiency of these systems. 

Responsibilities

• Drive Strategic Vision: Define the multi-year roadmap for Stripe’s Batch Compute Infrastructure, leading complex architectural shifts and modernization.
• Lead and Scale: Build, mentor, and aggressively scale a high-performing team of engineers, proactively investing in their career development and fostering a culture of operational excellence.
• Ensure Operational Rigor: Maintain unwavering reliability for a Tier-0 infrastructure processing tens of thousands of daily workloads, proactively mitigating risks and managing complex on-call telemetry.
• Cross-Functional Orchestration: Collaborate deeply with data platform teams, finance, and user groups to define compute efficiency metrics, execute massive-scale cost optimization strategies, and guarantee compliance with global financial regulations.
• Technical Stewardship: Provide technical guidance in architecture reviews, evaluating critical cost, performance, and reliability trade-offs in distributed systems design involving Hadoop, Spark, AWS cloud primitives, and modern metastores.

Who You Are

Minimum requirements

• 10+ years of professional software development and engineering experience.
• 3+ years of direct engineering management experience, successfully building and operating high-velocity technical teams.
• Deep technical background in building, scaling, and maintaining large-scale distributed data systems or Tier-0 infrastructure using open-source tools (e.g., Hadoop, Spark, Celeborn, Airflow, Kafka).
• Proven track record of driving significant infrastructure efficiency, managing capacity planning, and making data-driven cost-performance trade-offs.
• Experience working effectively in highly cross-functional, global organizations.

Preferred requirements

• Experience managing remote or geographically distributed engineering teams.
• Familiarity with managing a massive fleet of Linux servers, on-premise Hadoop clusters, and modern cloud data architectures (e.g., AWS S3, Graviton).
• Demonstrated ability to navigate strategic ambiguity and deliver complex, multi-quarter infrastructural projects from inception to completion.
• Deep empathy for internal data users with a passion for building robust developer tooling and abstractions.

Who we are

About Stripe

Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world’s largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career.

About the team

We are experts in data, working to make it cost-effective, understandable, and trustworthy. We build pipelines processing billions of events a day and are stewards of canonical data warehouses and datasets delivering products for Stripe Users while embedding with teams to build their data products.  We are experts in using the Stripe Data Platform and to scale we lead the data culture and data education to enable product teams to own their data. We invest in [AI] Data Ops to scale incident handling and serve as an escalation path for data incidents to minimize their impact. The Data Engineering Solutions team will work closely with product teams delivering trustworthy data / backend code / and innovative (AI) tools/platforms/services for data.

What you’ll do

We're looking for a person who could drive the Data Engineering Solutions Team in solving high-impact, cutting-edge data problems. The ideal candidate will be someone that has built data pipelines for large scale volume, is deeply knowledgeable of Data Engineering tools including Airflow/Spark/Kafka/Flink, is empathetic, excels at building strong relationships, and collaborates effectively with other Stripe teams to understand their use cases and unlock new capabilities.

You will:

• Lead the technical outcomes for a team of ambitious, talented engineers, providing mentorship, guidance, and support to ensure their success.
• Partner with our recruiting team to attract and hire top talent.
• Deliver cutting-edge data pipelines that scale to users' needs, focusing on reliability and efficiency.
• Develop strong subject matter expertise and manage the SLAs of data pipelines and full stack web applications that support critical stakeholders.
• Collaborate with product managers and peers across the company to create/improve canonical datasets and data warehouses, use golden paths, and ensure Stripes and customers are using trustworthy data.
• Leverage AI/LLM and Agents at scale to produce and analyze high-quality data on ambiguous problems
• Have an opportunity to work with Spark, Flink, Kafka, Trino, Pinot, Airflow, Scala, Java, SQL, and Python and many other big data technologies.
• Have the opportunity to drive the execution of key data initiatives for Stripe, overseeing the entire development lifecycle from planning to delivery while maintaining high standards of quality and timely completion.
• Foster a collaborative and inclusive work environment, promoting innovation, knowledge sharing, and continuous improvement within the team.

Who you are

We’re looking for someone who meets the minimum requirements to be considered for the role. If you meet these requirements, you are encouraged to apply. The preferred qualifications are a bonus, not a requirement.

Minimum requirements

We’re looking for someone who has: 

• 10+ Years of engineering experience with 5+ Years of hands-on experience building+operating data systems/pipelines, datasets/data warehouses, infrastructure, and leading small teams to deliver exceptional solutions.
• A strong engineering background and passion for data.
• Prior experience with writing and debugging data pipelines using a distributed data framework (Spark / Hadoop / Trino / etc)
• An inquisitive nature in diving into data inconsistencies to pinpoint issues, and resolve deep rooted data quality issues
• Knowledge of a backend development language (such as Scala, Java, or Go) and strong SQL experience
• Extreme customer focus, with a commitment to partnering with Product Managers, leaders, and other Stripe engineers to understand their use cases.
• Effective cross-functional collaboration, with the ability to think rigorously, communicate clearly, and make or coordinate difficult decisions and trade-offs.
• Thrive with high autonomy and responsibility in an ambiguous environment.
• Ability to foster and work in a healthy, inclusive, challenging, and supportive work environment.

Preferred qualifications

• Expertise in Iceberg, Kafka, Change Data Capture, Flink, Spark, Airflow, Hive Metastore, Pinot, Trino, AWS Cloud, and influencing open-source contributions is a plus.
• Experience creating and maintaining Data Marts / Data Warehouses to power business reporting needs
• Experience working with Product or Go-To-Market (GTM - Sales/Marketing) teams
• Genuine enjoyment of innovation and a deep interest in understanding how things work, with the ability to question and direct architectural decisions.
• Strong written and verbal communication skills for various audiences, including leadership, users, and company-wide.

We're seeking a Head of Machine Learning to own and scale the ML function at Prodigal. This is the senior-most ML role in the company — partnering directly with the CTO as a peer technical leader, defining the multi-year ML vision, building and leading a world-class team, and translating cutting-edge research into production systems that move the needle for over 100 customers and millions of consumers. You'll set the bar for technical excellence, hire and develop the next generation of ML leaders, and shape what consumer finance intelligence looks like over the next decade. If you've operated at this level before — or are ready to step into it at a company where ML is the engine of the product — we want to talk.

Responsibilities:

• Own the ML function end-to-end — vision, roadmap, team, delivery, and measurable business impact across classical ML, NLP, GenAI, and Agentic AI
• Partner with the CTO as the senior ML leader to set company-wide technical direction and shape the long-term roadmap for Prodigal's Intelligence Engine
• Build and lead a high-performing ML organization — hire, mentor, and develop ML engineers, applied scientists, and tech leads across multiple pods
• Translate research into product — drive the application of LLMs, Agentic AI, the modern NLP stack, recommendation systems, and classical ML into production systems serving 100+ customers
• Set technical standards for model development, deployment, monitoring, evaluation, and experimentation that scale across the org
• Architect data and ML infrastructure in partnership with the platform and engineering teams to support large-scale training and reliable, low-latency inference
• Communicate strategy and outcomes clearly to the founders, board, customers, and broader engineering organization
• Represent Prodigal externally — at conferences, in research collaborations, and as a senior voice in the consumer finance AI community
• Stay at the frontier of ML and GenAI research, identifying where new techniques unlock product and business advantage
• Collaborate cross-functionally with product, engineering, GTM, and customer success leaders to ensure ML investment ties directly to revenue, retention, and customer outcomes

Requirements:

• 10+ years of experience in machine learning and software development at a tech or product company, with 4+ years leading ML teams (managing engineers and/or tech leads)
• Proven track record of shipping ML products in production at scale with measurable business impact
• Deep technical fluency across classical ML, deep learning, and the modern NLP/LLM stack — you can still go deep in design reviews, not just review at the surface
• Strong coding skills in Python. Hands-on with PyTorch, scikit-learn, Pandas, and Spark
• Demonstrated success hiring, mentoring, and growing ML talent — including team leads and senior engineers
• Strong executive communication and the ability to set technical direction with founders, peers, and the board
• A bias for outcomes — you connect model work to revenue, engagement, and operational metrics

Preferred Qualifications:

• Experience as a founding ML hire, ML lead, or applied science leader at a high-growth AI/ML product company
• Background in voice AI, conversational AI, speech, NLP on unstructured text, or fintech/lending domains
• Experience with cloud services (AWS), Databricks, and building scalable, distributed systems
• Track record of running A/B testing and experimentation programs at scale
• Patents, publications, or open-source contributions; strong institutional pedigree (IIT, BITS, NIT, IISc)
• Experience scaling an ML org through a hypergrowth phase

Job Benefits

• GenAI at the core – Lead the ML function at a company where AI isn't a feature, it's the product. Shape groundbreaking work that redefines consumer finance intelligence.
• World-class team - You'll get the chance to learn from (and teach) some of the brightest and most skilled people you'll ever meet. Our team members have been part of BCG, Deloitte, EY, Blackstone, Meta, Amazon and are IIT, IIM, BITS alumnus.
• Continuous education - As relentless seekers of knowledge, we sponsor and support any training materials, books, courses, and exam fees for upskilling yourself in areas related to your role - but that's not where it ends. If you make a good case for some extra learning, we're delighted to foot the tab.
• Food at the office – Meals are on us. We won't let your stomach grumble while you hustle.
• Health insurance - Health always comes first. The health of your family is as important to us as it is to you. We offer insurance coverage for both you and your family.
• Flexible schedule - We're not a "clock in, clock out" company. Morning person? Start work while the world's still sleeping. Night owl? Ramp things up while others are winding down. You're fully trusted to create the right conditions for your own personal peak productivity. We only ask that you be available to your teammates for seamless collaboration.
• Generous leave policy - Take all the time you need to recharge your batteries - no cap on vacation here. Because a rested, relaxed, and refreshed mind is a happy and effective mind.
• Recreation & team activities – We regularly indulge in friendly football, table tennis, cooking sessions, and challenge each other to do those extra push-ups or chug that 4th drink (of course, that's Nimbu Pani).

Meet Sangram (Cofounder and CTO) and hear his vision for Prodigal: https://www.youtube.com/embed/FTWlN9fwiIA?feature=shared

As a Staff Backend Engineer, you will be a highly technical individual contributor responsible for designing, building, and optimizing the backend systems that power our low-latency ad platform. You will take the lead in developing scalable microservices and streaming data infrastructure to handle high-throughput workloads with minimal latency. This role requires deep expertise in distributed systems and real-time data processing (ideally in the programmatic advertising domain) to ensure our systems remain highly performant and reliable. You’ll work closely with product managers, data scientists, and other engineering teams to translate business needs into technical solutions and ensure the platform is fast, fault-tolerant, and observable. This role is based in the United States and can be performed remotely, with a preference for candidates who can join us in a hybrid capacity in San Francisco, New York, or Atlanta.

Responsibilities:

• System Architecture & Development: Lead the design and implementation of scalable, high-performance backend services, including microservices and APIs, that can efficiently handle large volumes of requests with low latency. Ensure the architecture accommodates real-time bidding and personalization use cases common in AdTech.
• Streaming Data Infrastructure: Develop and maintain streaming data pipelines and event-driven systems to process and analyze continuous data flows in real time (e.g., using Apache Kafka). Optimize data ingestion and processing for timeliness and accuracy to support downstream analytics and machine-learning models.
• Performance & Reliability: Ensure the backend systems are highly performant, resilient, and stable under heavy load. Implement robust fault-tolerance mechanisms and optimize for low-latency response times in a high-concurrency environment. Leverage observability best practices (comprehensive monitoring, logging, and tracing) to enable engineers to quickly analyze system behavior and take proactive measures to boost performance and reliability.
• Cross-Functional Collaboration: Work closely with cross-functional teams – including Product, Data Science, DevOps, and Frontend – to translate business requirements into scalable technical solutions. Facilitate effective communication and collaborative problem-solving to deliver new features and improvements that align with our product roadmap.
• Technical Leadership & Mentorship: Provide technical leadership within the engineering team without direct managerial duties. Guide and mentor junior engineers through code reviews, design discussions, and best practice adoption, fostering a culture of technical excellence and continuous improvement.
• Technical Strategy & Innovation: Stay abreast of emerging technologies and industry trends (e.g. new AWS services, streaming frameworks, database technologies) and evaluate their potential benefit to our platform. Contribute to the technical roadmap, making build-vs-buy recommendations and driving innovation to keep our systems ahead of the curve.

Required Qualifications:

• 8+ years of software engineering experience building backend systems, with 3+ years in a senior or lead role (e.g. Staff Engineer, Principal Engineer) in the AdTech or a similar high-volume, low-latency domain.
• Proven track record in designing and building high-throughput, low-latency distributed systems that operate at scale (e.g. handling thousands of requests per second or more).
• Expertise in microservices architecture and distributed system design, including experience decomposing monoliths or building greenfield microservices with well-defined APIs.
• Proficiency in Java and Go for backend development, and experience with Python for scripting, automation, or data processing tasks.
• Hands-on experience with streaming data technologies and event-driven frameworks, such as Apache Kafka (or AWS Kinesis), and possibly stream processing frameworks (Spark Streaming, Flink, or similar, experience with Apache Kafka is highly desired).
• Strong experience with cloud platforms (AWS preferred) and deploying services in a cloud-native environment. Familiarity with AWS components like EC2, S3, Lambda, SNS/SQS, etc., and ability to design cost-effective, performant cloud architectures.
• Experience with both SQL and NoSQL databases for high-volume applications. Comfortable with technologies like PostgreSQL/MySQL as well as key-value or wide-column stores (e.g. DynamoDB, Cassandra, Redis) for caching and fast lookups.
• Familiarity with containerization and orchestration tools (Docker, Kubernetes) and CI/CD pipelines to build and deploy microservices reliably.
• Deep understanding of system observability and monitoring – experience instrumenting applications and using monitoring/logging tools to ensure visibility into system performance (e.g. Prometheus, Grafana, ELK stack or similar).
• Excellent problem-solving and communication skills. Ability to communicate complex technical concepts clearly to cross-functional team members and stakeholders. Proven collaboration skills in an agile development environment.

Preferred Qualifications:

• Domain Expertise: Deep knowledge of the programmatic advertising ecosystem, including how Demand-Side Platforms (DSPs), Supply-Side Platforms (SSPs), ad exchanges, and real-time bidding (RTB) work together. Prior experience building or optimizing components of a DSP or ad server is a strong plus.
• High-Scale Data Processing: Experience designing systems that operate at extreme scale, such as real-time auction systems or high-frequency trading platforms, and optimizing algorithms for latency and throughput (e.g. understanding of auction theory or bidding optimization strategies).
• Data Pipelines & Analytics: Familiarity with big data processing and analytics pipelines (Spark, Hadoop, or columnar data stores) for batch and streaming workloads. Experience with data warehousing or real-time analytics databases (e.g. Druid, ClickHouse) is a plus.
• Advanced Performance Tuning: Demonstrated experience in performance profiling and optimization (e.g. JVM tuning, concurrency, GC optimization, network I/O) in large-scale Java or Go applications.
• Leadership in the Tech Community: A track record of contributing to open-source projects, technical publications, or speaking at industry conferences. Keeping on top of emerging trends and sharing knowledge both inside and outside the organization.
• Education: Bachelor’s degree in Computer Science, Engineering, or related field (Master’s or Ph.D. a plus), with strong foundations in algorithms and data structures.

Company Profile:

Zeta Global is a NYSE listed data-powered marketing technology company with a heritage of innovation and industry leadership. Founded in 2007 by entrepreneur David A. Steinberg and John Sculley, former CEO of Apple Inc and Pepsi-Cola, the Company combines the industry’s 3rd largest proprietary data set (2.4B+ identities) with Artificial Intelligence to unlock consumer intent, personalize experiences and help our clients drive business growth.

Our technology runs on the Zeta Marketing Platform, which powers ‘end to end’ marketing programs for some of the world’s leading brands. With expertise encompassing all digital marketing channels – Email, Display, Social, Search and Mobile – Zeta orchestrates acquisition and engagement programs that deliver results that are scalable, repeatable and sustainable.

Zeta Global is an Equal Opportunity/Affirmative Action employer and does not discriminate on the basis of race, gender, ancestry, color, religion, sex, age, marital status, sexual orientation, gender identity, national origin, medical condition, disability, veterans status, or any other basis protected by law.

ZETA IN THE NEWS!

https://zetaglobal.com/press/?cat=press-releases 

As a Staff Backend Engineer, you will be a highly technical individual contributor responsible for designing, building, and optimizing the backend systems that power our low-latency ad platform. You will take the lead in developing scalable microservices and streaming data infrastructure to handle high-throughput workloads with minimal latency. This role requires deep expertise in distributed systems and real-time data processing (ideally in the programmatic advertising domain) to ensure our systems remain highly performant and reliable. You’ll work closely with product managers, data scientists, and other engineering teams to translate business needs into technical solutions and ensure the platform is fast, fault-tolerant, and observable. This role is based in the United States and can be performed remotely, with a preference for candidates who can join us in a hybrid capacity in San Francisco, New York, or Atlanta.

Key Responsibilities

• System Architecture & Development: Lead the design and implementation of scalable, high-performance backend services, including microservices and APIs, that can efficiently handle large volumes of requests with low latency. Ensure the architecture accommodates real-time bidding and personalization use cases common in AdTech.
• Streaming Data Infrastructure: Develop and maintain streaming data pipelines and event-driven systems to process and analyze continuous data flows in real time (e.g., using Apache Kafka). Optimize data ingestion and processing for timeliness and accuracy to support downstream analytics and machine-learning models.
• Performance & Reliability: Ensure the backend systems are highly performant, resilient, and stable under heavy load. Implement robust fault-tolerance mechanisms and optimize for low-latency response times in a high-concurrency environment. Leverage observability best practices (comprehensive monitoring, logging, and tracing) to enable engineers to quickly analyze system behavior and take proactive measures to boost performance and reliability.
• Cross-Functional Collaboration: Work closely with cross-functional teams – including Product, Data Science, DevOps, and Frontend – to translate business requirements into scalable technical solutions. Facilitate effective communication and collaborative problem-solving to deliver new features and improvements that align with our product roadmap.
• Technical Leadership & Mentorship: Provide technical leadership within the engineering team without direct managerial duties. Guide and mentor junior engineers through code reviews, design discussions, and best practice adoption, fostering a culture of technical excellence and continuous improvement.
• Technical Strategy & Innovation: Stay abreast of emerging technologies and industry trends (e.g. new AWS services, streaming frameworks, database technologies) and evaluate their potential benefit to our platform. Contribute to the technical roadmap, making build-vs-buy recommendations and driving innovation to keep our systems ahead of the curve.

Required Qualifications:

• 8+ years of software engineering experience building backend systems, with 3+ years in a senior or lead role (e.g. Staff Engineer, Principal Engineer) in the AdTech or a similar high-volume, low-latency domain.
• Proven track record in designing and building high-throughput, low-latency distributed systems that operate at scale (e.g. handling thousands of requests per second or more).
• Expertise in microservices architecture and distributed system design, including experience decomposing monoliths or building greenfield microservices with well-defined APIs.
• Proficiency in Java and Go for backend development, and experience with Python for scripting, automation, or data processing tasks.
• Hands-on experience with streaming data technologies and event-driven frameworks, such as Apache Kafka (or AWS Kinesis), and possibly stream processing frameworks (Spark Streaming, Flink, or similar, experience with Apache Kafka is highly desired).
• Strong experience with cloud platforms (AWS preferred) and deploying services in a cloud-native environment. Familiarity with AWS components like EC2, S3, Lambda, SNS/SQS, etc., and ability to design cost-effective, performant cloud architectures.
• Experience with both SQL and NoSQL databases for high-volume applications. Comfortable with technologies like PostgreSQL/MySQL as well as key-value or wide-column stores (e.g. DynamoDB, Cassandra, Redis) for caching and fast lookups.
• Familiarity with containerization and orchestration tools (Docker, Kubernetes) and CI/CD pipelines to build and deploy microservices reliably.
• Deep understanding of system observability and monitoring – experience instrumenting applications and using monitoring/logging tools to ensure visibility into system performance (e.g. Prometheus, Grafana, ELK stack or similar).
• Excellent problem-solving and communication skills. Ability to communicate complex technical concepts clearly to cross-functional team members and stakeholders. Proven collaboration skills in an agile development environment.

Preferred Qualifications:

• Domain Expertise: Deep knowledge of the programmatic advertising ecosystem, including how Demand-Side Platforms (DSPs), Supply-Side Platforms (SSPs), ad exchanges, and real-time bidding (RTB) work together. Prior experience building or optimizing components of a DSP or ad server is a strong plus.
• High-Scale Data Processing: Experience designing systems that operate at extreme scale, such as real-time auction systems or high-frequency trading platforms, and optimizing algorithms for latency and throughput (e.g. understanding of auction theory or bidding optimization strategies).
• Data Pipelines & Analytics: Familiarity with big data processing and analytics pipelines (Spark, Hadoop, or columnar data stores) for batch and streaming workloads. Experience with data warehousing or real-time analytics databases (e.g. Druid, ClickHouse) is a plus.
• Advanced Performance Tuning: Demonstrated experience in performance profiling and optimization (e.g. JVM tuning, concurrency, GC optimization, network I/O) in large-scale Java or Go applications.
• Leadership in the Tech Community: A track record of contributing to open-source projects, technical publications, or speaking at industry conferences. Keeping on top of emerging trends and sharing knowledge both inside and outside the organization.
• Education: Bachelor’s degree in Computer Science, Engineering, or related field (Master’s or Ph.D. a plus), with strong foundations in algorithms and data structures.

WHO WE ARE 

Zeta Global (NYSE: ZETA) is the AI-Powered Marketing Cloud that leverages advanced artificial intelligence (AI) and trillions of consumer signals to make it easier for marketers to acquire, grow, and retain customers more efficiently. Through the Zeta Marketing Platform (ZMP), our vision is to make sophisticated marketing simple by unifying identity, intelligence, and omnichannel activation into a single platform – powered by one of the industry’s largest proprietary databases and AI. Our enterprise customers across multiple verticals are empowered to personalize experiences with consumers at an individual level across every channel, delivering better results for marketing programs. Zeta was founded in 2007 by David A. Steinberg and John Sculley and is headquartered in New York City with offices around the world. To learn more, go to www.zetaglobal.com.

PEOPLE & CULTURE AT ZETA

Zeta considers applicants for employment without regard to, and does not discriminate on the basis of an individual’s sex, race, color, religion, age, disability, status as a veteran, or national or ethnic origin; nor does Zeta discriminate on the basis of sexual orientation, gender identity or expression.  

We’re committed to building a workplace culture of trust and belonging, so everyone feels invited to bring their whole selves to work. We provide a forum for employees to celebrate, support and advocate for one another. Learn more about our commitment to diversity, equity and inclusion here:  https://zetaglobal.com/blog/a-look-into-zetas-ergs/ 

ZETA IN THE NEWS!

https://zetaglobal.com/press/?cat=press-releases 

At Zeta Global, identity is at the core of our marketing cloud. The Identity team builds and operates backend services that power the Zeta Identity Graph - collecting, resolving, and maintaining billions of behavioural, demographic, and transactional signals. These services enable people-based marketing at scale, ensure trust and transparency in how identity data is managed, and provide critical APIs and event streams consumed across Zeta’s platform. Our systems support more than 235 million consumer profiles and process billions of events monthly, requiring services that are highly available, low-latency, and built to scale.

We are looking for a Lead Software Engineer who brings strength in both backend distributed systems and data engineering. In this role, you’ll design APIs and event-driven services, scale our systems to handle rapidly growing data volumes, and modernize our platform for resilience, transparency, and performance.

You Will:

• Design and build backend services and APIs for identity resolution, graph transparency, and integrations.
• Develop and optimize event-driven pipelines and workflows processing billions of signals.
• Deploy and operate cloud-native services on EKS/Kubernetes, leveraging Helm for repeatable deployments.
• Ensure reliability, observability, and scalability across services and data pipelines.
• Collaborate across engineering, product, and data teams to deliver end-to-end identity solutions.
• Mentor engineers and influence architecture and roadmap decisions.

You Have:

• 7+ years of experience in backend and/or data engineering at scale.
• Strong skills in Python, Java, or Scala, with expertise in APIs, distributed systems, and event-driven design.
• Hands-on experience with Kafka (or similar), Spark/Hive/Flink, and workflow schedulers (Airflow/Luigi).
• Proficiency with Kubernetes (EKS preferred) and deployment practices (Helm, service meshes).
• Solid knowledge of SQL, data modelling, and cloud platforms (AWS).
• Familiarity with columnar / NoSQL databases (Aerospike, Snowflake, HBase, Scylla, Elasticsearch)
• Knowledge of performance optimization and resilience patterns (caching, retries, fault tolerance).
• Familiarity with CI/CD and automated testing practices for backend services.
• Strong communication skills and a track record of driving technical direction and mentoring teams.

Bonus Skills:

• Experience with large-scale or multi-tenant distributed systems.
• Exposure to real-time streaming frameworks (Flink, Storm).
• Knowledge of open table formats (Iceberg, Hudi, Delta Lake).
• Background in security, compliance, or privacy related to identity systems.

Company Summary:

Zeta Global is a NYSE listed data-powered marketing technology company with a heritage of innovation and industry leadership. Founded in 2007 by entrepreneur David A. Steinberg and John Sculley, former CEO of Apple Inc and Pepsi-Cola, the Company combines the industry’s 3rd largest proprietary data set (2.4B+ identities) with Artificial Intelligence to unlock consumer intent, personalize experiences and help our clients drive business growth.

Our technology runs on the Zeta Marketing Platform, which powers ‘end to end’ marketing programs for some of the world’s leading brands. With expertise encompassing all digital marketing channels – Email, Display, Social, Search and Mobile – Zeta orchestrates acquisition and engagement programs that deliver results that are scalable, repeatable and sustainable.

Zeta Global is an Equal Opportunity/Affirmative Action employer and does not discriminate on the basis of race, gender, ancestry, color, religion, sex, age, marital status, sexual orientation, gender identity, national origin, medical condition, disability, veterans status, or any other basis protected by law.

Zeta Global Recognized in Enterprise Marketing Software and Cross-Channel Campaign Management Reports by Independent Research Firm

https://www.forbes.com/sites/shelleykohan/2024/06/19/amazon-partners-with-zeta-global-to-deliver-gen-ai-marketing-automation/

https://www.cnbc.com/video/2024/05/06/zeta-global-ceo-david-steinberg-talks-ai-in-focus-at-milken-conference.html

https://www.businesswire.com/news/home/20240904622808/en/Zeta-Increases-3Q%E2%80%9924-Guidance

https://www.prnewswire.com/news-releases/zeta-global-opens-ai--data-labs-in-san-francisco-and-nyc-300945353.html

https://www.prnewswire.com/news-releases/zeta-global-recognized-in-enterprise-marketing-software-and-cross-channel-campaign-management-reports-by-independent-research-firm-300938241.html

We invite you to explore this opportunity to be a part of the Zeta family……

Should you need any assistance or require further information, please do not hesitate to contact us.

We’re looking for a Senior Data Engineer to design, build, and operate the data pipelines and aggregates that power Zeta’s AdTech platform. This is a hands-on individual contributor role focused on high-scale batch + streaming data processing, reliable data products, and analytics-ready datasets that enable prediction, agentic workflows, BI reporting, and measurement. You will partner closely with backend, ML, and product teams to deliver trusted, well-modeled data with strong performance, quality, and observability.

What You’ll Do

• Build data pipelines: Develop robust batch and streaming pipelines (Kafka/Kinesis) to ingest, transform, and enrich large-scale event data (impressions, clicks, conversions, costs, identity signals).
• Create data aggregates & marts: Design and maintain curated aggregates and dimensional models for multiple consumers—prediction models, agents, BI dashboards, and measurement workflows.
• Data modeling & contracts: Define schemas, data contracts, and versioning strategies to keep downstream systems stable as sources evolve.
• Data quality & reliability: Implement validation, anomaly detection, backfills, and reconciliation to ensure completeness, correctness, and timeliness (SLAs/SLOs).
• Performance & cost optimization: Optimize compute/storage for scale (partitioning, file sizing, incremental processing, indexing), balancing latency, throughput, and cost.
• Orchestration & automation: Build repeatable workflows with scheduling/orchestration (e.g., Airflow, Dagster, Step Functions) and CI/CD for data pipelines.
• Observability for data systems: Instrument pipelines with metrics, logs, lineage, and alerting to accelerate detection and root-cause analysis of data issues.

Security & governance: Apply least-privilege access, PII-aware handling, and governance controls aligned with enterprise standards.

5+ years building production data pipelines and data products (batch and/or streaming) in a high-scale environment.

Strong experience with SQL and data modeling (dimensional modeling, star/snowflake schemas, event modeling).

• Hands-on experience with streaming systems (Kafka preferred) and/or AWS Kinesis, including event-driven designs.
• Proficiency in one or more languages used for data engineering (Python, Java, Scala, or Go).
• Experience with distributed data processing (Spark, Flink, or equivalent) and performance tuning at scale.
• Experience with AWS data services and cloud-native patterns (S3, Glue/EMR, Athena, Redshift, etc. as applicable).
• Familiarity with lakehouse/table formats and large-scale storage patterns (e.g., Parquet; Iceberg/Hudi/Delta are a plus).
• Experience with orchestration/workflow tooling (Airflow/Dagster/Step Functions) and CI/CD for data workloads.
• Strong data quality/observability practices (tests, monitoring, lineage; understanding of SLAs/SLOs).
• Experience with SQL + NoSQL data stores (e.g., Postgres/MySQL; DynamoDB/Cassandra/Redis) and choosing the right store per use case.

Clear communicator and collaborator; able to work with mixed audiences and translate needs into reliable data interfaces.

• AdTech / programmatic advertising domain knowledge: DSP/SSP/exchange/RTB concepts and data flows.
• Experience building measurement pipelines (attribution, incrementality, lift, or experimentation analytics).

Experience supporting ML feature stores, offline/online feature generation, or model training datasets.

• Experience with real-time analytics stores (Druid/ClickHouse/Pinot) and high-cardinality aggregation strategies.
• Deep knowledge of data governance/privacy, including PII handling and consent-aware data processing.
• Open-source contributions, publications, or conference speaking.
• BS/MS in CS/Engineering or equivalent practical experience.

WHO WE ARE 

Zeta Global (NYSE: ZETA) is the AI-Powered Marketing Cloud that leverages advanced artificial intelligence (AI) and trillions of consumer signals to make it easier for marketers to acquire, grow, and retain customers more efficiently. Through the Zeta Marketing Platform (ZMP), our vision is to make sophisticated marketing simple by unifying identity, intelligence, and omnichannel activation into a single platform – powered by one of the industry’s largest proprietary databases and AI. Our enterprise customers across multiple verticals are empowered to personalize experiences with consumers at an individual level across every channel, delivering better results for marketing programs. Zeta was founded in 2007 by David A. Steinberg and John Sculley and is headquartered in New York City with offices around the world. To learn more, go to www.zetaglobal.com.

PEOPLE & CULTURE AT ZETA

Zeta considers applicants for employment without regard to, and does not discriminate on the basis of an individual’s sex, race, color, religion, age, disability, status as a veteran, or national or ethnic origin; nor does Zeta discriminate on the basis of sexual orientation, gender identity or expression.  

We’re committed to building a workplace culture of trust and belonging, so everyone feels invited to bring their whole selves to work. We provide a forum for employees to celebrate, support and advocate for one another. Learn more about our commitment to diversity, equity and inclusion here:  https://zetaglobal.com/blog/a-look-into-zetas-ergs/ 

ZETA IN THE NEWS!

https://zetaglobal.com/press/?cat=press-releases 

As a Senior AI/ML Engineer in our AdTech team, you will be a hands-on individual contributor building and deploying machine learning models and AI-driven features for our advertising platform. You will partner with engineering, product, and data science to deliver production-grade ML for campaign optimization, user personalization, and creative intelligence—operating at large scale and low latency across billions of ad events per day. You will contribute to modern ML/LLM capabilities and agentic workflows that automate and enhance campaign operations, with a strong focus on reliability, performance, and measurable business impact.

Key Responsibilities

• Machine Learning Delivery: Design, implement, and ship scalable ML solutions for core AdTech use cases (targeting, ranking, pacing, measurement). Own features end-to-end from experimentation to production rollout.
• ML System Design: Build and evolve the ML lifecycle—data preparation, training, evaluation, and real-time inference—ensuring models integrate cleanly with ad serving systems and meet low-latency, high-throughput requirements.
• Technical Contribution: Contribute to the AI/ML technical roadmap by evaluating tools and techniques (including deep learning, LLMs, and retrieval/feature systems). Make pragmatic trade-offs with an eye toward maintainability and operational excellence.
• AI & Agentic Applications: Develop and integrate LLM-powered features and agentic workflows that assist with campaign workflows such as audience insights, bid/budget recommendations, and creative generation—within well-defined guardrails.
• Cross-Functional Collaboration: Work closely with engineering, product, and data science partners to translate marketing objectives into ML-driven solutions, define success metrics, and deliver iterative improvements.
• Performance & Reliability: Operate ML services in a high-concurrency, latency-sensitive environment. Optimize inference paths, implement monitoring/alerting, manage model drift, and ensure safe deployment practices (A/B testing, canaries, rollbacks).
• Mentorship & Best Practices: Mentor and support other engineers through code/model reviews and knowledge sharing. Champion engineering rigor in testing, observability, documentation, and reproducible ML workflows.

Required Qualifications

• 5+ years of experience in software engineering and/or applied machine learning, with a track record of shipping ML systems to production.
• Experience designing and building high-throughput, low-latency services or data pipelines for large-scale applications.
• Working knowledge of the programmatic advertising ecosystem (DSP/SSP/RTB) is a plus; strong adjacent experience (recommendation, ranking, marketplaces) is also valued.
• Proficiency in at least one of Java, Go, or Python for backend services and ML tooling.
• Hands-on experience with ML frameworks (PyTorch or TensorFlow) and common modeling approaches (classification, ranking, embeddings, deep learning).
• Experience with big data and streaming frameworks (e.g., Spark, Kafka) for processing and analyzing large datasets.
• Experience deploying ML to cloud environments (preferably AWS) and operating services at scale.
• Familiarity with data stores (SQL/NoSQL) such as PostgreSQL/MySQL, Cassandra/DynamoDB, Redis, etc.
• Familiarity with containerization/orchestration (Docker, Kubernetes) and CI/CD practices.
• Strong communication skills and ability to collaborate across disciplines; comfort explaining technical concepts to both technical and non-technical stakeholders.

Preferred Qualifications

• Experience with Large Language Models (LLMs) and generative AI applied to advertising (e.g., ad copy generation, creative optimization, or personalized messaging).
• Experience designing and implementing agentic workflows that support autonomous or semi-autonomous decision-making with strong safety/observability guardrails.
• Experience with model serving and optimization for real-time inference (latency-critical environments).
• Familiarity with modern data lake and table formats (e.g., Apache Iceberg, Apache Hudi) for managing large-scale analytical datasets.
• Knowledge of microservices architecture and event-driven design patterns in distributed systems.
• Contributions to open-source projects, publications, or speaking engagements that demonstrate thought leadership in AI/ML are a plus.

WHO WE ARE 

Zeta Global (NYSE: ZETA) is the AI-Powered Marketing Cloud that leverages advanced artificial intelligence (AI) and trillions of consumer signals to make it easier for marketers to acquire, grow, and retain customers more efficiently. Through the Zeta Marketing Platform (ZMP), our vision is to make sophisticated marketing simple by unifying identity, intelligence, and omnichannel activation into a single platform – powered by one of the industry’s largest proprietary databases and AI. Our enterprise customers across multiple verticals are empowered to personalize experiences with consumers at an individual level across every channel, delivering better results for marketing programs. Zeta was founded in 2007 by David A. Steinberg and John Sculley and is headquartered in New York City with offices around the world. To learn more, go to www.zetaglobal.com. 

PEOPLE & CULTURE AT ZETA

Zeta considers applicants for employment without regard to, and does not discriminate on the basis of an individual’s sex, race, color, religion, age, disability, status as a veteran, or national or ethnic origin; nor does Zeta discriminate on the basis of sexual orientation, gender identity or expression.  

We’re committed to building a workplace culture of trust and belonging, so everyone feels invited to bring their whole selves to work. We provide a forum for employees to celebrate, support and advocate for one another. Learn more about our commitment to diversity, equity and inclusion here:  https://zetaglobal.com/blog/a-look-into-zetas-ergs/ 

ZETA IN THE NEWS!

https://zetaglobal.com/press/?cat=press-releases 

See yourself at Twilio

Join the team as our next Data Platform Product Manager in the Data Governance and Insights team..

About the job

This position is needed to own Twilio's Data Governance initiatives across Twilio. This position is based in India. You will touch many teams within Twilio to ensure safe customer data handling, supporting data privacy and compliance. This team manages data pipeline security, data reliability, and ensuring access controls. We are also the bridge to the reporting systems trusted by customers, executives and shareholders.

Responsibilities

In this role, you’ll:

• Lead the product requirements required to build and operate a central data catalog as a metadata store.
• Drive Data Governance initiative, working across various organizations and stakeholders.
• Understand the needs of our customers for operational and analytical purposes, and execute on governance of the data pipeline with required access management to fulfill these requirements.
• Craft and deliver a vision for data governance at Twilio, working side by side with other product managers and engineering counterparts across Twilio R&D.

Qualifications 

Twilio values diverse experiences from all kinds of industries, and we encourage everyone who meets the required qualifications to apply. If your career is just starting or hasn't followed a traditional path, don't let that stop you from considering Twilio. We are always looking for people who will bring something new to the table!

*Required:

• Someone with 10+ years of product management experience in a fast-paced company. If you have a strong work ethic and know how to knock down barriers to get to your objective this might be the opportunity for you.
• Strong background in Data Governance, having led at least one initiative that included cataloging metadata, data reliability, sensitive data classification and access management.
• Worked on data platforms, customer engagement platforms, or streaming applications. Proficiency in the big data ecosystem e.g. Kafka, Spark, Presto/Athena, or similar technologies.
• Technically savvy and experienced with the cloud, APIs, communications, enterprise software, data reliability, and ETL techniques.
• You have a customer oriented approach. You have an amazing ability to understand the customer’s challenges and are able to articulate a vision to solve challenges to make an impact. 
• The ability to solicit customer requirements from many - often opposing - sources, prioritize, and work with engineering and design to deliver.
• You are a strategic problem solver and flourish operating in broad scope, from conception through continuous operation of 24x7 services.
• You have solved sophisticated problems and have the aptitude to navigate uncharted waters.

Desired:

• Collaborative approach and ability to work with distributed, cross-functional teams.
• Great communication skills. You're equally at home on zoom presenting to an audience of developers as you are on a zoom talking to users and then coming up with product requirements. Your best days are the ones where you do both on the same day.
• Bachelor’s degree Computer Science, Engineering or equivalent experience required.

Location

This role will be remote, and based in India.

Travel 

We prioritize connection and opportunities to build relationships with our customers and each other. For this role, you may be required to travel occasionally to participate in project or team in-person meetings.

What We Offer

Working at Twilio offers many benefits, including competitive pay, generous time off, ample parental and wellness leave, healthcare, a retirement savings program, and much more. Offerings vary by location.

CSQ227R231

Mission

The Director of Data & AI Support Engineering - Bangalore will be responsible for leading and growing a regional team of Data & AI technical experts in India, focused on providing resiliency and smooth operation of customer production workloads.  This leader will oversee support operations during APJ and EMEA business hours with close alignment with other global teams to ensure 24x7 support coverage through coordination with other regions.  This team resolves complex and long-running data engineering use cases raised by Databricks customers to support the success of live use cases - which includes performance optimization, ensuring resiliency of production jobs, helping customers stabilize workloads on new products and features, and more.  Reporting to the Global Lead of Frontline Support Engineering - Data & AI - you are able to understand the real-world business problems our customers are solving with data and are committed to helping them achieve reliability and performance of their systems to meet their goals.

The impact you will have:

• Serve as the India site leader for an elite team of Data & AI specialists that can provide coverage of customers across EMEA & APJ business hours.
• Grow the technical expertise of the team to support successful adoption of new products and features of the Databricks platform for customer production workloads.
• Engage with top customers to understand how to support their business needs with their Data & AI strategy, in collaboration with field engineering and sales when required.
• Partner with internal product engineering teams to make Databricks products better and more supportable.
• Understand how to maintain high reliability of the Databricks platform to successfully achieve customer business goals.

Competencies & Requirements

• Proven people leadership experience: at least 6+ years as a manager of managers.
• 18+ years in the IT industry, with a strong background in Software Engineering with specialization in Data Engineering, ideally with Big Data & Cloud experience.
• Experience leading large teams (100+ employees) in engineering, technical support, or consulting.  Support experience is not required - but customer facing experience is highly desirable.
• Hands-on experience in at least two of the following at production scale:
• Big Data (Spark, Hadoop, Kafka)
• Machine Learning / Artificial Intelligence projects
• Data Science / Streaming use cases
• Spark expertise is a big advantage.
• Strong background in customer-facing support leadership roles.
• Excellent troubleshooting skills across distributed systems.
• Strong ownership mindset with ability to thrive in a fast-paced, startup-like environment with evolving needs.
• Bachelor’s/Master’s in Computer Science or equivalent technical field.

Job Title: Data Analyst (Python +Pyspark)

 About Us

“Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the  British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. 

WHY JOIN CAPCO? 

You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.

MAKE AN IMPACT

Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.

#BEYOURSELFATWORK

Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.

CAREER ADVANCEMENT

With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.

DIVERSITY & INCLUSION

We believe that diversity of people and perspective gives us a competitive advantage.

Job Description:

POD Lead with Data Background, Scrum, Agile, Data Migration

Who we are

Metropolis is an artificial intelligence company that uses computer vision technology to enable frictionless, checkout-free experiences in the real world. Today, we are reimagining parking to enable millions of consumers to just "drive in and drive out." We envision a future where people transact in the real world with a speed, ease and convenience that is unparalleled, even online. Tomorrow, we will power checkout-free experiences anywhere you go to make the everyday experiences of living, working and playing remarkable - giving us back our most valuable asset, time.

Who you are

We are looking for a highly motivated and analytical Data Scientist to join our growing data team. You will play a key role in extracting insights from large datasets, building predictive models, and supporting data-driven decision-making across departments.

What you'll do

• Collect, process, and analyze large datasets from multiple sources
• Build and deploy machine learning models to solve business problems
• Design and implement A/B tests and statistical analyses
• Collaborate with cross-functional teams (product, engineering, marketing) to define analytics requirements
• Communicate complex data insights in a clear and actionable manner to stakeholders
• Develop dashboards and visualizations to monitor key metrics
• Stay current with the latest trends and technologies in data science and AI

What we're looking for

• Bachelor’s and or Master’s degree in Computer Science, Mathematics, Statistics, or related field
• 4+ years of proven experience as a Data Scientist or Data Analyst
• Strong knowledge of Python/R and SQL
• Hands-on experience with machine learning frameworks (e.g., scikit learn, tensroflow, pytorch)
• Experience with big data tools (e.g., Spark, Hadoop)
• Familiarity with data visualization tools
• Strong analytical, problem-solving, and communication skills

While not required, these are a plus:

• Experience with cloud platforms preferably AWS (S3, Sagemaker, Airflow etc)
• Strong SQL skills, with experience in Snowflake, MySQL, and PostgreSQL
• Familiarity with data visualization tools (e.g., Tableau, Power BI, Looker)

3 Days in Office: Metropolis values in-person collaboration to drive innovation, strengthen culture, and enhance the Member experience. Our corporate team members hold to our office-first model, which requires employees to be on-site at least four days a week, fostering organic interactions that spark creativity and connection.

When you join Metropolis, you'll join a team of world-class product leaders and engineers, building an ecosystem of technologies at the intersection of parking, mobility, and real estate. Our goal is to build an inclusive culture where everyone has a voice and the best idea wins. You will play a key role in building and maintaining this culture as our organization grows. #LI-SR1 #LI-Onsite

Who we are

Metropolis is an artificial intelligence company that uses computer vision technology to enable frictionless, checkout-free experiences in the real world. Today, we are reimagining parking to enable millions of consumers to just "drive in and drive out." We envision a future where people transact in the real world with a speed, ease and convenience that is unparalleled, even online. Tomorrow, we will power checkout-free experiences anywhere you go to make the everyday experiences of living, working and playing remarkable - giving us back our most valuable asset, time.

Who you are

As a Senior Data Engineer at Metropolis, you will play a key role in shaping both customer-facing and business-facing data products that align with our mission. Your technical expertise and analytical acumen will contribute to designing and building extensive data sets that impact thousands of internal users and millions of members. Join a world-class data engineering team dedicated to advancing your skills and career in data engineering and beyond.

What you'll do

• Collaborate with engineers, product managers, and data scientists to understand data needs, and develop end-to-end data pipelines, solutions, and foundational data sets
• Design and own the data architecture for large-scale projects, making informed decisions about design and operational trade-offs
• Build, launch, and optimize sophisticated data pipelines, data models, and visualizations that support diverse use cases across multiple products or domains
• Define and manage Service Level Agreements (SLAs) for all data sets within areas of ownership
• Implement data security models based on privacy requirements, ensure compliance with safeguards, address data quality issues, and evolve data governance processes
• Solve complex data integration challenges using optimal ETL/ELT patterns, frameworks, and query techniques for both structured and unstructured data sources
• Maintain and enhance existing production processes by optimizing complex code using advanced algorithmic concepts 
• Optimize pipelines, dashboards, frameworks, and systems to streamline data artifact development
• Mentor team members, providing and receiving actionable feedback to foster skill growth and collaboration
• Ensure flexibility with availability during evening hours

What we're looking for

• Bachelor's degree in computer science, Computer Engineering, or a relevant technical field; a master's degree is preferred
• 5+ years of experience in data engineering, database engineering, business intelligence, data warehousing, and ETL tools, working with large data sets in the cloud
• Proficiency in SQL, ETL/ELT, and data modeling, with extensive experience in Snowflake and dbt 
• 5+ years of experience with Python, and experience building scalable Big Data solutions and ETL ecosystems
• Hands-on experience with RDBMS such as MySQL, MS SQL Server, and Postgres
• Familiarity with integration tools like Airflow and Automic, along with a working knowledge of CI/CD pipelines
• Ability to deliver high standards of code quality, system reliability, and performance
• Experience with Spark and PySpark to handle large-scale data processing and enhance data pipeline efficiency
• Strong proficiency in Terraform is a must-have.

Our Stack

• Languages + Frameworks: TypeScript, React, Scala (principally), Java (limited)
• Datastores: MySQL, PostgreSQL, Snowflake
• Cloud: AWS
• Version control: Git & GitHub
• AI Tooling: Copilot on GitHub
• Observability: Datadog

When you join Metropolis, you’ll join a team of world-class product leaders and engineers, building an ecosystem of technologies at the intersection of parking, mobility, and real estate. Our goal is to build an inclusive culture where everyone has a voice and the best idea wins. You will play a key role in building and maintaining this culture as our organization grows. #LI-SR1 #LI-Onsite

Who we are

Metropolis is an artificial intelligence company that uses computer vision technology to enable frictionless, checkout-free experiences in the real world. Today, we are reimagining parking to enable millions of consumers to just "drive in and drive out." We envision a future where people transact in the real world with a speed, ease and convenience that is unparalleled, even online. Tomorrow, we will power checkout-free experiences anywhere you go to make the everyday experiences of living, working and playing remarkable - giving us back our most valuable asset, time.

What you'll do

Metropolis is seeking a Senior Analytics Engineer to join our Data Engineering and Analytics team. The ideal candidate will possess a passion for creating value using data and a strong foundation in all aspects of analytics engineering. In this pivotal role, you will be instrumental in making data accessible and actionable, facilitating informed decision-making throughout the company. You will partner and lead across multiple product team functions and domains and drive impact through your data vision and architecture.

What we're looking for

• 5+ years experience with data/analytics engineering
• 5+ years of experience with Python and SQL (preferably Snowflake)
• 3+ years of experience with dbt (dbt certification a plus)
• Owned large-scale data projects that drove significant impact across the company by effectively partnering with engineering, data analysts, data scientists, and other business stakeholders
• Mentored other stakeholders in Data Science/Analytics, PM, and Engineering on data best practices
• Led the design, implementation, and monitoring of large-scale data warehouses and data marts that enable clear product-focused insights
• An expert at SQL, window functions, STRUCT/ARRAY manipulation, and query optimization
• Promoted performance best practices for your tables depending on the database engine (partitions, sort keys, dist keys, clustering, incremental modeling)
• Designed systems with a test-driven approach in mind to trap bad quality data or highlight alerts as part of your data flow
• Familiarity with ELT (Extract, Load, Transform) processes and tools to prepare and clean data for analysis
• Skill in using tools like dbt to build data transformation pipelines

Our Stack

• Languages + Frameworks: TypeScript, React, Scala (principally), Java (limited)
• Datastores: MySQL, PostgreSQL, Snowflake
• Cloud: AWS
• Version control: Git & GitHub
• AI Tooling: Copilot on GitHub
• Observability: Datadog

3 Days in Office: Metropolis values in-person collaboration to drive innovation, strengthen culture, and enhance the Member experience. Our corporate team members hold to our office-first model, which requires employees to be on-site at least four days a week, fostering organic interactions that spark creativity and connection.

When you join Metropolis, you'll join a team of world-class product leaders and engineers, building an ecosystem of technologies at the intersection of parking, mobility, and real estate. Our goal is to build an inclusive culture where everyone has a voice and the best idea wins. You will play a key role in building and maintaining this culture as our organization grows. #LI-SR1 #LI-Onsite

SLSQ227R141

Field Engineering, Lakebase Product Specialist

As the Lakebase Product Specialist, you will be defining our technical go to market strategy and driving our application stack adoption in the India region. 

You will be directly working with customers to guide and influence their application architecture and decisions. You will be expected to present, demo and pitch the Lakebase product suite and You will be acting as a trusted advisor for senior executives and your in-depth technical knowledge will ensure our customers are successful in leveraging Databricks to solve their business problems.

You will be the technical expert to support our field engineering teams internally and you will be expected to help enable the team to understand the key differentiators of our product against our competitors. You will partner with product managers to help to define the product direction based on local knowledge and inform our product strategy with our go-to-market field teams. You will not have any direct reports but will recruit and lead a group of specialists across the field dedicated to scale your impact. 

You will also be a thought leader externally to the market via speaking at conferences, online webinars, and blog posts. You will meet with customers to communicate the vision and gather feedback.

You have expertise in modern data application architectures and preferably industry domain knowledge. You will bring your in depth knowledge and experience of building production level data applications leveraging different technologies and patterns. You will excel in creating and articulating a compelling value proposition for our customers and enabling Account Executives and Field Engineers to operate effectively using best practices and assets that you own and develop.

The impact you will have:

• Lead the vision and strategy for Databricks Lakebase adoption in India
• Develop materials for our GTM team to effectively communicate our value proposition
• Support our field teams in key strategic pursuit opportunities
• Lead a team of subject matter experts (SMEs) to scale your impact in local regions and enable the broader field team to have confidence in competing in the market
• Act as the thought leader to build confidence and relationships with our customers at the executive level
• Present externally at conferences, events and webinars and publish content to establish our position in the market
• Work with post sales and partners to establish best practices
• Act as a cross-functional representative with Product Management, Product Marketing and Engineering on our go-to-market motion

What we look for:

• 6+ years of experience in application development and familiar with modern database architecture
• Deep technical knowledge with database technologies, e.g. Postgres, MySQL, Oracle, Aurora, RDS, etc.
• Deep technical understanding of the software engineering / data application development practices
• Trusted advisor to technical executives that inform strategic data decisions
• Proven track record of successful pre-sales experience in competitive situations
• Ability to define and executive strategic program cross functionally
• High impact communication internally and externally

About Zuora

At Zuora, we help businesses grow smarter and adapt faster. Our platform powers modern business models — from subscriptions and usage-based pricing to AI-driven and outcome-based offerings — helping companies launch new products, automate complex billing, and unlock predictable, recurring revenue.

We’ve led the Subscription Economy for more than a decade. Now we’re evolving again by building the definitive platform for quote to cash and helping companies monetize their products and services with an adaptable, AI-ready foundation.

The Opportunity

We’re looking for a strong technical contributor to drive AI/ML innovation and deliver real business impact through intelligent solutions.

You’ll:

• Identify high-impact opportunities using AI/ML to solve customer and business problems
• Partner with stakeholders and influence decisions through data-driven insights
• Build and deploy end-to-end ML models (including LLMs) using structured and unstructured data
• Collaborate with engineering teams to develop scalable data and ML pipelines
• Take full ownership from idea to production, delivering measurable business outcomes

This role is ideal for someone who can combine deep technical expertise with business thinking to simplify complexity and build impactful, production-ready AI solutions.

About You

1. 7+ years of experience in the data science/machine learning domain, preferably with hands-on end-to-end model building experience
2. Curious mind to learn, explore and identify biggest customer opportunities
3. Build strong relationships across both technical and business/product teams, earn trust with leadership
4. Driven towards forming opinions and conclusions through data and experimentation, rather than anecdotes and hearsay
5. Willingness to dive deep into the tech stack as well as hands-on coding
6. Experience in building end to end ML models, across the ML lifecycle
7. Strong communication and leadership presence
8. Technical skills- hands on with scripting required, with knowledge or willingness to learn tools/softwares. Knowledge of R, SQL, Python, Statistical modeling, experience with AWS/Azure/GCP ML suite
9. Experience in the following domains/industries preferred- SaaS, ecommerce, pricing or payments
10. Bachelors/Masters in a technical or natural sciences domain from a top university

Even if you feel like you meet some, but not all of the qualifications, we would love it if you take the time to apply to the role. As we evolve and scale up a relatively new team, we strongly believe that a diverse team structure will accelerate progress towards our objectives.

The Team

Zuora Platform Tech is at the forefront of technological and business transformation, tackling complex, ambiguous problems to drive innovation. As part of the AIMS team (AI, ML, and Science), you’ll work on applying advanced AI and data science to enable total monetization across Zuora’s product suite and beyond.

The team operates at the intersection of AI, business strategy, and product innovation, solving high-impact problems like pricing, forecasting, segmentation, and optimization. The tech stack includes Java, Spring, Microservices, Kafka, Spark, NodeJS, AWS, Kubernetes, Terraform, and AngularJS.

Benefits

Zuora offers a comprehensive total rewards package designed to support ZEOs’ wellbeing, growth, and flexibility. While specific offerings may vary by country, we typically provide:

• Competitive compensation, variable bonus and performance-based reward opportunities, and retirement programs
• Medical, dental, and vision insurance
• Generous, flexible time off, plus paid holidays, wellness days, and a company-wide year-end break
• Paid parental leave (including fully paid leave for eligible ZEOs, subject to local policy)
• Learning & development stipend to support ongoing growth
• Opportunities to volunteer and give back, including charitable donation matching where available
• Mental wellbeing resources and support

*Benefits may vary by location; details will be shared during the interview process

#ZEOLife at Zuora

ZEOs (our employees) are empowered to take ownership, challenge the status quo, and make a real impact. We:

• Collaborate deeply across teams and regions
• Learn constantly and iterate often
• Build an inclusive, high-performance culture where people feel inspired, connected, and valued

Our Commitment to an Inclusive Workplace

Think, be and do you.
At Zuora, different perspectives, experiences, and contributions matter — everyone counts.

Zuora is proud to be an Equal Opportunity Employer committed to creating an inclusive environment for all. We do not discriminate on the basis of, and consider individuals seeking employment with Zuora without regard to, race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics.

We encourage candidates from all backgrounds to apply. Applicants in need of special assistance or accommodation during the interview process or in accessing our website may contact us by sending an email to assistance@zuora.com (or local equivalent, where applicable).

About AQR Capital Management  

AQR is a global investment management firm built at the intersection of financial theory and practical application. We strive to deliver superior, long-term results for our clients by seeking to filter out market noise to identify and isolate what matters most, and by developing ideas that stand up to rigorous testing. Underpinning this philosophy is an unrelenting commitment to excellence in technology — powering our insights and analysis. This unique combination has made us leaders in alternative and traditional strategies since 1998. 

AQR takes a systematic, research-driven approach, applying quantitative tools to process fundamental information and manage risk. Our clients include institutional investors, such as pension funds, insurance companies, endowments, foundations and sovereign wealth funds, as well as financial advisors. 

The Team: 

AQR is building a new Data Engineering team within the Enterprise Engineering organization to focus on solving problems working with big data. This team will work directly with researchers and others across the firm to build and manage the software that loads, validates, and provisions many large data sets used in the research and investment processes. 

Your Role: 

As a data engineering developer, you will participate in designing and building a new enterprise data platform used by quantitative researchers to manage large volumes of market, reference, and alternative data, both structured and unstructured. You will also build critical tools that will be used across the firm to validate data, back-test, and find valuable investment insights. You will be collaborating directly with Researchers and Portfolio Managers to define and implement detailed business requirements for new and existing projects. This critical team will use big data technologies and cloud-based platforms to build an extensible and scalable solution to the data needs of one of the largest quantitative investment firms in the world. 

What You’ll Bring: 

• 3+ Years of relevant work experience 

• Bachelors/Masters/PhD in Computer Science, Engineering, or related discipline 

• Outstanding coding, debugging, and analytical skills; Python required, other languages are a plus 

• Ability to work directly with business stakeholders to spec out and implement solutions 

• Experience working in a distributed data environment and working with large data sets 

• Knowledge of big data frameworks such as Spark and Hadoop 

• An interest in quantitative finance (no finance / trading experience required) 

• Familiarity with one of the large cloud providers is required; AWS experience is a plus 

• Familiarity with AI models and/or frameworks is a plus 

Who You Are: 

• Mature, thoughtful, and a natural fit for our collaborative culture 

• Hard-working and eager to learn in a fast-paced, innovative environment 

• Committed to intellectual integrity, transparency, and openness 

• Motivated by the groundbreaking effects of technology-at-scale 

We believe that the next innovation to transform our business could come from anyone at AQR. Expect to be recognized not only for your diligence and hard work today, but for your vision for tomorrow. We are mathematicians, computer scientists, engineers and artists, passionate about advancing financial research and pushing the limits of today’s technology. 

About AQR Capital Management  

AQR is a global investment management firm built at the intersection of financial theory and practical application. We strive to deliver superior, long-term results for our clients by seeking to filter out market noise to identify and isolate what matters most, and by developing ideas that stand up to rigorous testing. Underpinning this philosophy is an unrelenting commitment to excellence in technology — powering our insights and analysis. This unique combination has made us leaders in alternative and traditional strategies since 1998. 

AQR takes a systematic, research-driven approach, applying quantitative tools to process fundamental information and manage risk. Our clients include institutional investors, such as pension funds, insurance companies, endowments, foundations and sovereign wealth funds, as well as financial advisors. 

The Team: 

AQR is building a new Data Engineering team within the Enterprise Engineering organization to focus on solving problems working with big data. This team will work directly with researchers and others across the firm to build and manage the software that loads, validates, and provisions many large data sets used in the research and investment processes. 

Your Role: 

As a data engineering developer, you will participate in designing and building a new enterprise data platform used by quantitative researchers to manage large volumes of market, reference, and alternative data, both structured and unstructured. You will also build critical tools that will be used across the firm to validate data, back-test, and find valuable investment insights. You will be collaborating directly with Researchers and Portfolio Managers to define and implement detailed business requirements for new and existing projects. This critical team will use big data technologies and cloud-based platforms to build an extensible and scalable solution to the data needs of one of the largest quantitative investment firms in the world. 

What You’ll Bring: 

• 6+ Years of relevant work experience 
• Bachelors/Masters/PhD in Computer Science, Engineering, or related discipline 
• Outstanding coding, debugging, and analytical skills; Python required, other languages are a plus 
• Ability to work directly with business stakeholders to spec out and implement solutions 
• Experience working in a distributed data environment and working with large data sets 
• Knowledge of big data frameworks such as Spark and Hadoop 
• An interest in quantitative finance (no finance / trading experience required) 
• Familiarity with one of the large cloud providers is required; AWS experience is a plus 
• Familiarity with AI models and/or frameworks is a plus 

Who You Are: 

• Mature, thoughtful, and a natural fit for our collaborative culture 
• Hard-working and eager to learn in a fast-paced, innovative environment 
• Committed to intellectual integrity, transparency, and openness 
• Motivated by the groundbreaking effects of technology-at-scale 

We believe that the next innovation to transform our business could come from anyone at AQR. Expect to be recognized not only for your diligence and hard work today, but for your vision for tomorrow. We are mathematicians, computer scientists, engineers and artists, passionate about advancing financial research and pushing the limits of today’s technology. 

Why This Role Matters 

This role powers Tekion’s AI‑native, end‑to‑end automotive platform by turning unified dealership data across DMS, CRM, Digital Retail, Service, and Payments into real‑time intelligence. You’ll operationalize a graph‑based contextual ecosystem so agents can retrieve the right context, enforce policy, and personalize experiences that drive measurable dealer outcomes. You’ll also build the resilient control layer - MCP and the LLM Gateway - that enables safe, cost‑efficient, multi‑provider LLM usage. Finally, you’ll define the standards for building, evaluating, deploying, and governing agentic systems so product teams can ship AI features quickly, safely, and at scale. In addition to enabling agentic systems powered by LLMs, this role also drives building the platform for classical ML models driving optimization across dealership operations.  

What Makes This Opportunity Unique 

This role offers direct, measurable impact on dealer outcomes and consumer experiences across Tekion’s Automotive Retail Cloud and Automotive Enterprise Cloud, with end‑to‑end ownership of an LLM control plane and gateway that serve multi‑tenant workloads under SLAs and, quality and cost guardrails. You’ll leverage a rich vertical dataset and domain graph spanning sales, service, parts, F&I, accounting, and consumer touchpoints to power context‑aware agents and retrieval‑augmented generation. You’ll also shape core levers - agent orchestration patterns, evaluation frameworks, and safety guardrails - so improvements in latency, reliability, evaluation quality, and safety translate into dealer KPIs like upsell, cycle time, CSAT, and service revenue.  You’ll also maintain and enhance the platform to support classical supervised and unsupervised ML models . 

Responsibilities 

• Build and run the LLM control plane/gateway: smart routing, rate limits/quotas, failover, and token/cost tracking. 

• Ship a unified API and SDKs (REST/gRPC) with normalized schemas, structured outputs, caching, and full observability (traces/logs/metrics). 

• Enforce safety and privacy by default: content filtering, prompt/response validation, and PII redaction. 

• Enable multi‑model, multi‑vendor use LLMs with automated canarying and versioning. 

• Own the agent runtime: tool registry, permissions, function calling, grounding, and retrieval. 

• Design orchestration patterns (sequential, planner‑executor, streaming) and manage agent state and long‑running workflows. 

• Enabling platform components for training and scoring pipelines for classical ML (e.g., XGBoost/LightGBM/linear/trees) and deep models; standardize experiment tracking and packaging. 

• Create components to Monitor model and data drift, retraining and tuning models as needed to maintain accuracy and relevance. 

• Add human‑in‑the‑loop review and safe‑actioning before agents touch dealer systems. 

• Evolve the domain graph and entity resolution; build reliable data ingestion pipelines. 

• Serve real‑time context to agents (profiles, inventory, pricing, appointments, service history) with access controls and lineage. 

• Power retrieval with hybrid search (graph + vector + keyword) and smart cache/TTL to balance accuracy, latency, and cost. 

• Run continuous offline/online evaluations for quality, factuality, bias, and safety for the platform sanity. 

• Define SLOs for latency (p50/p95), uptime, and cost view capabilities; enable autoscaling and spend controls. 

• Maintain a model/agent registry, versioning, approvals, audit trails, and reproducibility; support compliances where needed. 

• Provide templates/CLIs, sandboxes, and docs so product teams can build and ship fast; mentor engineers and champion MLOps and AI safety best practices. 

Desired Skills & Experience 

• 12–15+ years building large‑scale data/ML or platform systems; strong software engineering fundamentals (Abstracted API design, concurrency, distributed systems). 

• Production experience with Python plus one of Java/Scala/Go; microservices and API design. 

• MLOps at scale: pipelines (Airflow/Kubeflow), tracking/registry (MLflow), CI/CD for models, A/B testing, shadow/canary, and online feature computation (Spark/Flink/Kafka). 

• Cloud and containers: AWS (preferred), plus Docker/Kubernetes; performance, reliability, and cost engineering in multi‑tenant SaaS. 

• Practical ML knowledge (feature engineering, training, evaluation, drift detection); experience deploying models that power user‑facing workflows. 

• Built or operated an LLM gateway/control plane: provider adapters, routing/policies, caching, quota/rate‑limit, cost and token accounting. 

• Agentic systems: tool use/function calling, orchestration frameworks, human‑in‑the‑loop, safety/guardrails, and online evaluation/telemetry. 

• Graph and retrieval: knowledge graphs (e.g., Neo4j/Neptune/TigerGraph), GraphQL, vector search (e.g., pgvector/Qdrant/Milvus), hybrid retrieval patterns. 

Preferred Mindset 

• Platform‑as‑product: obsess over developer experience, paved roads, and clear SLAs. 

• Thinks in systems - observability, fallback, access control are core, not afterthoughts. 

• Passionate about AI - enjoys enabling real-world LLM and agentic use cases. 

• Cost‑aware builder: you treat latency and dollars as first‑class metrics and design for graceful degradation. 

• Vendor‑agnostic thinker: choose the right model/provider per use case; build for portability and resilience. 

• Documentation and teaching: you make complex systems understandable; you uplevel teams. 

CSQ126R22

As a Training & Operations Manager, you will build and scale a predictable, AI-enabled learning operations engine across APJ that transforms regional execution into disciplined, data-driven, revenue-aligned outcomes.

As the operational backbone of the region, you will design systems, not just manage processes, ensuring APJ training operations scale with clarity, control, and commercial rigour.

The impact you will have:

• Architect and run a scalable, data-driven operating cadence across APJ, including forecasting, QBRs, capacity planning, and executive reporting.
• Partner with Sales, Professional Services, and Learning & Enablement leaders to translate global strategy into executable regional plans.
• Reduce operational friction by embedding automation, predictive analytics, and AI-first workflows into intake, scheduling, and performance tracking.
• Improve forecast accuracy and operational predictability by identifying risks early and driving structured corrective action.
• Lead high-priority escalations with discipline and composure, converting recurring issues into systemic improvements.
• Increase stakeholder self-sufficiency by shifting standard operational requests into automated, AI-enabled pathways.
• Standardize governance frameworks, decision rights, and ownership models to ensure consistent regional execution aligned with global standards.
• Optimize regional utilization and fill rates while maintaining cost discipline and delivery quality.
• Elevate operational maturity across APJ by driving adoption of data-driven practices and structured execution frameworks.

What we look for:

• 10+ years of experience in Consulting, Sales Operations, Business Operations, Enablement Operations, or Professional Services Operations within high-growth technology companies.
• Proven experience owning regional operating cadence, forecasting frameworks, and large-scale execution models.
• Strong commercial fluency, including understanding of utilization, forecast variance, and revenue discipline.
• Experience implementing automation, analytics, or AI-driven workflows to improve efficiency and predictability.
• Analytical rigor with the ability to translate data into executive-level insight and actionable recommendations.
• Experience operating in matrixed, international environments with sensitivity to regional and cultural nuances.
• A structured, systems-oriented mindset with the ability to balance speed, governance, and scalability.

Duration - 3 months to 6 months

Stipend - 35,000 in hand

Working Days - 6 days

About IRL

Researchers at UC Berkeley have identified a “100,000-year data gap” - the gulf between what trained AI language models and what physical robots actually have to learn from. Closing that gap is the defining infrastructure challenge of the physical AI era. IRL is Instawork’s answer to it. We deploy skilled workers into real commercial and residential environments - kitchens, warehouses, hotel floors, homes - to capture the high-fidelity task data that the world’s leading Robotics labs use to train their foundation models. Read more here.

Role Overview

We are looking for an analytically-minded Operations Management Intern with an engineering background to join our team. This role is ideal for Engineering Graduates who enjoy solving structural problems and want to apply their technical discipline to business operations. You will be responsible for managing high-volume data and coordinating complex logistics to ensure our operational engine runs at peak efficiency.

Key Responsibilities

• Operational Analytics: Use your engineering mindset to break down operational workflows and identify areas for automation or optimization.
• Advanced Data Tracking: Manage and audit large-scale datasets using Excel, ensuring 100% accuracy in reporting and forecasting.
• Project Coordination: Oversee the lifecycle of specific operational tasks, ensuring technical requirements and timelines are met.
• Stakeholder Liaison: Act as a bridge between technical teams and field operations to ensure seamless communication.
• Problem Solving: Rapidly troubleshoot real-time operational issues using a logical, first-principles approach.

Mandatory Qualifications

• Education: B.E. / B.Tech Graduate (All streams welcome; Batch of 2025 or 2026).
• Event Leadership: Proven experience in a core leadership or operations role for a College Fest. We are looking for candidates who have managed budgets, logistics, or large teams in a high-pressure environment.
• Technical Tools: Expert-level proficiency in Microsoft Excel (formulas, data modeling, and pivot tables).
• Systems Thinking: Ability to understand how different parts of a process impact the whole.

Company Introduction  

We exist to wow our customers. We know we’re doing the right thing when we hear our customers say, “How did we ever live without Coupang?” Born out of an obsession to make shopping, eating, and living easier than ever, we’re collectively disrupting the multi-billion-dollar e-commerce industry from the ground up. We are one of the fastest-growing e-commerce companies that established an unparalleled reputation for being a dominant and reliable force in South Korean commerce.   

We are proud to have the best of both worlds — a startup culture with the resources of a large global public company. This fuels us to continue our growth and launch new services at the speed we have been since our inception. We are all entrepreneurs surrounded by opportunities to drive new initiatives and innovations. At our core, we are bold and ambitious people that like to get our hands dirty and make a hands-on impact. At Coupang, you will see yourself, your colleagues, your team, and the company grow every day.  

Our mission to build the future of commerce is real. We push the boundaries of what’s possible to solve problems and break traditional tradeoffs. Join Coupang now to create an epic experience in this always-on, high-tech, and hyper-connected world. 
  

Role Overview 

We are looking for an experienced Software Development Manager to lead a team of 8-14 engineers building critical settlement platform capabilities. You will own the technical direction, delivery, and people growth for your team while partnering closely with business stakeholders to deliver a world-class finance & settlement platform. 

The CGFS (Coupang Global Financial Settlement) team is responsible for the end-to-end settlement platform — from vendor master management and AR/AP registers, through netting engines and tax invoicing, to payment execution and GL posting. We process billions of dollars in settlements annually across multiple countries and business models.

You will have the opportunity to : 

• Build a greenfield settlement platform processing billions in daily volume
• High-impact role — your team's work directly affects vendor/seller payment accuracy and speed
• Work with cutting-edge distributed systems at massive scale 

What You Will Do 

• Lead, hire, and grow a team of 8-14 backend engineers building core settlement platform services
• Own technical delivery of key platform capabilities including revenue/inventory accounting, AR/AP processing, tax invoicing, integration with fintech & SAP.
• Partner with Product, Accounting, Treasury, and Tax teams to translate complex business requirements into scalable technical solutions
• Drive architecture decisions across Java backend services, distributed data stores (MySQL/TiDB, DynamoDB, Aurora), and streaming infrastructure (Kafka, Flink, Spark)
• Establish engineering excellence — code quality, operational readiness, on-call practices, and incident response
• Manage cross-functional dependencies and delivery timelines across multiple platform capabilities
• Mentor engineers, conduct performance reviews, and build a high-performing engineering culture
• Drive migration from legacy SAP-based settlement to modern microservices architecture
• Ensure platform reliability, correctness, and auditability for financial-grade systems processing billions in daily settlements 

Basic Qualifications 

• 8+ years of software engineering experience with 3+ years in engineering management
• Strong technical background in Java backend development and distributed systems
• Experience managing teams of 10+ engineers through full development lifecycle
• Hands-on experience with relational databases (MySQL, Aurora, TiDB) and NoSQL (DynamoDB)
• Experience with event-driven architectures and streaming platforms (Kafka, Flink, or Spark)
• Track record of delivering large-scale, high-reliability platforms on time
• Strong communication skills — ability to translate between business stakeholders and engineering teams
• BS/MS in Computer Science or equivalent practical experience  

Preferred Qualifications 

• Experience in finance, accounting, payments, or e-commerce settlement domains
• Experience with financial-grade systems (auditability, reconciliation, idempotency, data correctness)
• Experience migrating legacy monolithic systems to microservices
• Experience with OLAP/analytics engines (Hive, Pinot) for operational reporting
• Experience operating at scale in a fast-growing, multi-country environment 

Type of work model 

• Hybrid / Onsite / Remote working 

Our Hybrid work model: Coupang hybrid work model is designed to enable a culture of collaboration that acts a catalyst to enrich the experience of employees. Employees are required to work at least 3 days in the office per week, with the flexibility to work from home 2 days a week, depending on the role requirement. Some businesses may require more time in office due to nature of work.  

Details to consider 

• Those eligible for employment protection (recipients of veteran’s benefits, the disabled, etc.) may receive preferential treatment for employment in accordance with applicable laws. 

Privacy Notice  

• Your personal information will be collected and managed by Coupang as stated in the Application Privacy Notice located below. https://privacy.coupang.com/en/land/jobs/ 

 Please complete the attached Internal Transfer Request Form and submit.   

Please make sure to apply with your Coupang e-mail address.   

Company Introduction  

We exist to wow our customers. We know we’re doing the right thing when we hear our customers say, “How did we ever live without Coupang?” Born out of an obsession to make shopping, eating, and living easier than ever, we’re collectively disrupting the multi-billion-dollar e-commerce industry from the ground up. We are one of the fastest-growing e-commerce companies that established an unparalleled reputation for being a dominant and reliable force in South Korean commerce.   

We are proud to have the best of both worlds — a startup culture with the resources of a large global public company. This fuels us to continue our growth and launch new services at the speed we have been since our inception. We are all entrepreneurs surrounded by opportunities to drive new initiatives and innovations. At our core, we are bold and ambitious people that like to get our hands dirty and make a hands-on impact. At Coupang, you will see yourself, your colleagues, your team, and the company grow every day.  

Our mission to build the future of commerce is real. We push the boundaries of what’s possible to solve problems and break traditional tradeoffs. Join Coupang now to create an epic experience in this always-on, high-tech, and hyper-connected world. 
  

Role Overview 

The Taiwan Data, Analytics & AI team is the engine driving Coupang’s rapid expansion in the Taiwan market. Our mission is to transform massive datasets into actionable intelligence and automated systems that power business decisions. As we scale, we are transitioning from foundational growth to a sophisticated enterprise AI ecosystem. We are building the next generation of data services that ensure every stakeholder across the Taiwan organization has access to high-integrity, automated, and intelligent insights.

As a Staff Machine Learning Engineer, you will be a technical leader responsible for the architecture and automation of our regional data intelligence layer. Your primary focus will be bridging the gap between raw data and organizational knowledge. You will lead the automation of our Knowledge Base, govern the integrity of our core metrics, and scale our analytics services to support the entire Taiwan organization.

This is a high-impact role where technology meet business, and you will design systems that not only provide data but ensure that the "truth" behind the data is refreshed, accurate, and easily accessible through AI-driven interfaces and help us become true AI first Analytics Organisation.

What You Will Do

• Automated Knowledge Engineering: Design and implement end-to-end ML pipelines to automate the creation and maintenance of a centralized Knowledge Base, utilizing LLMs and RAG (Retrieval-Augmented Generation) to synthesize complex business logic.

• Metric Integrity & Governance: Develop systemic checks and automated validation frameworks to ensure the integrity of business metrics. You will be the architect of a "Single Source of Truth," ensuring definitions remain consistent across all AI and reporting services.

• AI-Driven Pipeline Automation: Architect "Self-Healing" data pipelines using AI tools to automate schema mapping, error detection, and recovery. Implement LLM-powered agents to generate, optimize, and document ETL code, reducing manual engineering overhead.

• Scalable AI Services: Architect and scale existing Data and Analytics services to handle the increasing demands of the entire Taiwan organization, ensuring high availability and low-latency access to insights.

• Feedback & Refresh Loops: Build automated feedback mechanisms to identify "stale" content or drifting metric definitions. You will design the workflows that ensure both new and existing knowledge content is refreshed regularly based on user behavior and data shifts.

• Systemic Optimization: Drive innovation in semantic retrieval and query understanding to allow non-technical stakeholders to interact with complex data layers using natural language.

• Enablement & Training: Act as a force multiplier by enabling and training various reporting functions (Finance, Ops, Marketing). You will create the tools and frameworks that allow these teams to self-serve with high confidence.

• Technical Mentorship: Lead by example in code quality, system design, and experimentation. Mentor senior and mid-level engineers, fostering a culture of technical excellence and continuous improvement.

Basic Qualifications

•  Bachelor’s degree in Computer Science, Mathematics, Statistics, or a related technical field.

• 8+ years of professional experience in software engineering and applied machine learning (with at least 2 years in a Staff or Lead capacity).

• Proficiency in Python or Java, with deep experience building production-grade ML systems and scalable data pipelines.

• Strong experience with SQL and big data technologies (e.g., Spark, Presto/Trino, Airflow).

Preferred Qualifications

• Advanced Degree: Master’s or PhD in a relevant technical field.

• AI/LLM Expertise: Proven track record of deploying Large Language Models (LLMs), vector databases, and embedding-based retrieval systems in a production environment.

• Automated Management: Experience with AI-powered data management tools (e.g., automated data profiling, AI-driven data catalogs, or LLM-assisted SQL generation).

• Enterprise Scaling: Experience transitioning data organizations from "growth-phase" scripts to "enterprise-phase" robust microservices.

• Cloud Proficiency: Hands-on experience with AWS or GCP (SageMaker, Vertex AI, BigQuery).

• MLOps Mastery: Experience with ML lifecycle tools like MLflow, Kubeflow, or Weights & Biases to manage model lineage and data drift.

• Communication: Exceptional ability to communicate technical roadmaps to non-technical business leaders and influence cross-functional stakeholders in a fast-paced, global environment.

Type of work model 

• Hybrid 

Details to consider 

• Those eligible for employment protection (recipients of veteran’s benefits, the disabled, etc.) may receive preferential treatment for employment in accordance with applicable laws. 
   

Privacy Notice  

• Your personal information will be collected and managed by Coupang as stated in the Application Privacy Notice located below. https://privacy.coupang.com/en/land/jobs/ 

              Berkadia Services India Pvt Ltd   

-----------------------------------------------------------------------------------------------   

       Integrity is Everything I We Take the Long View I We believe People Matter I We Stand for Excellence I We Love our Jobs I We Innovate   

Reports To                 Philip Valent          

The Opportunity   

As a member of the Data Pipeline team you’ll be at the center of building our platform that enables us to redefine the Commercial Real Estate industry. We’re building a data pipeline that merges with the tested design of data warehousing and the latest big data technologies. You will be designing and building data projects while securing core data elements. 

In this role, individual will be required to work on one or multiple aspects of Innovation verticals with the following key responsibilities –    

• Research new technology and share knowledge with team and peers 

• Design, implement and release data applications in AWS using big data technologies 

• Coordinate development efforts across the organization 

• Influence team in development standards and processes 

• Teach and mentor peers 

• Other duties as assigned 

Your Qualification  

Education:   

• Bachelor’s degree in information technology, Computer Science, Engineering, Information Systems, or a closely related technology field; or equivalent practical experience. 

• Preferably Post Graduate degree including MBA/PGDBM 

Qualifications:   

Qualifications to perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the experience required: 

• 5+ years of professional experience in data engineering or a closely related field. 

• 5 -8 years of hands-on Apache Spark experience (PySpark preferred) 

• Proven experience building and maintaining ETL/ELT pipelines using tools/frameworks such as PostgreSQL, Docker, Apache Airflow, AWS Step Functions, or similar. 

• 1-2 years of experience building high-performance algorithms in scalable languages such as Scala, Python and R 

• Strong expertise in SQL (complex queries, performance tuning, analytical functions). 

• Excellent interpersonal, verbal and written communication skills 

• Experience mentoring junior engineers and performing code reviews 

• Strong logical, analytical, problem solving and reporting skills 

• AWS Elastic Map Reduce (EMR) experience 

• Experience with modern data warehousing and/or lakehouse architecture. 

• Familiarity with CI/CD, Git, and agile development practices. 

• Experience managing large scale products with a passion for quality/efficiency. 

Perks & Benefits           

Berkadia offers the best-in-class benefits to enable an enjoyable work environment for the employees. Key benefits include –  

• Leaves: Berkadia offers a comprehensive leave policy that not only helps you to plan holidays and personal milestones, but also covers exigencies such as sickness and bereavement.  

• Transportation: Berkadia offers free transportation to every employee, irrespective of their shift timings.  

• Medical Insurance: Berkadia has an inclusive medical insurance policy that covers the family members of the employees, including parents.  

• Learn while you Earn: Berkadia encourages employees to learn new skills by sponsoring degrees, certifications, training, and workshops.  

• Wellness: Berkadia has an extensive wellness program that includes annual health check, eye checkup, dental screening, OPD reimbursement, and Employee Assistance Program.  

About us  

Berkadia, a joint venture of Berkshire Hathaway and Jefferies Financial Group, is a leader in the commercial real estate industry, offering a robust suite of services to our multifamily and commercial property clients. Powered by deep relationships and industry-changing technology, our people sell, finance, and service commercial real estate, providing support for the entire life cycle of our clients’ assets.                                                             

Berkadia is an equal opportunity employer and affords equal opportunity to all applicants and employees for all positions without regard to race, color, religion, gender, national origin, age, disability, or any other status protected under the law. To learn more about Berkadia, please visit https://berkadia.com/  

For details about India operations, please visit https://berkadia.com/india/  

Why us?  

Here At Berkadia, We Believe People Matter.  

In fact, our people are the heart and soul of everything we do. That’s why we employ the top CRE professionals in our industry, and make sure we invest in their personal development and training. With a focus on innovation and insights, we set the bar high – and keep it there – so that we provide best-in-class service for our clients.  

Our culture, or Berkadia Way as we know it, encourages us to truly see people as people, with unique needs, challenges, and objectives. We take this into consideration when working with each other, engaging our clients, and supporting our communities. Thus, instilling a mindset that fosters our shared commitment to self-accountability helps us see our impact on each other and adjust our efforts accordingly.  

While this job description is intended to be an accurate reflection of the job requirements, management reserves the right to modify, add, or remove duties and to assign other duties, as necessary.    

Please note that we will only be able to accept candidates who have the appropriate rights and documentation for employment in India. 

Who we are. 

Axi is a leading global provider of margin and deliverable Foreign Exchange, Contracts for Difference (CFDs), and Financial Spread betting. Our business has evolved into a world-class, multifaceted brokerage with offices in six regions. With heavy investment in the latest trading technology, Axi seeks to offer the most comprehensive end-to-end trading experience available, servicing traders of all levels from beginners to institutional-level clients. 

Let's talk about the cool stuff you do at Axi! 

As the Senior Data Engineer for the Customer Data Platform, you will play a pivotal role improving Axi’s data capabilities which deliver positive performance impacts on our global trading products. You will sit within our Product Data Team and proactively collaborate with broader business teams across Product, IT, Sales/Marketing and Finance. You will implement data initiatives which buildAxi’s utilisation of our Customer Data Platform to deliver growth strategies that increase the
adoption of Axi’s trading products that will generate new trading clients.

Your EDGE Assignment/You Will

• Build and maintain ETL/ELT pipelines on Azure Databricks using PySpark or Scala to ingest, transform, and deliver data products at scale.
• Ingest data from SQL Server, Cosmos DB, event streams, APIs, and external sources into cloud data lakes and Databricks lakehouses.
• Design and implement data quality checks, validation rules, and monitoring to ensure reliability and early detection of anomalies.
• Optimize Spark jobs for performance and cost, including cluster sizing, partitioning strategies, and caching mechanisms.
• Document data pipelines, lineage, and schemas; maintain data dictionaries and metadata catalogs for consumer discovery and understanding.
• Collaborate with data analysts, scientists, and domain engineers to understand requirements and refine data products.
• Contribute to infrastructure and tooling for data workflows (scheduling, orchestration, monitoring, alerting).

Technical Requirements

• Hands-on experience with Azure Databricks and Apache Spark (PySpark or Scala) for large-scale data processing.
• Strong SQL skills, including complex queries, window functions, CTEs, and query optimization for both transactional and analytical workloads.
• Experience with SQL Server: data warehousing concepts, schema design, indexing, and optimization for analytics.
• Familiarity with Azure data services: Data Lake Storage, Synapse Analytics, Data Factory, or Blob Storage.
• Understanding of ETL/ELT concepts, data modeling, dimensional modeling (fact/dimension tables), and slowly changing dimensions.
• Experience with batch and/or stream processing concepts; familiarity with event-driven architectures.
• Knowledge of data quality frameworks, testing strategies, and monitoring/alerting for data pipelines.
• Basic understanding of relational and NoSQL databases (Cosmos DB exposure is beneficial).

Are you the one? 

• 5+ years of experience in data engineering or analytics engineering roles.
• Strong problem-solving and ability to work independently with guidance from senior engineers.
• Good communication skills to translate business requirements into technical data solutions.
• Ability to work in Agile environments and collaborate with global teams across time zones.

Axi's bag of delights 

• Competitive and attractive compensation.
• Extensive learning opportunities, such as professional training and certifications and soft skills development.
• 18 annual leave days per year.
• 12 sick days leave per year.
• Public holidays as declared by local government.
• Maternity leave as per law.
• Health Insurance. 

Axi's interview journey 

• Talent Acquisition Interview (45 minutes)
• Hiring Manager Exploratory Discussion (30–45 min)
• Coding/Data Round (60–90 min)
• Data Design Round (60 min)
• Cultural Interview (30 minutes)

At Axi, we prioritise creating a workplace that upholds fairness and respect for all. We encourage every individual within our community to contribute towards a culture where everyone feels a sense of belonging and is treated with the dignity they deserve. We make all employment-related decisions—whether in hiring, compensation, training, performance reviews, or termination—based on merit and without bias, ensuring equal opportunities for everyone. We consciously work to identify and overcome any unconscious biases, with a commitment to fostering an inclusive environment where every employee and candidate feels genuinely welcomed and valued.

Please note that our organization works with recruitment agencies on a pre-approved basis only. A recruitment agency that wishes to submit candidate profiles or resumes for consideration must obtain prior written consent from our talent acquisition team. We do not accept unsolicited resumes from recruitment agencies, and we will not be responsible for any fees related to unsolicited resumes. Should we receive an unsolicited resume from a recruitment agency that does not have prior written consent, we will not be responsible for the payment any fees related to the recruitment of the candidate represented in the unsolicited resume.

Please note that we will only be able to accept candidates who have the appropriate rights and documentation for employment in India. 

Who we are. 

Axi is a leading global provider of margin and deliverable Foreign Exchange, Contracts for Difference (CFDs), and Financial Spread betting. Our business has evolved into a world-class, multifaceted brokerage with offices in six regions. With heavy investment in the latest trading technology, Axi seeks to offer the most comprehensive end-to-end trading experience available, servicing traders of all levels from beginners to institutional-level clients. 

Let's talk about the cool stuff you do at Axi! 

The Architecture organization partners with Engineering, Data, Risk, and Product teams to define platforms, standards, and reference architectures that enable safe, fast delivery at scale. As Data Architect, you will shape how we organize, govern, and serve data across Axi’s technology ecosystem

Your EDGE Assignment/You Will

• Define end-to-end data platform architecture spanning ingestion, storage, processing, and serving layers using Azure Databricks, SQL Server, Cosmos DB, and Data Lake technologies.
• Design batch, streaming, and real-time data pipelines for trading, risk, regulatory, and customer data, establishing clear SLAs and contracts with consumers.
• Establish data governance frameworks: data classification, lineage tracking, quality standards, and compliance/security requirements.
• Create reference architectures and decision trees for data-heavy services (OLTP vs OLAP, relational vs NoSQL, batch vs streaming, medallion/lakehouse patterns).
• Lead architectural reviews and provide guidance to domain PODs and Data Engineering teams on data strategy, technology choices, and scalability.
• Design data models and storage strategies balancing transactional consistency, analytical performance, and cost efficiency.
• Work closely with Risk, Finance, and Compliance teams to ensure data architectures meet regulatory and audit requirements.

Technical Requirements

• Deep expertise with Azure Databricks, Delta Lake, and the Medallion (Bronze/Silver/Gold) architecture pattern for data lakehouses.
• Expert-level understanding of Apache Spark, including optimization, cluster management, and cost control.
• Strong SQL Server knowledge: data warehousing, dimensional modeling, indexing, query optimization, and replication strategies.
• Solid experience with Cosmos DB: partitioning strategies, consistency models, throughput management, and cost optimization.
• Experience with Azure data services: Data Lake Storage Gen2, Azure Synapse, Data Factory, Event Hubs, or equivalent.
• Understanding of data governance, metadata management, and data cataloging tools (e.g., Purview, Collibra, or similar).
• Knowledge of data quality frameworks and testing strategies for batch and streaming pipelines.
• Experience with security and compliance in data platforms (encryption, RBAC, audit logging, regulatory requirements)

 Requirements

• 7–14 years of experience in data engineering and/or data architecture, with at least 3+ years in an architecture or principal engineer role.
• Proven track record designing and scaling data platforms in financial services, trading, or other regulated, high-volume environments.
• Strong ability to communicate complex architectural concepts to both technical teams and non-technical stakeholders.
• Experience influencing organizational practices, standards, and tool selection across multiple teams.
• Demonstrated ability to balance innovation, performance, cost, and regulatory requirements in architecture decisions.

Axi's bag of delights 

• Competitive and attractive compensation.
• Extensive learning opportunities, such as professional training and certifications and soft skills development.
• 18 annual leave days per year.
• 12 sick days leave per year.
• Public holidays as declared by local government.
• Maternity leave as per law.
• Health Insurance. 

Axi's interview journey 

• Talent Acquisition Interview (45 minutes)
• Hiring Manager Exploratory Discussion (45–60 min
• Architecture Deep Dive (60–75 min
• Design & Stakeholder Round (60–75 min
• Cultural Interview (30 minutes)

At Axi, we prioritise creating a workplace that upholds fairness and respect for all. We encourage every individual within our community to contribute towards a culture where everyone feels a sense of belonging and is treated with the dignity they deserve. We make all employment-related decisions—whether in hiring, compensation, training, performance reviews, or termination—based on merit and without bias, ensuring equal opportunities for everyone. We consciously work to identify and overcome any unconscious biases, with a commitment to fostering an inclusive environment where every employee and candidate feels genuinely welcomed and valued.

Please note that our organization works with recruitment agencies on a pre-approved basis only. A recruitment agency that wishes to submit candidate profiles or resumes for consideration must obtain prior written consent from our talent acquisition team. We do not accept unsolicited resumes from recruitment agencies, and we will not be responsible for any fees related to unsolicited resumes. Should we receive an unsolicited resume from a recruitment agency that does not have prior written consent, we will not be responsible for the payment any fees related to the recruitment of the candidate represented in the unsolicited resume.

Please note that we will only be able to accept candidates who have the appropriate rights and documentation for employment in India. 

Who we are. 

Axi is a leading global provider of margin and deliverable Foreign Exchange, Contracts for Difference (CFDs), and Financial Spread betting. Our business has evolved into a world-class, multifaceted brokerage with offices in six regions. With heavy investment in the latest trading technology, Axi seeks to offer the most comprehensive end-to-end trading experience available, servicing traders of all levels from beginners to institutional-level clients. 

Let's talk about the cool stuff you do at Axi! 

As the Data Engineer for the Customer Data Platform, you will play a pivotal role improving Axi’s data capabilities which deliver positive performance impacts on our global trading products. You will sit within our Product Data Team and proactively collaborate with broader business teams across Product, IT, Sales/Marketing and Finance. You will implement data initiatives which buildAxi’s utilisation of our Customer Data Platform to deliver growth strategies that increase the
adoption of Axi’s trading products that will generate new trading clients.

Your EDGE Assignment/You Will

• Build and maintain ETL/ELT pipelines on Azure Databricks using PySpark or Scala to ingest, transform, and deliver data products at scale.
• Ingest data from SQL Server, Cosmos DB, event streams, APIs, and external sources into cloud data lakes and Databricks lakehouses.
• Design and implement data quality checks, validation rules, and monitoring to ensure reliability and early detection of anomalies.
• Optimize Spark jobs for performance and cost, including cluster sizing, partitioning strategies, and caching mechanisms.
• Document data pipelines, lineage, and schemas; maintain data dictionaries and metadata catalogs for consumer discovery and understanding.
• Collaborate with data analysts, scientists, and domain engineers to understand requirements and refine data products.
• Contribute to infrastructure and tooling for data workflows (scheduling, orchestration, monitoring, alerting).

Technical Requirements

• Hands-on experience with Azure Databricks and Apache Spark (PySpark or Scala) for large-scale data processing.
• Strong SQL skills, including complex queries, window functions, CTEs, and query optimization for both transactional and analytical workloads.
• Experience with SQL Server: data warehousing concepts, schema design, indexing, and optimization for analytics.
• Familiarity with Azure data services: Data Lake Storage, Synapse Analytics, Data Factory, or Blob Storage.
• Understanding of ETL/ELT concepts, data modeling, dimensional modeling (fact/dimension tables), and slowly changing dimensions.
• Experience with batch and/or stream processing concepts; familiarity with event-driven architectures.
• Knowledge of data quality frameworks, testing strategies, and monitoring/alerting for data pipelines.
• Basic understanding of relational and NoSQL databases (Cosmos DB exposure is beneficial).

Are you the one? 

• 3+ years of experience in data engineering or analytics engineering roles.
• Strong problem-solving and ability to work independently with guidance from senior engineers.
• Good communication skills to translate business requirements into technical data solutions.
• Ability to work in Agile environments and collaborate with global teams across time zones.

Axi's bag of delights 

• Competitive and attractive compensation.
• Extensive learning opportunities, such as professional training and certifications and soft skills development.
• 18 annual leave days per year.
• 12 sick days leave per year.
• Public holidays as declared by local government.
• Maternity leave as per law.
• Health Insurance. 

Axi's interview journey 

• Talent Acquisition Interview (45 minutes)
• Hiring Manager Exploratory Discussion (30–45 min)
• Coding/Data Round (60–90 min)
• Data Design Round (60 min)
• Cultural Interview (30 minutes)

At Axi, we prioritise creating a workplace that upholds fairness and respect for all. We encourage every individual within our community to contribute towards a culture where everyone feels a sense of belonging and is treated with the dignity they deserve. We make all employment-related decisions—whether in hiring, compensation, training, performance reviews, or termination—based on merit and without bias, ensuring equal opportunities for everyone. We consciously work to identify and overcome any unconscious biases, with a commitment to fostering an inclusive environment where every employee and candidate feels genuinely welcomed and valued.

Please note that our organization works with recruitment agencies on a pre-approved basis only. A recruitment agency that wishes to submit candidate profiles or resumes for consideration must obtain prior written consent from our talent acquisition team. We do not accept unsolicited resumes from recruitment agencies, and we will not be responsible for any fees related to unsolicited resumes. Should we receive an unsolicited resume from a recruitment agency that does not have prior written consent, we will not be responsible for the payment any fees related to the recruitment of the candidate represented in the unsolicited resume.

Company Introduction  

We exist to wow our customers. We know we’re doing the right thing when we hear our customers say, “How did we ever live without Coupang?” Born out of an obsession to make shopping, eating, and living easier than ever, we’re collectively disrupting the multi-billion-dollar e-commerce industry from the ground up. We are one of the fastest-growing e-commerce companies that established an unparalleled reputation for being a dominant and reliable force in South Korean commerce.   

We are proud to have the best of both worlds — a startup culture with the resources of a large global public company. This fuels us to continue our growth and launch new services at the speed we have been since our inception. We are all entrepreneurs surrounded by opportunities to drive new initiatives and innovations. At our core, we are bold and ambitious people that like to get our hands dirty and make a hands-on impact. At Coupang, you will see yourself, your colleagues, your team, and the company grow every day.  

Our mission to build the future of commerce is real. We push the boundaries of what’s possible to solve problems and break traditional tradeoffs. Join Coupang now to create an epic experience in this always-on, high-tech, and hyper-connected world. 
  

Role Overview 

The Taiwan Data, Analytics & AI team is the engine driving Coupang’s rapid expansion in the Taiwan market. Our mission is to transform massive datasets into actionable intelligence and automated systems that power business decisions. As we scale, we are transitioning from foundational growth to a sophisticated enterprise AI ecosystem. We are building the next generation of data services that ensure every stakeholder across the Taiwan organization has access to high-integrity, automated, and intelligent insights.

As a Staff Machine Learning Engineer, you will be a technical leader responsible for the architecture and automation of our regional data intelligence layer. Your primary focus will be bridging the gap between raw data and organizational knowledge. You will lead the automation of our Knowledge Base, govern the integrity of our core metrics, and scale our analytics services to support the entire Taiwan organization.

This is a high-impact role where technology meet business, and you will design systems that not only provide data but ensure that the "truth" behind the data is refreshed, accurate, and easily accessible through AI-driven interfaces and help us become true AI first Analytics Organisation.

What You Will Do

• Automated Knowledge Engineering: Design and implement end-to-end ML pipelines to automate the creation and maintenance of a centralized Knowledge Base, utilizing LLMs and RAG (Retrieval-Augmented Generation) to synthesize complex business logic.

• Metric Integrity & Governance: Develop systemic checks and automated validation frameworks to ensure the integrity of business metrics. You will be the architect of a "Single Source of Truth," ensuring definitions remain consistent across all AI and reporting services.

• AI-Driven Pipeline Automation: Architect "Self-Healing" data pipelines using AI tools to automate schema mapping, error detection, and recovery. Implement LLM-powered agents to generate, optimize, and document ETL code, reducing manual engineering overhead.

• Scalable AI Services: Architect and scale existing Data and Analytics services to handle the increasing demands of the entire Taiwan organization, ensuring high availability and low-latency access to insights.

• Feedback & Refresh Loops: Build automated feedback mechanisms to identify "stale" content or drifting metric definitions. You will design the workflows that ensure both new and existing knowledge content is refreshed regularly based on user behavior and data shifts.

• Systemic Optimization: Drive innovation in semantic retrieval and query understanding to allow non-technical stakeholders to interact with complex data layers using natural language.

• Enablement & Training: Act as a force multiplier by enabling and training various reporting functions (Finance, Ops, Marketing). You will create the tools and frameworks that allow these teams to self-serve with high confidence.

• Technical Mentorship: Lead by example in code quality, system design, and experimentation. Mentor senior and mid-level engineers, fostering a culture of technical excellence and continuous improvement.

Basic Qualifications

•  Bachelor’s degree in Computer Science, Mathematics, Statistics, or a related technical field.

• 8+ years of professional experience in software engineering and applied machine learning (with at least 2 years in a Staff or Lead capacity).

• Proficiency in Python or Java, with deep experience building production-grade ML systems and scalable data pipelines.

• Strong experience with SQL and big data technologies (e.g., Spark, Presto/Trino, Airflow).

Preferred Qualifications

• Advanced Degree: Master’s or PhD in a relevant technical field.

• AI/LLM Expertise: Proven track record of deploying Large Language Models (LLMs), vector databases, and embedding-based retrieval systems in a production environment.

• Automated Management: Experience with AI-powered data management tools (e.g., automated data profiling, AI-driven data catalogs, or LLM-assisted SQL generation).

• Enterprise Scaling: Experience transitioning data organizations from "growth-phase" scripts to "enterprise-phase" robust microservices.

• Cloud Proficiency: Hands-on experience with AWS or GCP (SageMaker, Vertex AI, BigQuery).

• MLOps Mastery: Experience with ML lifecycle tools like MLflow, Kubeflow, or Weights & Biases to manage model lineage and data drift.

• Communication: Exceptional ability to communicate technical roadmaps to non-technical business leaders and influence cross-functional stakeholders in a fast-paced, global environment.

Type of work model 

• Hybrid 

Details to consider 

• Those eligible for employment protection (recipients of veteran’s benefits, the disabled, etc.) may receive preferential treatment for employment in accordance with applicable laws. 
   

Privacy Notice  

• Your personal information will be collected and managed by Coupang as stated in the Application Privacy Notice located below. https://privacy.coupang.com/en/land/jobs/ 

Experience : 5-8 yrs
Location: Bangalore or Willing to Relocate
Job Mode: Hybrid
Education: Minimum Bachelor's Degree Required

Toast has grown to be a leading hospitality software company in the US and is now setting its sights on our next stages of growth.  As the business continues to grow, there is increased demand to enhance the enterprise level of support in the product. Toast customers who managed several restaurants a few years ago are now expanding their business and adding new locations. New enterprise customers are looking to leverage Toast technology to support the growth of their business in new ways. These exciting new opportunities will require Toast to bolster our product offerings

Are you bready* for a change?

Toast is looking for a Senior Software engineer to join our enterprise Away team. You will get to work across the entire Toast platform, including the partner ecosystem. As a member of the enterprise team, you will help ensure that the product is being built to meet the new and expanding needs of these customers.

About this roll* (Responsibilities) 

• Design, build, deploy, and maintain highly resilient and scalable features across Toast’s enterprise management products
• Lead complex projects that improve functionality and reliability for our customers 
• Partner with a wide array of teams across Toast 
• Ensure quality by building automated testing for changes
• Roll* features out to customers, including monitoring for success
• Collaborate with UX and PM on the definition and design of features  
• Mentor and coach other engineers

Do you have the right ingredients*? (Requirements)

• 5+ years experience building backend services and APIs
• Extensive experience working with an Object Oriented Language like Java or Kotlin, with a deep understanding of testing, quality, and best practices
• Experience shipping production services and balancing getting things done with platform stability and reliability
• Experience building backend services and APIs and scaling distributed systems
• Focused on delivering positive impact for Toast customers
• Enjoys working in a team environment with a shared code-base
• Excellent cross-team communication skills on complex technical topics 

We are hiring individuals with a wide range of experience so if you have more or less than these exact roles, please still apply!

Our Tech Stack

Toast’s products run on a stack that ranges from guest and restaurant-facing Android tablets to backend services in Java to internal, guest-facing and restaurant-facing web apps. Our backend services follow a microservice architecture written using Java 8 and DropWizard; we use AWS extensively, ranging from S3 to RDS to Lambda. We have our own platform for dealing with user management, service elevations and robust load balancing. Toast stores data in a set of sharded Postgres databases and utilizes Apache Spark for large scale data workloads including query and batch processing. The front-end is built primarily using React and ES6. The main Toast POS application is an Android application written in Java and Kotlin. For data between tablets and our cloud platform we operate RabbitMQ clusters as well as direct tablet communication to the back end.

AI at Toast

At Toast, one of our company values is that we're hungry to build and learn. We believe learning new AI tools empowers us to build for our customers faster, more independently, and with higher quality. We provide these tools across all disciplines, from Engineering and Product to Sales and Support, and are inspired by how our Toasters are already driving real value with them. The people who thrive here are those who embrace changes that let us build more for our customers; it’s a core part of our culture.

Our Total Rewards Philosophy 
We strive to provide competitive compensation and benefits programs that help to attract, retain, and motivate the best and brightest people in our industry. Our total rewards package goes beyond great earnings potential and provides the means to a healthy lifestyle with the flexibility to meet Toasters’ changing needs. Learn more about our benefits at https://careers.toasttab.com/toast-benefits.

Job Title: Data Engineer

About Us

“Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the  British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. 

WHY JOIN CAPCO?

You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.

MAKE AN IMPACT

Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.

#BEYOURSELFATWORK

Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.

CAREER ADVANCEMENT

With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.

DIVERSITY & INCLUSION

We believe that diversity of people and perspective gives us a competitive advantage.

MAKE AN IMPACT

JOB: Data Engineer

Location: Bangalore & Pune

About Okta

Okta is an enterprise grade identity management service, built from the ground up in the cloud and delivered with an unwavering focus on customer success. With Okta you can manage access across any application, person, or device. Whether the people are employees, partners, or customers, or the applications are in the cloud, on premises, or on a mobile device, Okta helps you become more secure, make people more productive, and maintain compliance.

The Okta service provides directory services, single sign-on, strong authentication, provisioning, workflow, and built in reporting. It runs in the cloud on a secure, reliable, extensively audited platform and integrates deeply with on premises applications, directories, and identity management systems.

About the Team

The Data Platform team is responsible for the foundational data services, systems, and data products for Okta that benefit our users. Today, the Data Platform team solves challenges and enables:

• Streaming analytics 
• Interactive end-user reporting 
• Data and ML platform for Okta to scale
• Telemetry of our products and data

Our elite team is fast, creative and flexible. We encourage ownership. We expect great things from our engineers and reward them with stimulating new projects, new technologies and the chance to have significant equity in a company. Okta is about to change the cloud computing landscape forever. 

About the Position

This is an opportunity for experienced Software Engineers to join our fast growing Data Platform organization that is passionate about scaling high volume, low-latency, distributed data-platform services & data products. In this role, you will get to work with engineers throughout the organization to build foundational infrastructure that allows Okta to scale for years to come. As a member of the Data Platform team, you will be responsible for designing, building, and deploying the systems that power our data analytics and ML. Our analytics infrastructure stack sits on top of many modern technologies, including Kinesis, Flink, ElasticSearch, and Snowflake. 

We are looking for experienced Software Engineers who can help design and own the building, deploying and optimizing the streaming infrastructure. This project has a directive from engineering leadership to make OKTA a leader in the use of data and machine learning to improve end-user security and to expand that core-competency across the rest of engineering. You will have a sizable impact on the direction, design & implementation of the solutions to these problems.

Job Duties and Responsibilities:

• Design, implement and own data-intensive, high-performance, scalable platform components
• Work with engineering teams, architects and cross functional partners on the development of projects, design, and implementation
• Conduct and participate in design reviews, code reviews, analysis, and performance tuning
• Coach and mentor engineers to help scale up the engineering organization
• Debug production issues across services and multiple levels of the stack 

Required Knowledge, Skills, and Abilities: 

• 8+ years of experience in object-oriented language, preferably Java 
• Hands-on experience using a cloud-based distributed computing technologies including
• Messaging systems such as Kinesis, Kafka 
• Data processing systems like Flink, Spark, Beam
• Storage & Compute systems such as Snowflake, Hadoop
• Coordinators and schedulers like the ones in Kubernetes, Hadoop, Mesos

• Experience in developing and tuning highly scalable distributed systems
• Excellent grasp of software engineering principles
• Solid understanding of multithreading, garbage collection and memory management
• Experience with reliability engineering specifically in areas such as data quality, data observability and incident management

Nice to have

• Maintained security, encryption, identity management, or authentication infrastructure
• Leveraged major public cloud providers to build mission-critical, high volume services
• Hands-on experience in developing Data Integration applications for large scale (petabyte scale) environments with experience in both batch and online systems.
• Contributed to the development of distributed systems or used one or more at high volume or criticality such as Kafka or Hadoop
• Experience developing Kubernetes based services on AWS Stack

#LI-Hybrid

#P24820

About the role:

As a Sr. Manager, Platform & Architecture you will lead the definition, governance & continuous evolution of the enterprise data architecture vision and roadmap, ensuring strong alignment with business strategy and digital transformation goals. This role is accountable for establishing modern, secure, and scalable data platform architectures that enable advanced analytics, AI/ML, generative AI, and self service data capabilities across the organization.

You will provide strategic leadership in embedding AI into the enterprise data platform, enabling use cases such as predictive analytics, intelligent automation, and generative AI, while ensuring responsible AI practices, model governance, data quality, and regulatory compliance.

The role requires deep expertise in data architecture, cloud data platforms, analytics ecosystems, and platform security, combined with strong people and stakeholder management skills. You will guide the evaluation and adoption of emerging technologies, oversee PoC initiatives, and drive the operationalization of AI/ML and GenAI solutions.

Working closely with data engineering, analytics, AI/ML, security, and business leaders, you will ensure the delivery of trusted, high performing, and future ready data and AI platforms that scale with organizational needs.

What you'll do:

Strategic Leadership & Architecture Vision

• Define and own the enterprise data architecture vision and roadmap aligned with business strategy.
• Establish architectural principles, standards, and best practices across data modeling, integration, metadata, and analytics
• Guide architectural decisions to support scalability, performance, security, and future growth.
• Evaluate and approve new data technologies, platforms, and tools

Team Management & Development

• Lead, mentor, and manage data modelers & architects, platform engineers and data engineers
• Set goals, conduct performance reviews, and support career growth and skills development
• Ensure effective workload planning, prioritization, and resource allocation
• Promote a culture of collaboration, documentation, and architectural discipline

Data Platform & Architecture Design

• Design and oversee end to end data architectures, including ingestion, storage, processing, analytics, and consumption layers
• Define scalable patterns for batch, near real time, and streaming data processing
• Establish standards for data platforms, ingestion frameworks, transformation and modeling approaches, and BI/visualization tools
• Ensure platform reliability, performance, scalability, and cost optimization

Platform Engineering, Security & Governance

• Architect platforms with security by design, including IAM, RBAC, data encryption, masking, and auditing
• Collaborate with security and compliance teams to meet regulatory and data privacy requirements
• Define and enforce data governance standards, including metadata management, lineage, data quality, and observability
• Support platform monitoring, availability, and operational excellence

Advanced Analytics & Innovation

• Enable advanced analytics use cases, including forecasting, predictive modeling, and statistical analysis
• Support data science and analytics teams by designing architectures for ML pipelines, feature stores, and model deployment
• Lead Proof of Concept (PoC) initiatives to evaluate new data, analytics, and platform tools
• Assess emerging technologies for scalability, security, integration, and business value

Self-Service & Data Enablement

• Drive the self-service analytics strategy to empower analysts and business users
• Design curated, governed data layers and semantic models for trusted self-service access
• Reduce dependency on IT by enabling reusable data assets and standardized analytics frameworks
• Partner with stakeholders to align data products with business needs

Experience you'll need:

• Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or related field
• 10 - 15+ years of experience in data engineering, analytics, or platform architecture roles
• Strong experience designing and implementing modern data architectures and cloud data platforms.
• Hands-on and architectural experience with:
  • Snowflake or similar cloud data warehouse/data lake experience
  • Tableau or similar BI tools
  • Fivetran or equivalent ingestion tools
  • dbt or similar data transformation frameworks
• Proficiency in SQL, Python, Spark, and data modeling techniques.
• Experience with cloud platforms such as AWS, Azure, or GCP

Preferred Qualifications:

• Experience with advanced analytics, forecasting, and predictive modeling.
• Knowledge of ML/AI platforms and MLOps concepts.
• Strong understanding of data security, governance, and compliance frameworks.
• Excellent communication and stakeholder management skills.
• Experience working in large-scale or enterprise Data & Analytics environments.

FEQ227R53

As a Senior Solutions Architect, you will shape the future of the Data & AI landscape by working with the most sophisticated data engineering and data science teams in the world. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible data-driven outcomes through the use of our Databricks Lakehouse Platform, helping data teams complete projects and integrate our platform into their enterprise Ecosystem. You'll grow as a leader in your field, while finding solutions to our customers' biggest challenges in big data, analytics, data engineering and data science problems

Reporting to the Field Engineering Manager, you will collaborate with our most strategic prospects and customers, work directly with product and engineering to drive the Databricks roadmap forward, and work with the broader customer-facing team to develop architectures and solutions using our platform. You will guide customers through the competitive landscape, best practices, and implementation, and develop technical champions along the way.

The impact you will have:

• You will partner with the sales team and provide technical leadership to help customers understand how Databricks can help solve their business problems.
• You will work directly with the sales team to develop your book of business, define account strategies, and execute those strategies to help your customers and prospects solve their business problems with Databricks. 
• Consult on Big Data architectures, implement proof of concepts for strategic projects, spanning data engineering, data science and machine learning, and SQL analysis workflows. As well as validating integrations with cloud services, home grown tools, and other 3rd party applications
• Collaborate with your fellow Solutions Architects, using your skills to support each other and our users
• Become an expert in, promote, and recruit contributors for Databricks inspired open-source projects (Spark, Delta Lake, and MLflow) across the developer community.

What we look for:

• 8+ years in a data engineering, data science, technical architecture, or similar pre-sales/consulting role
• 8+ years of experience with Big Data technologies, including Apache Spark™, AI, Data Science, Data Engineering, Hadoop, Cassandra, and others
• Strong consulting / customer facing experience , working with external clients across a variety of industry markets
• Coding experience in Python, R, Java, Apache Spark™ or Scala
• Experience building distributed data systems
• Have built solutions with public cloud providers such as AWS, Azure, or GCP
• Available to travel to customers in your region
• Nice to have: Databricks Certification

GAQ227R131

We're looking for a self-driven Senior Business Analyst to join Databricks' OTR Systems Transformation team. You'll take end-to-end ownership of quality, documentation, and operational health across our Order-to-Revenue (OTR) tech stack — operating with limited direction and building structure from ambiguity from day one. You'll be a partner across Deals Desk, Revenue Assurance, RevOps, Billing, Revenue, FP&A, and Finance leadership — influencing decisions through data-backed analysis and driving cross-functional alignment within the OTR domain.

Databricks is a data-driven company. Every recommendation should be grounded in data, not intuition. We actively embrace AI-assisted ways of working and expect this person to be curious, proactive, and always anticipating the next step.

The impact you will have:

• Own end-to-end UAT lifecycle: planning, test design, execution, defect management, RCA, and audit-ready signoffs
• Coordinate parallel test streams across Business, IT, and Engineering with clear accountability and outcomes
• Translate BRDs/BIDs into user stories and test scenarios; maintain SOX-compliant documentation and traceability
• Lead retrospectives and drive continuous improvement actions
• Define enablement standards (SOPs, training) and evolve toward automated testing frameworks
• Lead senior stakeholder forums and own executive communications on status, risks, and actions
• Build and maintain OTR systems flow documentation; partner with IT/Engineering and leverage AI to keep it current
• Own production health and month-end close readiness; drive RCA and reduce recurring issues
• Lead backlog prioritization and tech debt management using data-driven impact analysis
• Support data migrations and contribute to data quality and metadata standards; expand scope as the function scales

What we look for:

• 6–8+ years in Revenue/Business Ops, Financial Systems, or Consulting with strong OTR (Order-to-Cash) expertise
• Hands-on with Salesforce CPQ and ERP systems (NetSuite/SAP preferred)
• Strong knowledge of ASC 606, revenue recognition, and usage/consumption-based billing
• Deep understanding of OTR system integrations, data flows, and transformation logic
• Proven ownership of full UAT lifecycle in financial/OTR systems
• Strong analytical skills; comfortable using data tools (SQL a plus) and AI for validation and insights
• Experience drafting BRDs/BIDs and building process/system flow documentation; data migration validation is a plus
• Self-driven, thrives in ambiguity, and effectively influences senior stakeholders with data-backed communication
• Leverages AI tools to scale output; maintains high quality standards and mentors junior team members
• Flexible to work IST with overlap into PST as required

Role Overview

We’re looking for a Staff Software Engineer to serve as a technical pillar across our engineering teams. This role is ideal for a highly experienced backend engineer who thrives on solving hard problems, mentoring others, and guiding architecture across multiple domains. You’ll be a multiplier, operating independently, shaping technical direction, and partnering with engineers 
and product teams to raise the bar across the organization. 

You’ll work across squads to improve system performance, reliability, and scalability, while owning high-impact projects that support our Advertising platform. Whether it’s unblocking performance bottlenecks, leading design for new backend services, or reducing tech debt, your contributions will have a far-reaching impact. 

This is a high-impact role where you will not only write mission-critical code but also provide the AI-driven roadmap to help our team automate optimizations and anomaly detection within our data pipelines. 

Core Responsibilities 

• Own and lead design for major backend systems across Ads, focusing on performance, scalability, and reliability. 

• Serve as the subject matter expert for Python & Django. You will optimize application performance, focusing on concurrency, memory management, and efficient integration with our data layer. 

• Architect and optimize large scale data workflows for Ads. You will be expected to tune complex queries in Hive, Flink, or Trino to reduce latency and cost while maintaining data integrity. 

• Actively profile our stack to identify bottlenecks. You should be comfortable moving between high-level architectural planning and low-level query optimization. 

• Guide the engineering team in leveraging AI and Machine Learning for predictive analytics, automated QA of data streams, and enhancing our internal decision-making engines.  

• Collaborate with multiple teams to address cross team concerns (e.g., shared libraries, infra patterns, tech debt, security) 

• Tackle escalated production issues / incidents by providing quick remediations 

• Raise the engineering bar through elite code review, technical RFCs and hands on guidance for senior and mid-level engineers. 

• Work with EMs and PMs to shape technical roadmap and support long-term platform health. 
   

Technical Requirements 

• 10+ years in backend engineering with a proven track record of scaling systems in Ad-Tech, Fintech or High-Scale SaaS. 

• Deep expertise in building high concurrency, asynchronous services. You know how to scale Django beyond standard patterns. 

• Strong experience with distributed systems (e.g. Flink, Spark, Hive or SingleStore). You are an expert at optimizing distributed joins and partitioned datasets. 

• Advanced SQL skills; you can dissect an execution plan and optimize complex analytical queries for both performance and cloud cost. 

• Experience managing “Sync vs Async” data flows and ensuring consistency across disparate data stores 

• Experience with containerization technologies such as Docker and Kubernetes. 

• Familiarity with CI/CD pipelines and modern DevOps practices. 

• Strong communication skills with the ability to explain complex technical concepts to non-technical stakeholders is a must. 

• Proven leadership experience, including mentoring engineers and leading technical initiatives. 
   

Ideal Candidate 

• The Pragmatic Architect: You understand the trade-offs between “perfect” code and “performant” code in a high throughput environment. 

• The Data Integrity Advocate: You care deeply about how data is captured at the source just as much as how it is processed at scale. 

• The Force Multiplier: You don’t just solve problems; you build systems and processes that prevent them from recurring. 

• The Mentor: You thrive on helping others grow and can explain complex architectural concepts to both engineers and stakeholders. 

Why Valtech? We’re the experience innovation company - a trusted partner to the world’s most recognized brands. To our people we offer growth opportunities, a values-driven culture, international careers and the chance to shape the future of experience. 

The opportunity

At Valtech, you’ll find an environment designed for continuous learning, meaningful impact, and professional growth. Whether you're pioneering new digital solutions, challenging conventional thinking or building the next generation of customer experiences, your work will help transform industries. 

We are proud of: 

• The work we do and the innovation we drive 
• Our values of share, care and dare 
• A workplace culture that fosters creativity, diversity and autonomy 
• Our borderless, global framework, which enables seamless collaboration 

The role  

As a Cloud Engineer, you are passionate about experience innovation and eager to push the boundaries of what’s possible. You bring 6+ YEARS of experience, a growth mindset and a drive to make a lasting impact. 

You will thrive in this role if you are: 

• A curious problem solver who challenges the status quo 
• A collaborator who values teamwork and knowledge-sharing 
• Excited by the intersection of technology, creativity and data 
• Experienced in Agile methodologies and consulting (a plus) 

Role responsibilities

• Design GCP-native architectures using services such as BigQuery, Dataflow (Apache Beam), Cloud Composer (Airflow), Pub/Sub, Cloud Storage, Vertex AI, and Cloud Run
• Build and maintain data pipelines — batch and streaming — following medallion architecture patterns (Bronze / Silver / Gold)
• Implement infrastructure as code using Terraform and manage deployments via Cloud Build or equivalent CI/CD tooling
• Define and apply GCP landing zone standards including IAM, VPC, Shared VPC, Private Service Connect, and Org policies
• Develop end-to-end Lakehouse solutions on Databricks — including Delta Lake table design, Unity Catalog governance, and MLflow model tracking
• Write and optimise PySpark and SQL workloads for large-scale transformations and feature engineering
• Configure Databricks clusters, job scheduling, auto-scaling, and cost controls in a GCP (DBX on GCP) environment
• Implement Databricks Workflows and Asset Bundles for orchestration and deployment automation
• Advise clients on Databricks platform adoption, including migration pathways from legacy Hadoop or on-premise data warehouses
• Lead technical workshops and requirements-gathering sessions with client technical and business teams
• Produce high-quality client-facing deliverables: architecture diagrams, technical specifications, migration runbooks, and data dictionaries
• Present solution designs and progress updates to client stakeholders — adapting technical communication to audience level (CTO to Business Analyst)
• Manage technical dependencies, risks, and issues across delivery workstreams — escalating to Delivery Managers as appropriate
• Participate in sprint ceremonies and maintain delivery velocity within Agile/Scrum or Kanban frameworks
• Implement data quality frameworks using tools such as Great Expectations, dbt tests, or Databricks Delta constraints
• Support data catalogue initiatives and metadata management using Dataplex or Unity Catalog
• Ensure GDPR/data residency compliance is embedded into solution design from the outset
• Support practice leads in responding to RFPs and RFIs — contributing to effort estimation, solution sizing, and proposal narrative
• Contribute to internal knowledge-sharing — through documentation, runbooks, and team enablement sessions
• Stay current with GCP and Databricks product roadmaps and proactively identify opportunities to introduce new capabilities to clients

Must have qualifications

• Bachelor's degree in Computer Science, Engineering, Information Systems, or equivalent practical experience
• 6+ years of hands-on professional experience in cloud data engineering or GCP platform roles.
• Google Cloud Professional Data Engineer or Professional Cloud Architect certification
• Databricks Certified Associate Developer for Apache Spark or Databricks Certified Data Engineer certification
• BigQuery — advanced SQL, partitioning, clustering, cost optimization
• Cloud Storage, Cloud Functions, Cloud Run
• Dataflow (Apache Beam) — batch & streaming pipelines
• Cloud Composer / Airflow — DAG authoring and management
• Pub/Sub — event-driven architectures
• Vertex AI — model serving and Pipelines exposure
• IAM, VPC, Org Policies — security and governance
• Cloud Build / Artifact Registry — CI/CD and containerization
• Terraform — infrastructure as code on GCP
• Looker / Looker Studio — reporting layer familiarity
• PySpark — DataFrame API, optimization, broadcast joins
• Delta Lake — ACID transactions, time travel, Z-ordering
• Unity Catalog — governance, lineage, access control
• Databricks Workflows / Job orchestration
• Databricks on GCP — cluster config, instance pools
• MLflow — experiment tracking, model registry
• dbt on Databricks or BigQuery
• Databricks Asset Bundles / CI/CD integration
• Python — data engineering and scripting proficiency
• SQL — advanced analytical queries
• Git / version control — branching, PR workflows
• Docker — containerization basics
• Unit testing and data pipeline testing practices
• REST API integration patterns

Nice to have qualifications  

• Experience with Azure or AWS alongside GCP — hybrid cloud delivery experience
• Familiarity with commercetools, Contentful, or other composable commerce/content platforms
• Exposure to Salesforce Marketing Cloud data connectors or CDPs
• Knowledge of Generative AI / LLM integration patterns — Vertex AI GenAI Studio, Gemini APIs
• Experience with Databricks Agent Framework or LangChain for agentic AI workloads
• Apache Kafka or Confluent Cloud for event streaming architectures
• Google Cloud Professional Machine Learning Engineer
• HashiCorp Terraform Associate.
• Experience in luxury, retail, or FMCG verticals — understanding of product data models and PIM systems

If you do not meet all the listed qualifications or have gaps in your experience, we still encourage you to apply. At Valtech, we recognize that talent comes in many forms, and we value diverse perspectives and a willingness to learn. 

Commitment to reaching all kinds of people 

We design experiences that work for all kinds of people - and that starts with our own teams. At Valtech, we’re intentional about building an inclusive culture where everyone feels supported to grow, thrive and achieve their goals. No matter your background, you belong here. Explore our Diversity & Inclusion site to see how we’re creating a more equitable Valtech for all. 

The benefits  

This is a Full Time position based in Bengaluru

Beyond a competitive compensation package, we offer: 

• Flexibility, with remote and hybrid work options (country-dependent) 
• Career advancement, with international mobility and professional development programs 
• Learning and development, with access to cutting-edge tools, training and industry experts 

Our benefits are tailored to each location. Your Talent Partner will provide full details during the hiring process. 

Your application process

Once you apply, our Talent Acquisition team will review your application. Your CV should cover key information on relevant experiences and expertise. We do not require information such as age, gender, marital status, or a headshot in your application. We review all candidates based on skills, experience, and potential.

⚠️ Beware of recruitment fraud!

We are committed to inclusion and accessibility. If you need reasonable accommodations during the interview process, please either indicate it in your application or let your Talent Partner know. 

About Valtech

Valtech is the experience innovation company that exists to unlock a better way to experience the world. By blending crafts, categories, and cultures, we help brands unlock new value in an increasingly digital world. 

At the intersection of data, AI, creativity, and technology, we drive transformation for leading organizations, including L’Oréal, Mars, Audi, P&G, Volkswagen Dolby, and more. 

At Valtech, we don’t just talk about transformation. We make it happen. Our people are the heart of our success, and we foster a workplace where everyone has the support to thrive, grow and innovate. 

Are you ready to create what’s next? Join us.

DevOps Lead: 

Top consumer brands like Nestle, Kimberly Clark, Natures Bounty, Johnson & Johnson, Mondelez, Kellogg to name a few rely on CommerceIQ suite of products to make efficient business decisions on a daily basis. It is critical to have services which run high quality data and algorithms that drive business decisions for our customers in a timely manner. As a DevOps you are responsible for building scalable, extensible, secure infrastructure on cloud for CommerceIQ’s applications and data science teams. 

In this role, you will work with a couple of Infra/DevOps SDEs and partner with engineering managers to achieve CommerceIQ’s QoQ goals. As a DevOps lead, you will play a crucial role in upkeep security, cost, deployment infrastructure and maintain/develop services owned by Infra/DevOps team.

A successful candidate will be obsessed with technology and relentlessly raise the bar on the architecture, design and quality of code delivered while aggressively pursuing optimizations to meet cost and scale SLAs. The candidate should be capable of managing a fast-paced delivery schedule and influence and drive a high-level engineering strategy with the leadership, as well as take a hands-on approach to implementing that strategy.

Functional level Expectations

• You should possess advanced knowledge of AWS and other software design approaches to guide the DevOps team in designing infrastructure that caters to scale, concurrency. Preferably AWS certified.
• You should be able to work in situations where you can use your prior expertise and judgment to determine goals, identify constraints, and propose an actionable plan. 
• Your work is typically focused on working with multiple teams’ architecture and product solutions. 
• You should be able to lead the design and implementation that are extensible and scalable
• For continuous integration and deployment
• For multi cloud deployments
• For DR of various services with CiQ infrastructure
• You should be able to influence as a “team lead”, management decisions and priorities and actively mentor to create force multipliers
• You should drive teams to adhere to engineering best practices in SDLC like code coverage, acceptance testing, CI/CD and design patterns that ensure consistency and standardization of architecture
• You should proactively simplify code, identify bottlenecks and resolve team architecture deficiencies. 
• You should be able to work along with other SDEs on their team, build relationships with stakeholders including customers, product managers, cross functional partners and external partners and integrate for a cohesive launch. 

Required Skills

• At least 6-10 years of technology experience including 3+ years of working experience in cloud 
• Ideal candidate should have handled operations, deployment and security of multiple SaaS/B2C products
• Deep knowledge of Python, Cloud or GoLang and one of the public clouds
• Good knowledge of log collection designs like EFK and metric collection tools like newrelic, Prometheus/Grafana or SignalFx
• Good knowledge in design, creation and consumption of RESTful API, Micro service architectures on public clouds preferably AWS
• Excellent analytical, communication and coding skills is a must.
• Thorough orientation towards code reviews, coding/design standards and documentation
• Good knowledge in designing with messaging systems such as SQS, Kafka.
• Good knowledge in designing with ETL pipelines using AWS Step, Azkaban, Airflow
• Good knowledge of any big data engine like Spark would be an advantage.

Below is a brief description of the charter for Infra team (subject o product/business deliverables)

Prometheus / Grafana 

K8s metrics and deployment metrics

We use newrelic(NR) for log collection and operational metrics. But certain shortcomings and solved problems in Prometheus/Grafana might force us to move away from NR. Apart from the prometheus track, the lead will have to work with all. stakeholders [apps/DS] to migrate from OCD to K8s, with all balance and checks in place

EFK stack

Log collection and analysis is via newrelic and it’ll cost us as we move more applications to K8s. We need to optimise or explore options like EFK stack of logs or sumo logic etc 

Security audit

We need to be proactive and do frequent security audits of our applications. We need a security center with all our documentation. Place to store the docs/questionnaires we filled for our clients etc. 

BCP 

We need to audit all our services for disaster recovery and develop a BCP across the company.

CI/CD 

The lead is expected to enforce git branching and set code cov, style check guidelines across teams and projects. E.g Publishing the guidelines for Java project, NodeJS project, Python project. Establishing average code cov metrics, running static code analysis, findbug and other security code scanning tools

Infra services

The Infra team also has many services, especially crucial services like BSS (CSS) . These infra services should set the benchmark for DevOps best practices in the org. 

Azkaban

Azkaban is our ETL orchestrator. It's run in-house and has custom code deployed. Maintenance of Azkaban to match growth is needed. Exploration and guidance to use other orchestrators like airflow, step function, astronomer is also expected

AWS admin and access / SF admin and access / AWS/SF cost , unit cost for client

Constant efforts to identify and reduce costs

AWS partnership [case studies, blogs, trainings, tech conf talks]

Cost savings across all our infrastructure.

SOC2 and other compliance 

Automate our soc2 process with diligence. This is more important as we expand to other pillars of soc2 and ISO.

Why Valtech? We’re the experience innovation company - a trusted partner to the world’s most recognized brands. To our people we offer growth opportunities, a values-driven culture, international careers and the chance to shape the future of experience. 

The opportunity

At Valtech, you’ll find an environment designed for continuous learning, meaningful impact, and professional growth. Whether you're pioneering new digital solutions, challenging conventional thinking or building the next generation of customer experiences, your work will help transform industries. 

We are proud of: 

• The work we do and the innovation we drive 
• Our values of share, care and dare 
• A workplace culture that fosters creativity, diversity and autonomy 
• Our borderless, global framework, which enables seamless collaboration