About the team

Roku runs one of the largest data lakes in the world. We store over 70 PB of data, run 10+M queries per month, scan over 100 PB of data per month. 
Big Data team is the one responsible for building, running, and supporting the platform that makes this possible. We provide all the tools needed to acquire, generate, process, monitor, validate and access the data in the lake for both streaming data and batch. We are also responsible for generating the foundational data. The systems we provide include Scribe, Kafka, Hive, Presto, Spark, Flink, Pinot, and others. The team is actively involved in the Open Source, and we are planning to increase our engagement over time. 

About the Role 

Roku is in the process of modernizing its Big Data Platform. We are working on defining the new architecture to improve user experience, minimize the cost and increase efficiency. Are you interested in helping us build this state-of-the-art big data platform? Are you an expert with Big Data Technologies? Have you looked under the hood of these systems? Are you interested in Open Source? If you answered “Yes” to these questions, this role is for you! 

What you will be doing 

• You will be responsible for streamlining and tuning existing Big Data systems and pipelines and building new ones. Making sure the systems run efficiently and with minimal cost is a top priority 
• You will be making changes to the underlying systems and if an opportunity arises, you can contribute your work back into the open source 
• You will also be responsible for supporting internal customers and on-call services for the systems we host. Making sure we provided stable environment and great user experience is another top priority for the team 

We are excited if you have 

• 10+ years of production experience building big data platforms based upon Spark, Trino or equivalent 
• Strong programming expertise in Java, Scala, Kotlin or another JVM language. 
• A robust grasp of distributed systems concepts, algorithms, and data structures 
• Strong familiarity with the Apache Hadoop ecosystem: Spark, Kafka, Hive/Iceberg/Delta Lake, Presto/Trino, Pinot, etc. 
• Experience working with at least 3 of the technologies/tools mentioned here: Big Data / Hadoop, Kafka, Spark, Trino, Flink, Airflow, Druid, Hive, Iceberg, Delta Lake, Pinot, Storm etc 
• Extensive hands-on experience with public cloud AWS or GCP 
• BS/MS degree in CS or equivalent
• AI Literacy /AI growth mindset

About the Team 

The Data Insights team plays a critical role in Roku’s Advertising organization, leading measurement and analytics initiatives that power decision-making across the advertising ecosystem. We develop and manage products that deliver actionable insights for advertisers while meeting the operational and analytical needs of internal teams.We work closely with Product Managers, Data Science, Ad Sales, Ads Operations, and multiple groups within Advertising Engineering to deliver high-impact solutions. Looking ahead, we are exploring AI-driven measurement capabilities to further enhance the effectiveness of advertising campaigns and strengthen internal analytics. 

About the Role 

We are seeking a highly skilled Senior Software Engineer with deep expertise in big data technologies, including Apache Spark and Apache Airflow. This hybrid position bridges software engineering and data engineering, requiring the ability to design, build, and maintain scalable systems for both application development and large-scale data processing.In this role, you will collaborate with cross-functional teams to architect and manage robust, production-grade data products that power critical analytics and measurement capabilities. You will work with technologies such as Apache Spark, Apache Airflow, Trino, Druid, Spring Boot, StarRocks, and Looker to deliver reliable, high-performance solutions.The ideal candidate is a proactive, self-motivated professional with a strong track record in building high-scale data services and a dedication to delivering exceptional results.

What You’ll Be Doing 

Software Development 

• Design and build APIs and backend services using Spring Boot to support data products and analytics workflows. 

• Write clean, maintainable, and efficient code, ensuring adherence to best practices through code reviews. 

Big Data Engineering 

• Design, develop, and maintain data pipelines and ETL workflows using Apache Spark and Apache Airflow. 

• Optimize data storage, retrieval, and processing systems to ensure reliability, scalability, and performance. 

• Develop and fine-tune complex queries and analytics solutions using Druid, Trino, and StarRocks for large-scale datasets. 

• Monitor, troubleshoot, and improve data systems to minimize downtime and maximize efficiency. 

Collaboration & Mentorship 

• Partner with data scientists, software engineers, and other teams to deliver integrated, high-quality solutions. 

• Provide technical guidance and mentorship to junior engineers, promoting best practices in software and data engineering. 

We’re Excited If You Have 

• Bachelor's degree in computer science, Engineering, or a related field (or equivalent experience). 

• 8+ years of experience in software and/or data engineering with expertise in big data technologies such as Apache Spark, Apache Airflow. 

• Expertise with atleast one of the following Apache Druid, StarRocks, and Trino. 

• Strong understanding of SOLID principles and distributed systems architecture. 

• Proven experience in distributed data processing, data warehousing, and real-time data pipelines. 

• Advanced SQL skills, with expertise in query optimization for large datasets. 

• Exceptional problem-solving abilities and the capacity to work independently or collaboratively. 

• Excellent verbal and written communication skills. 

• Experience with cloud platforms such as AWS, GCP, or Azure, and containerization tools like Docker and Kubernetes. (preferred) 

• Familiarity with additional big data technologies, including Hadoop and Kafka.  

• Experience in AdTech, in advertising data platforms and campaign measurement. (preferred)

• Strong programming skills in Python, Java, or Scala. (preferred) 

• Knowledge of CI/CD pipelines, DevOps practices, and infrastructure-as-code tools (e.g., Terraform). (preferred) 

• Expertise in data modeling, schema design, and data visualization tools.

• Experience with building Agentic AI systems to automate decision-making and enhance analytics workflows. (preferred) 

Who We Are

About Stripe

Stripe is a financial infrastructure platform for businesses. Millions of companies - from the world’s largest enterprises to the most ambitious startups - use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career.

About the Team

The Batch Compute Infrastructure team at Stripe manages the foundational infrastructure, tooling, and distributed systems behind Stripe's massive-scale batch processing environments, currently encompassing over 5,000 computational nodes. Powered primarily by Hadoop, Spark, and Celeborn, these systems are the backbone for several core asynchronous financial, analytical, and regulatory workflows at Stripe, operating at petabyte scale.

What you’ll do -
You will support a team of engineers focused on building the tooling, infra and systems for operating Spark, Hadoop and Celeborn at Stripe. In addition to helping define the roadmap for these systems, you will be interacting with many other managers and their teams at Stripe, who rely on the Data processing Infra team to deliver efficient and scalable services to our customers. You will work with both the finance and engineering organization (infrastructure & product) to define, measure and monitor the cost efficiency of these systems. 

Responsibilities

• Drive Strategic Vision: Define the multi-year roadmap for Stripe’s Batch Compute Infrastructure, leading complex architectural shifts and modernization.
• Lead and Scale: Build, mentor, and aggressively scale a high-performing team of engineers, proactively investing in their career development and fostering a culture of operational excellence.
• Ensure Operational Rigor: Maintain unwavering reliability for a Tier-0 infrastructure processing tens of thousands of daily workloads, proactively mitigating risks and managing complex on-call telemetry.
• Cross-Functional Orchestration: Collaborate deeply with data platform teams, finance, and user groups to define compute efficiency metrics, execute massive-scale cost optimization strategies, and guarantee compliance with global financial regulations.
• Technical Stewardship: Provide technical guidance in architecture reviews, evaluating critical cost, performance, and reliability trade-offs in distributed systems design involving Hadoop, Spark, AWS cloud primitives, and modern metastores.

Who You Are

Minimum requirements

• 10+ years of professional software development and engineering experience.
• 3+ years of direct engineering management experience, successfully building and operating high-velocity technical teams.
• Deep technical background in building, scaling, and maintaining large-scale distributed data systems or Tier-0 infrastructure using open-source tools (e.g., Hadoop, Spark, Celeborn, Airflow, Kafka).
• Proven track record of driving significant infrastructure efficiency, managing capacity planning, and making data-driven cost-performance trade-offs.
• Experience working effectively in highly cross-functional, global organizations.

Preferred requirements

• Experience managing remote or geographically distributed engineering teams.
• Familiarity with managing a massive fleet of Linux servers, on-premise Hadoop clusters, and modern cloud data architectures (e.g., AWS S3, Graviton).
• Demonstrated ability to navigate strategic ambiguity and deliver complex, multi-quarter infrastructural projects from inception to completion.
• Deep empathy for internal data users with a passion for building robust developer tooling and abstractions.

Who we are

About Stripe

Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world’s largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career.

About the team

We are experts in data, working to make it cost-effective, understandable, and trustworthy. We build pipelines processing billions of events a day and are stewards of canonical data warehouses and datasets delivering products for Stripe Users while embedding with teams to build their data products.  We are experts in using the Stripe Data Platform and to scale we lead the data culture and data education to enable product teams to own their data. We invest in [AI] Data Ops to scale incident handling and serve as an escalation path for data incidents to minimize their impact. The Data Engineering Solutions team will work closely with product teams delivering trustworthy data / backend code / and innovative (AI) tools/platforms/services for data.

What you’ll do

We're looking for a person who could drive the Data Engineering Solutions Team in solving high-impact, cutting-edge data problems. The ideal candidate will be someone that has built data pipelines for large scale volume, is deeply knowledgeable of Data Engineering tools including Airflow/Spark/Kafka/Flink, is empathetic, excels at building strong relationships, and collaborates effectively with other Stripe teams to understand their use cases and unlock new capabilities.

You will:

• Lead the technical outcomes for a team of ambitious, talented engineers, providing mentorship, guidance, and support to ensure their success.
• Partner with our recruiting team to attract and hire top talent.
• Deliver cutting-edge data pipelines that scale to users' needs, focusing on reliability and efficiency.
• Develop strong subject matter expertise and manage the SLAs of data pipelines and full stack web applications that support critical stakeholders.
• Collaborate with product managers and peers across the company to create/improve canonical datasets and data warehouses, use golden paths, and ensure Stripes and customers are using trustworthy data.
• Leverage AI/LLM and Agents at scale to produce and analyze high-quality data on ambiguous problems
• Have an opportunity to work with Spark, Flink, Kafka, Trino, Pinot, Airflow, Scala, Java, SQL, and Python and many other big data technologies.
• Have the opportunity to drive the execution of key data initiatives for Stripe, overseeing the entire development lifecycle from planning to delivery while maintaining high standards of quality and timely completion.
• Foster a collaborative and inclusive work environment, promoting innovation, knowledge sharing, and continuous improvement within the team.

Who you are

We’re looking for someone who meets the minimum requirements to be considered for the role. If you meet these requirements, you are encouraged to apply. The preferred qualifications are a bonus, not a requirement.

Minimum requirements

We’re looking for someone who has: 

• 10+ Years of engineering experience with 5+ Years of hands-on experience building+operating data systems/pipelines, datasets/data warehouses, infrastructure, and leading small teams to deliver exceptional solutions.
• A strong engineering background and passion for data.
• Prior experience with writing and debugging data pipelines using a distributed data framework (Spark / Hadoop / Trino / etc)
• An inquisitive nature in diving into data inconsistencies to pinpoint issues, and resolve deep rooted data quality issues
• Knowledge of a backend development language (such as Scala, Java, or Go) and strong SQL experience
• Extreme customer focus, with a commitment to partnering with Product Managers, leaders, and other Stripe engineers to understand their use cases.
• Effective cross-functional collaboration, with the ability to think rigorously, communicate clearly, and make or coordinate difficult decisions and trade-offs.
• Thrive with high autonomy and responsibility in an ambiguous environment.
• Ability to foster and work in a healthy, inclusive, challenging, and supportive work environment.

Preferred qualifications

• Expertise in Iceberg, Kafka, Change Data Capture, Flink, Spark, Airflow, Hive Metastore, Pinot, Trino, AWS Cloud, and influencing open-source contributions is a plus.
• Experience creating and maintaining Data Marts / Data Warehouses to power business reporting needs
• Experience working with Product or Go-To-Market (GTM - Sales/Marketing) teams
• Genuine enjoyment of innovation and a deep interest in understanding how things work, with the ability to question and direct architectural decisions.
• Strong written and verbal communication skills for various audiences, including leadership, users, and company-wide.

As a Staff Backend Engineer, you will be a highly technical individual contributor responsible for designing, building, and optimizing the backend systems that power our low-latency ad platform. You will take the lead in developing scalable microservices and streaming data infrastructure to handle high-throughput workloads with minimal latency. This role requires deep expertise in distributed systems and real-time data processing (ideally in the programmatic advertising domain) to ensure our systems remain highly performant and reliable. You’ll work closely with product managers, data scientists, and other engineering teams to translate business needs into technical solutions and ensure the platform is fast, fault-tolerant, and observable. This role is based in the United States and can be performed remotely, with a preference for candidates who can join us in a hybrid capacity in San Francisco, New York, or Atlanta.

Key Responsibilities

• System Architecture & Development: Lead the design and implementation of scalable, high-performance backend services, including microservices and APIs, that can efficiently handle large volumes of requests with low latency. Ensure the architecture accommodates real-time bidding and personalization use cases common in AdTech.
• Streaming Data Infrastructure: Develop and maintain streaming data pipelines and event-driven systems to process and analyze continuous data flows in real time (e.g., using Apache Kafka). Optimize data ingestion and processing for timeliness and accuracy to support downstream analytics and machine-learning models.
• Performance & Reliability: Ensure the backend systems are highly performant, resilient, and stable under heavy load. Implement robust fault-tolerance mechanisms and optimize for low-latency response times in a high-concurrency environment. Leverage observability best practices (comprehensive monitoring, logging, and tracing) to enable engineers to quickly analyze system behavior and take proactive measures to boost performance and reliability.
• Cross-Functional Collaboration: Work closely with cross-functional teams – including Product, Data Science, DevOps, and Frontend – to translate business requirements into scalable technical solutions. Facilitate effective communication and collaborative problem-solving to deliver new features and improvements that align with our product roadmap.
• Technical Leadership & Mentorship: Provide technical leadership within the engineering team without direct managerial duties. Guide and mentor junior engineers through code reviews, design discussions, and best practice adoption, fostering a culture of technical excellence and continuous improvement.
• Technical Strategy & Innovation: Stay abreast of emerging technologies and industry trends (e.g. new AWS services, streaming frameworks, database technologies) and evaluate their potential benefit to our platform. Contribute to the technical roadmap, making build-vs-buy recommendations and driving innovation to keep our systems ahead of the curve.

Required Qualifications:

• 8+ years of software engineering experience building backend systems, with 3+ years in a senior or lead role (e.g. Staff Engineer, Principal Engineer) in the AdTech or a similar high-volume, low-latency domain.
• Proven track record in designing and building high-throughput, low-latency distributed systems that operate at scale (e.g. handling thousands of requests per second or more).
• Expertise in microservices architecture and distributed system design, including experience decomposing monoliths or building greenfield microservices with well-defined APIs.
• Proficiency in Java and Go for backend development, and experience with Python for scripting, automation, or data processing tasks.
• Hands-on experience with streaming data technologies and event-driven frameworks, such as Apache Kafka (or AWS Kinesis), and possibly stream processing frameworks (Spark Streaming, Flink, or similar, experience with Apache Kafka is highly desired).
• Strong experience with cloud platforms (AWS preferred) and deploying services in a cloud-native environment. Familiarity with AWS components like EC2, S3, Lambda, SNS/SQS, etc., and ability to design cost-effective, performant cloud architectures.
• Experience with both SQL and NoSQL databases for high-volume applications. Comfortable with technologies like PostgreSQL/MySQL as well as key-value or wide-column stores (e.g. DynamoDB, Cassandra, Redis) for caching and fast lookups.
• Familiarity with containerization and orchestration tools (Docker, Kubernetes) and CI/CD pipelines to build and deploy microservices reliably.
• Deep understanding of system observability and monitoring – experience instrumenting applications and using monitoring/logging tools to ensure visibility into system performance (e.g. Prometheus, Grafana, ELK stack or similar).
• Excellent problem-solving and communication skills. Ability to communicate complex technical concepts clearly to cross-functional team members and stakeholders. Proven collaboration skills in an agile development environment.

Preferred Qualifications:

• Domain Expertise: Deep knowledge of the programmatic advertising ecosystem, including how Demand-Side Platforms (DSPs), Supply-Side Platforms (SSPs), ad exchanges, and real-time bidding (RTB) work together. Prior experience building or optimizing components of a DSP or ad server is a strong plus.
• High-Scale Data Processing: Experience designing systems that operate at extreme scale, such as real-time auction systems or high-frequency trading platforms, and optimizing algorithms for latency and throughput (e.g. understanding of auction theory or bidding optimization strategies).
• Data Pipelines & Analytics: Familiarity with big data processing and analytics pipelines (Spark, Hadoop, or columnar data stores) for batch and streaming workloads. Experience with data warehousing or real-time analytics databases (e.g. Druid, ClickHouse) is a plus.
• Advanced Performance Tuning: Demonstrated experience in performance profiling and optimization (e.g. JVM tuning, concurrency, GC optimization, network I/O) in large-scale Java or Go applications.
• Leadership in the Tech Community: A track record of contributing to open-source projects, technical publications, or speaking at industry conferences. Keeping on top of emerging trends and sharing knowledge both inside and outside the organization.
• Education: Bachelor’s degree in Computer Science, Engineering, or related field (Master’s or Ph.D. a plus), with strong foundations in algorithms and data structures.

WHO WE ARE 

Zeta Global (NYSE: ZETA) is the AI-Powered Marketing Cloud that leverages advanced artificial intelligence (AI) and trillions of consumer signals to make it easier for marketers to acquire, grow, and retain customers more efficiently. Through the Zeta Marketing Platform (ZMP), our vision is to make sophisticated marketing simple by unifying identity, intelligence, and omnichannel activation into a single platform – powered by one of the industry’s largest proprietary databases and AI. Our enterprise customers across multiple verticals are empowered to personalize experiences with consumers at an individual level across every channel, delivering better results for marketing programs. Zeta was founded in 2007 by David A. Steinberg and John Sculley and is headquartered in New York City with offices around the world. To learn more, go to www.zetaglobal.com.

PEOPLE & CULTURE AT ZETA

Zeta considers applicants for employment without regard to, and does not discriminate on the basis of an individual’s sex, race, color, religion, age, disability, status as a veteran, or national or ethnic origin; nor does Zeta discriminate on the basis of sexual orientation, gender identity or expression.  

We’re committed to building a workplace culture of trust and belonging, so everyone feels invited to bring their whole selves to work. We provide a forum for employees to celebrate, support and advocate for one another. Learn more about our commitment to diversity, equity and inclusion here:  https://zetaglobal.com/blog/a-look-into-zetas-ergs/ 

ZETA IN THE NEWS!

https://zetaglobal.com/press/?cat=press-releases 

As a Staff Backend Engineer, you will be a highly technical individual contributor responsible for designing, building, and optimizing the backend systems that power our low-latency ad platform. You will take the lead in developing scalable microservices and streaming data infrastructure to handle high-throughput workloads with minimal latency. This role requires deep expertise in distributed systems and real-time data processing (ideally in the programmatic advertising domain) to ensure our systems remain highly performant and reliable. You’ll work closely with product managers, data scientists, and other engineering teams to translate business needs into technical solutions and ensure the platform is fast, fault-tolerant, and observable. This role is based in the United States and can be performed remotely, with a preference for candidates who can join us in a hybrid capacity in San Francisco, New York, or Atlanta.

Responsibilities:

• System Architecture & Development: Lead the design and implementation of scalable, high-performance backend services, including microservices and APIs, that can efficiently handle large volumes of requests with low latency. Ensure the architecture accommodates real-time bidding and personalization use cases common in AdTech.
• Streaming Data Infrastructure: Develop and maintain streaming data pipelines and event-driven systems to process and analyze continuous data flows in real time (e.g., using Apache Kafka). Optimize data ingestion and processing for timeliness and accuracy to support downstream analytics and machine-learning models.
• Performance & Reliability: Ensure the backend systems are highly performant, resilient, and stable under heavy load. Implement robust fault-tolerance mechanisms and optimize for low-latency response times in a high-concurrency environment. Leverage observability best practices (comprehensive monitoring, logging, and tracing) to enable engineers to quickly analyze system behavior and take proactive measures to boost performance and reliability.
• Cross-Functional Collaboration: Work closely with cross-functional teams – including Product, Data Science, DevOps, and Frontend – to translate business requirements into scalable technical solutions. Facilitate effective communication and collaborative problem-solving to deliver new features and improvements that align with our product roadmap.
• Technical Leadership & Mentorship: Provide technical leadership within the engineering team without direct managerial duties. Guide and mentor junior engineers through code reviews, design discussions, and best practice adoption, fostering a culture of technical excellence and continuous improvement.
• Technical Strategy & Innovation: Stay abreast of emerging technologies and industry trends (e.g. new AWS services, streaming frameworks, database technologies) and evaluate their potential benefit to our platform. Contribute to the technical roadmap, making build-vs-buy recommendations and driving innovation to keep our systems ahead of the curve.

Required Qualifications:

• 8+ years of software engineering experience building backend systems, with 3+ years in a senior or lead role (e.g. Staff Engineer, Principal Engineer) in the AdTech or a similar high-volume, low-latency domain.
• Proven track record in designing and building high-throughput, low-latency distributed systems that operate at scale (e.g. handling thousands of requests per second or more).
• Expertise in microservices architecture and distributed system design, including experience decomposing monoliths or building greenfield microservices with well-defined APIs.
• Proficiency in Java and Go for backend development, and experience with Python for scripting, automation, or data processing tasks.
• Hands-on experience with streaming data technologies and event-driven frameworks, such as Apache Kafka (or AWS Kinesis), and possibly stream processing frameworks (Spark Streaming, Flink, or similar, experience with Apache Kafka is highly desired).
• Strong experience with cloud platforms (AWS preferred) and deploying services in a cloud-native environment. Familiarity with AWS components like EC2, S3, Lambda, SNS/SQS, etc., and ability to design cost-effective, performant cloud architectures.
• Experience with both SQL and NoSQL databases for high-volume applications. Comfortable with technologies like PostgreSQL/MySQL as well as key-value or wide-column stores (e.g. DynamoDB, Cassandra, Redis) for caching and fast lookups.
• Familiarity with containerization and orchestration tools (Docker, Kubernetes) and CI/CD pipelines to build and deploy microservices reliably.
• Deep understanding of system observability and monitoring – experience instrumenting applications and using monitoring/logging tools to ensure visibility into system performance (e.g. Prometheus, Grafana, ELK stack or similar).
• Excellent problem-solving and communication skills. Ability to communicate complex technical concepts clearly to cross-functional team members and stakeholders. Proven collaboration skills in an agile development environment.

Preferred Qualifications:

• Domain Expertise: Deep knowledge of the programmatic advertising ecosystem, including how Demand-Side Platforms (DSPs), Supply-Side Platforms (SSPs), ad exchanges, and real-time bidding (RTB) work together. Prior experience building or optimizing components of a DSP or ad server is a strong plus.
• High-Scale Data Processing: Experience designing systems that operate at extreme scale, such as real-time auction systems or high-frequency trading platforms, and optimizing algorithms for latency and throughput (e.g. understanding of auction theory or bidding optimization strategies).
• Data Pipelines & Analytics: Familiarity with big data processing and analytics pipelines (Spark, Hadoop, or columnar data stores) for batch and streaming workloads. Experience with data warehousing or real-time analytics databases (e.g. Druid, ClickHouse) is a plus.
• Advanced Performance Tuning: Demonstrated experience in performance profiling and optimization (e.g. JVM tuning, concurrency, GC optimization, network I/O) in large-scale Java or Go applications.
• Leadership in the Tech Community: A track record of contributing to open-source projects, technical publications, or speaking at industry conferences. Keeping on top of emerging trends and sharing knowledge both inside and outside the organization.
• Education: Bachelor’s degree in Computer Science, Engineering, or related field (Master’s or Ph.D. a plus), with strong foundations in algorithms and data structures.

Company Profile:

Zeta Global is a NYSE listed data-powered marketing technology company with a heritage of innovation and industry leadership. Founded in 2007 by entrepreneur David A. Steinberg and John Sculley, former CEO of Apple Inc and Pepsi-Cola, the Company combines the industry’s 3rd largest proprietary data set (2.4B+ identities) with Artificial Intelligence to unlock consumer intent, personalize experiences and help our clients drive business growth.

Our technology runs on the Zeta Marketing Platform, which powers ‘end to end’ marketing programs for some of the world’s leading brands. With expertise encompassing all digital marketing channels – Email, Display, Social, Search and Mobile – Zeta orchestrates acquisition and engagement programs that deliver results that are scalable, repeatable and sustainable.

Zeta Global is an Equal Opportunity/Affirmative Action employer and does not discriminate on the basis of race, gender, ancestry, color, religion, sex, age, marital status, sexual orientation, gender identity, national origin, medical condition, disability, veterans status, or any other basis protected by law.

ZETA IN THE NEWS!

https://zetaglobal.com/press/?cat=press-releases 

CSQ227R231

Mission

The Director of Data & AI Support Engineering - Bangalore will be responsible for leading and growing a regional team of Data & AI technical experts in India, focused on providing resiliency and smooth operation of customer production workloads.  This leader will oversee support operations during APJ and EMEA business hours with close alignment with other global teams to ensure 24x7 support coverage through coordination with other regions.  This team resolves complex and long-running data engineering use cases raised by Databricks customers to support the success of live use cases - which includes performance optimization, ensuring resiliency of production jobs, helping customers stabilize workloads on new products and features, and more.  Reporting to the Global Lead of Frontline Support Engineering - Data & AI - you are able to understand the real-world business problems our customers are solving with data and are committed to helping them achieve reliability and performance of their systems to meet their goals.

The impact you will have:

• Serve as the India site leader for an elite team of Data & AI specialists that can provide coverage of customers across EMEA & APJ business hours.
• Grow the technical expertise of the team to support successful adoption of new products and features of the Databricks platform for customer production workloads.
• Engage with top customers to understand how to support their business needs with their Data & AI strategy, in collaboration with field engineering and sales when required.
• Partner with internal product engineering teams to make Databricks products better and more supportable.
• Understand how to maintain high reliability of the Databricks platform to successfully achieve customer business goals.

Competencies & Requirements

• Proven people leadership experience: at least 6+ years as a manager of managers.
• 18+ years in the IT industry, with a strong background in Software Engineering with specialization in Data Engineering, ideally with Big Data & Cloud experience.
• Experience leading large teams (100+ employees) in engineering, technical support, or consulting.  Support experience is not required - but customer facing experience is highly desirable.
• Hands-on experience in at least two of the following at production scale:
• Big Data (Spark, Hadoop, Kafka)
• Machine Learning / Artificial Intelligence projects
• Data Science / Streaming use cases
• Spark expertise is a big advantage.
• Strong background in customer-facing support leadership roles.
• Excellent troubleshooting skills across distributed systems.
• Strong ownership mindset with ability to thrive in a fast-paced, startup-like environment with evolving needs.
• Bachelor’s/Master’s in Computer Science or equivalent technical field.

Who we are

Metropolis is an artificial intelligence company that uses computer vision technology to enable frictionless, checkout-free experiences in the real world. Today, we are reimagining parking to enable millions of consumers to just "drive in and drive out." We envision a future where people transact in the real world with a speed, ease and convenience that is unparalleled, even online. Tomorrow, we will power checkout-free experiences anywhere you go to make the everyday experiences of living, working and playing remarkable - giving us back our most valuable asset, time.

Who you are

We are looking for a highly motivated and analytical Data Scientist to join our growing data team. You will play a key role in extracting insights from large datasets, building predictive models, and supporting data-driven decision-making across departments.

What you'll do

• Collect, process, and analyze large datasets from multiple sources
• Build and deploy machine learning models to solve business problems
• Design and implement A/B tests and statistical analyses
• Collaborate with cross-functional teams (product, engineering, marketing) to define analytics requirements
• Communicate complex data insights in a clear and actionable manner to stakeholders
• Develop dashboards and visualizations to monitor key metrics
• Stay current with the latest trends and technologies in data science and AI

What we're looking for

• Bachelor’s and or Master’s degree in Computer Science, Mathematics, Statistics, or related field
• 4+ years of proven experience as a Data Scientist or Data Analyst
• Strong knowledge of Python/R and SQL
• Hands-on experience with machine learning frameworks (e.g., scikit learn, tensroflow, pytorch)
• Experience with big data tools (e.g., Spark, Hadoop)
• Familiarity with data visualization tools
• Strong analytical, problem-solving, and communication skills

While not required, these are a plus:

• Experience with cloud platforms preferably AWS (S3, Sagemaker, Airflow etc)
• Strong SQL skills, with experience in Snowflake, MySQL, and PostgreSQL
• Familiarity with data visualization tools (e.g., Tableau, Power BI, Looker)

3 Days in Office: Metropolis values in-person collaboration to drive innovation, strengthen culture, and enhance the Member experience. Our corporate team members hold to our office-first model, which requires employees to be on-site at least four days a week, fostering organic interactions that spark creativity and connection.

When you join Metropolis, you'll join a team of world-class product leaders and engineers, building an ecosystem of technologies at the intersection of parking, mobility, and real estate. Our goal is to build an inclusive culture where everyone has a voice and the best idea wins. You will play a key role in building and maintaining this culture as our organization grows. #LI-SR1 #LI-Onsite

About AQR Capital Management  

AQR is a global investment management firm built at the intersection of financial theory and practical application. We strive to deliver superior, long-term results for our clients by seeking to filter out market noise to identify and isolate what matters most, and by developing ideas that stand up to rigorous testing. Underpinning this philosophy is an unrelenting commitment to excellence in technology — powering our insights and analysis. This unique combination has made us leaders in alternative and traditional strategies since 1998. 

AQR takes a systematic, research-driven approach, applying quantitative tools to process fundamental information and manage risk. Our clients include institutional investors, such as pension funds, insurance companies, endowments, foundations and sovereign wealth funds, as well as financial advisors. 

The Team: 

AQR is building a new Data Engineering team within the Enterprise Engineering organization to focus on solving problems working with big data. This team will work directly with researchers and others across the firm to build and manage the software that loads, validates, and provisions many large data sets used in the research and investment processes. 

Your Role: 

As a data engineering developer, you will participate in designing and building a new enterprise data platform used by quantitative researchers to manage large volumes of market, reference, and alternative data, both structured and unstructured. You will also build critical tools that will be used across the firm to validate data, back-test, and find valuable investment insights. You will be collaborating directly with Researchers and Portfolio Managers to define and implement detailed business requirements for new and existing projects. This critical team will use big data technologies and cloud-based platforms to build an extensible and scalable solution to the data needs of one of the largest quantitative investment firms in the world. 

What You’ll Bring: 

• 6+ Years of relevant work experience 
• Bachelors/Masters/PhD in Computer Science, Engineering, or related discipline 
• Outstanding coding, debugging, and analytical skills; Python required, other languages are a plus 
• Ability to work directly with business stakeholders to spec out and implement solutions 
• Experience working in a distributed data environment and working with large data sets 
• Knowledge of big data frameworks such as Spark and Hadoop 
• An interest in quantitative finance (no finance / trading experience required) 
• Familiarity with one of the large cloud providers is required; AWS experience is a plus 
• Familiarity with AI models and/or frameworks is a plus 

Who You Are: 

• Mature, thoughtful, and a natural fit for our collaborative culture 
• Hard-working and eager to learn in a fast-paced, innovative environment 
• Committed to intellectual integrity, transparency, and openness 
• Motivated by the groundbreaking effects of technology-at-scale 

We believe that the next innovation to transform our business could come from anyone at AQR. Expect to be recognized not only for your diligence and hard work today, but for your vision for tomorrow. We are mathematicians, computer scientists, engineers and artists, passionate about advancing financial research and pushing the limits of today’s technology. 

About AQR Capital Management  

AQR is a global investment management firm built at the intersection of financial theory and practical application. We strive to deliver superior, long-term results for our clients by seeking to filter out market noise to identify and isolate what matters most, and by developing ideas that stand up to rigorous testing. Underpinning this philosophy is an unrelenting commitment to excellence in technology — powering our insights and analysis. This unique combination has made us leaders in alternative and traditional strategies since 1998. 

AQR takes a systematic, research-driven approach, applying quantitative tools to process fundamental information and manage risk. Our clients include institutional investors, such as pension funds, insurance companies, endowments, foundations and sovereign wealth funds, as well as financial advisors. 

The Team: 

AQR is building a new Data Engineering team within the Enterprise Engineering organization to focus on solving problems working with big data. This team will work directly with researchers and others across the firm to build and manage the software that loads, validates, and provisions many large data sets used in the research and investment processes. 

Your Role: 

As a data engineering developer, you will participate in designing and building a new enterprise data platform used by quantitative researchers to manage large volumes of market, reference, and alternative data, both structured and unstructured. You will also build critical tools that will be used across the firm to validate data, back-test, and find valuable investment insights. You will be collaborating directly with Researchers and Portfolio Managers to define and implement detailed business requirements for new and existing projects. This critical team will use big data technologies and cloud-based platforms to build an extensible and scalable solution to the data needs of one of the largest quantitative investment firms in the world. 

What You’ll Bring: 

• 3+ Years of relevant work experience 

• Bachelors/Masters/PhD in Computer Science, Engineering, or related discipline 

• Outstanding coding, debugging, and analytical skills; Python required, other languages are a plus 

• Ability to work directly with business stakeholders to spec out and implement solutions 

• Experience working in a distributed data environment and working with large data sets 

• Knowledge of big data frameworks such as Spark and Hadoop 

• An interest in quantitative finance (no finance / trading experience required) 

• Familiarity with one of the large cloud providers is required; AWS experience is a plus 

• Familiarity with AI models and/or frameworks is a plus 

Who You Are: 

• Mature, thoughtful, and a natural fit for our collaborative culture 

• Hard-working and eager to learn in a fast-paced, innovative environment 

• Committed to intellectual integrity, transparency, and openness 

• Motivated by the groundbreaking effects of technology-at-scale 

We believe that the next innovation to transform our business could come from anyone at AQR. Expect to be recognized not only for your diligence and hard work today, but for your vision for tomorrow. We are mathematicians, computer scientists, engineers and artists, passionate about advancing financial research and pushing the limits of today’s technology. 

About Okta

Okta is an enterprise grade identity management service, built from the ground up in the cloud and delivered with an unwavering focus on customer success. With Okta you can manage access across any application, person, or device. Whether the people are employees, partners, or customers, or the applications are in the cloud, on premises, or on a mobile device, Okta helps you become more secure, make people more productive, and maintain compliance.

The Okta service provides directory services, single sign-on, strong authentication, provisioning, workflow, and built in reporting. It runs in the cloud on a secure, reliable, extensively audited platform and integrates deeply with on premises applications, directories, and identity management systems.

About the Team

The Data Platform team is responsible for the foundational data services, systems, and data products for Okta that benefit our users. Today, the Data Platform team solves challenges and enables:

• Streaming analytics 
• Interactive end-user reporting 
• Data and ML platform for Okta to scale
• Telemetry of our products and data

Our elite team is fast, creative and flexible. We encourage ownership. We expect great things from our engineers and reward them with stimulating new projects, new technologies and the chance to have significant equity in a company. Okta is about to change the cloud computing landscape forever. 

About the Position

This is an opportunity for experienced Software Engineers to join our fast growing Data Platform organization that is passionate about scaling high volume, low-latency, distributed data-platform services & data products. In this role, you will get to work with engineers throughout the organization to build foundational infrastructure that allows Okta to scale for years to come. As a member of the Data Platform team, you will be responsible for designing, building, and deploying the systems that power our data analytics and ML. Our analytics infrastructure stack sits on top of many modern technologies, including Kinesis, Flink, ElasticSearch, and Snowflake. 

We are looking for experienced Software Engineers who can help design and own the building, deploying and optimizing the streaming infrastructure. This project has a directive from engineering leadership to make OKTA a leader in the use of data and machine learning to improve end-user security and to expand that core-competency across the rest of engineering. You will have a sizable impact on the direction, design & implementation of the solutions to these problems.

Job Duties and Responsibilities:

• Design, implement and own data-intensive, high-performance, scalable platform components
• Work with engineering teams, architects and cross functional partners on the development of projects, design, and implementation
• Conduct and participate in design reviews, code reviews, analysis, and performance tuning
• Coach and mentor engineers to help scale up the engineering organization
• Debug production issues across services and multiple levels of the stack 

Required Knowledge, Skills, and Abilities: 

• 8+ years of experience in object-oriented language, preferably Java 
• Hands-on experience using a cloud-based distributed computing technologies including
• Messaging systems such as Kinesis, Kafka 
• Data processing systems like Flink, Spark, Beam
• Storage & Compute systems such as Snowflake, Hadoop
• Coordinators and schedulers like the ones in Kubernetes, Hadoop, Mesos

• Experience in developing and tuning highly scalable distributed systems
• Excellent grasp of software engineering principles
• Solid understanding of multithreading, garbage collection and memory management
• Experience with reliability engineering specifically in areas such as data quality, data observability and incident management

Nice to have

• Maintained security, encryption, identity management, or authentication infrastructure
• Leveraged major public cloud providers to build mission-critical, high volume services
• Hands-on experience in developing Data Integration applications for large scale (petabyte scale) environments with experience in both batch and online systems.
• Contributed to the development of distributed systems or used one or more at high volume or criticality such as Kafka or Hadoop
• Experience developing Kubernetes based services on AWS Stack

#LI-Hybrid

#P24820

FEQ227R53

As a Senior Solutions Architect, you will shape the future of the Data & AI landscape by working with the most sophisticated data engineering and data science teams in the world. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible data-driven outcomes through the use of our Databricks Lakehouse Platform, helping data teams complete projects and integrate our platform into their enterprise Ecosystem. You'll grow as a leader in your field, while finding solutions to our customers' biggest challenges in big data, analytics, data engineering and data science problems

Reporting to the Field Engineering Manager, you will collaborate with our most strategic prospects and customers, work directly with product and engineering to drive the Databricks roadmap forward, and work with the broader customer-facing team to develop architectures and solutions using our platform. You will guide customers through the competitive landscape, best practices, and implementation, and develop technical champions along the way.

The impact you will have:

• You will partner with the sales team and provide technical leadership to help customers understand how Databricks can help solve their business problems.
• You will work directly with the sales team to develop your book of business, define account strategies, and execute those strategies to help your customers and prospects solve their business problems with Databricks. 
• Consult on Big Data architectures, implement proof of concepts for strategic projects, spanning data engineering, data science and machine learning, and SQL analysis workflows. As well as validating integrations with cloud services, home grown tools, and other 3rd party applications
• Collaborate with your fellow Solutions Architects, using your skills to support each other and our users
• Become an expert in, promote, and recruit contributors for Databricks inspired open-source projects (Spark, Delta Lake, and MLflow) across the developer community.

What we look for:

• 8+ years in a data engineering, data science, technical architecture, or similar pre-sales/consulting role
• 8+ years of experience with Big Data technologies, including Apache Spark™, AI, Data Science, Data Engineering, Hadoop, Cassandra, and others
• Strong consulting / customer facing experience , working with external clients across a variety of industry markets
• Coding experience in Python, R, Java, Apache Spark™ or Scala
• Experience building distributed data systems
• Have built solutions with public cloud providers such as AWS, Azure, or GCP
• Available to travel to customers in your region
• Nice to have: Databricks Certification

Why Valtech? We’re the experience innovation company - a trusted partner to the world’s most recognized brands. To our people we offer growth opportunities, a values-driven culture, international careers and the chance to shape the future of experience. 

The opportunity

At Valtech, you’ll find an environment designed for continuous learning, meaningful impact, and professional growth. Whether you're pioneering new digital solutions, challenging conventional thinking or building the next generation of customer experiences, your work will help transform industries. 

We are proud of: 

• The work we do and the innovation we drive 
• Our values of share, care and dare 
• A workplace culture that fosters creativity, diversity and autonomy 
• Our borderless, global framework, which enables seamless collaboration 

The role  

As a Cloud Engineer, you are passionate about experience innovation and eager to push the boundaries of what’s possible. You bring 6+ YEARS of experience, a growth mindset and a drive to make a lasting impact. 

You will thrive in this role if you are: 

• A curious problem solver who challenges the status quo 
• A collaborator who values teamwork and knowledge-sharing 
• Excited by the intersection of technology, creativity and data 
• Experienced in Agile methodologies and consulting (a plus) 

Role responsibilities

• Design GCP-native architectures using services such as BigQuery, Dataflow (Apache Beam), Cloud Composer (Airflow), Pub/Sub, Cloud Storage, Vertex AI, and Cloud Run
• Build and maintain data pipelines — batch and streaming — following medallion architecture patterns (Bronze / Silver / Gold)
• Implement infrastructure as code using Terraform and manage deployments via Cloud Build or equivalent CI/CD tooling
• Define and apply GCP landing zone standards including IAM, VPC, Shared VPC, Private Service Connect, and Org policies
• Develop end-to-end Lakehouse solutions on Databricks — including Delta Lake table design, Unity Catalog governance, and MLflow model tracking
• Write and optimise PySpark and SQL workloads for large-scale transformations and feature engineering
• Configure Databricks clusters, job scheduling, auto-scaling, and cost controls in a GCP (DBX on GCP) environment
• Implement Databricks Workflows and Asset Bundles for orchestration and deployment automation
• Advise clients on Databricks platform adoption, including migration pathways from legacy Hadoop or on-premise data warehouses
• Lead technical workshops and requirements-gathering sessions with client technical and business teams
• Produce high-quality client-facing deliverables: architecture diagrams, technical specifications, migration runbooks, and data dictionaries
• Present solution designs and progress updates to client stakeholders — adapting technical communication to audience level (CTO to Business Analyst)
• Manage technical dependencies, risks, and issues across delivery workstreams — escalating to Delivery Managers as appropriate
• Participate in sprint ceremonies and maintain delivery velocity within Agile/Scrum or Kanban frameworks
• Implement data quality frameworks using tools such as Great Expectations, dbt tests, or Databricks Delta constraints
• Support data catalogue initiatives and metadata management using Dataplex or Unity Catalog
• Ensure GDPR/data residency compliance is embedded into solution design from the outset
• Support practice leads in responding to RFPs and RFIs — contributing to effort estimation, solution sizing, and proposal narrative
• Contribute to internal knowledge-sharing — through documentation, runbooks, and team enablement sessions
• Stay current with GCP and Databricks product roadmaps and proactively identify opportunities to introduce new capabilities to clients

Must have qualifications

• Bachelor's degree in Computer Science, Engineering, Information Systems, or equivalent practical experience
• 6+ years of hands-on professional experience in cloud data engineering or GCP platform roles.
• Google Cloud Professional Data Engineer or Professional Cloud Architect certification
• Databricks Certified Associate Developer for Apache Spark or Databricks Certified Data Engineer certification
• BigQuery — advanced SQL, partitioning, clustering, cost optimization
• Cloud Storage, Cloud Functions, Cloud Run
• Dataflow (Apache Beam) — batch & streaming pipelines
• Cloud Composer / Airflow — DAG authoring and management
• Pub/Sub — event-driven architectures
• Vertex AI — model serving and Pipelines exposure
• IAM, VPC, Org Policies — security and governance
• Cloud Build / Artifact Registry — CI/CD and containerization
• Terraform — infrastructure as code on GCP
• Looker / Looker Studio — reporting layer familiarity
• PySpark — DataFrame API, optimization, broadcast joins
• Delta Lake — ACID transactions, time travel, Z-ordering
• Unity Catalog — governance, lineage, access control
• Databricks Workflows / Job orchestration
• Databricks on GCP — cluster config, instance pools
• MLflow — experiment tracking, model registry
• dbt on Databricks or BigQuery
• Databricks Asset Bundles / CI/CD integration
• Python — data engineering and scripting proficiency
• SQL — advanced analytical queries
• Git / version control — branching, PR workflows
• Docker — containerization basics
• Unit testing and data pipeline testing practices
• REST API integration patterns

Nice to have qualifications  

• Experience with Azure or AWS alongside GCP — hybrid cloud delivery experience
• Familiarity with commercetools, Contentful, or other composable commerce/content platforms
• Exposure to Salesforce Marketing Cloud data connectors or CDPs
• Knowledge of Generative AI / LLM integration patterns — Vertex AI GenAI Studio, Gemini APIs
• Experience with Databricks Agent Framework or LangChain for agentic AI workloads
• Apache Kafka or Confluent Cloud for event streaming architectures
• Google Cloud Professional Machine Learning Engineer
• HashiCorp Terraform Associate.
• Experience in luxury, retail, or FMCG verticals — understanding of product data models and PIM systems

If you do not meet all the listed qualifications or have gaps in your experience, we still encourage you to apply. At Valtech, we recognize that talent comes in many forms, and we value diverse perspectives and a willingness to learn. 

Commitment to reaching all kinds of people 

We design experiences that work for all kinds of people - and that starts with our own teams. At Valtech, we’re intentional about building an inclusive culture where everyone feels supported to grow, thrive and achieve their goals. No matter your background, you belong here. Explore our Diversity & Inclusion site to see how we’re creating a more equitable Valtech for all. 

The benefits  

This is a Full Time position based in Bengaluru

Beyond a competitive compensation package, we offer: 

• Flexibility, with remote and hybrid work options (country-dependent) 
• Career advancement, with international mobility and professional development programs 
• Learning and development, with access to cutting-edge tools, training and industry experts 

Our benefits are tailored to each location. Your Talent Partner will provide full details during the hiring process. 

Your application process

Once you apply, our Talent Acquisition team will review your application. Your CV should cover key information on relevant experiences and expertise. We do not require information such as age, gender, marital status, or a headshot in your application. We review all candidates based on skills, experience, and potential.

⚠️ Beware of recruitment fraud!

We are committed to inclusion and accessibility. If you need reasonable accommodations during the interview process, please either indicate it in your application or let your Talent Partner know. 

About Valtech

Valtech is the experience innovation company that exists to unlock a better way to experience the world. By blending crafts, categories, and cultures, we help brands unlock new value in an increasingly digital world. 

At the intersection of data, AI, creativity, and technology, we drive transformation for leading organizations, including L’Oréal, Mars, Audi, P&G, Volkswagen Dolby, and more. 

At Valtech, we don’t just talk about transformation. We make it happen. Our people are the heart of our success, and we foster a workplace where everyone has the support to thrive, grow and innovate. 

Are you ready to create what’s next? Join us.

Job Overview 

We are looking for a bright and exceptional Engineering Lead to join our Technology team. In this role, you will work closely with Product Managers, Subject Matter Experts, Data Scientists and Software Engineers to design, build, and optimize scalable data pipelines for our Data Platform. The ideal candidate has strong hands-on experience in distributed data processing, expertise in architecting Data Pipelines and operational skills to drive efficiency and speed.

Key Responsibilities:

• Work closely with the product and other teams to understand business requirements and translate them into robust engineering solutions.
• Architect, build and maintain data solutions and pipelines to meet business requirements.
• Engage and lead a team of talented technologists and establishing engineering best practices.
• Act as a point of contact for managing and driving production defects & stability improvements to resolution
• Oversee end-to-end data workflows from ingestion, transformation, and storage to data lake in both batch and streaming environments.
• Drive improvements in performance, reliability, and scalability of data pipelines 

Required Skills & Qualifications:

• A bachelor’s degree in computer science, Math, or other technical fields with 6-8 years of experience, Fintech domain is a plus.
• Demonstrated contribution to end-to-end delivery of enterprise-grade software
• Experience on Data Engineering, Data Lakes, Data Warehousing, Data Pipelines, Data Analytics tools.
• Experience using open-source Big Data technologies such as Spark, Hadoop, Elasticsearch, Kafka.
• Hands-on experience in enterprise application development
• Strong SQL skills and experience working with relational and NoSQL databases.
• Experience in cloud technologies is a plus
• Demonstrates advanced proficiency in Python for building scalable data pipelines, automating workflows
• Experience building scalable ETL/ELT data pipelines and data lakes/warehouses.
• Familiarity with workflow orchestration tools (Airflow, ADF, Glue Workflow, etc.).
• Solid understanding of CI/CD, version control, and DevOps practices.
• Experience working in agile, collaborative environments.
• Attention to detail and quality, and the ability to work well in and across teams
• Ability to advocate & influence multiple stakeholders
• Excellent problem-solving, communication, and leadership skills.
• Experience in leading a team of highly skilled engineers

Arcesium's Personal Data Privacy Notice for Candidates is linked here. 

The Role:

The e.fundamentals Digital Shelf Analytics platform gathers almost 4 million web pages per day from around 500 retailers worldwide. Gathering data on such a massive scale demands specialised tools for scheduling and reviewing thousands of individual tasks.

The Scheduling team is responsible for devising, building and supporting these tools. The team creates applications and services that enable our internal users to manage tasks safely and efficiently at scale. We’re looking for an experienced senior Software Engineer to lead the team as we develop a brand new iteration of our scheduling system to meet the demands of our rapidly growing customer-base.

What You'll Do:

• You will be responsible for the design, coding, documenting, and maintaining high-end computation platform development.
• You will own the architecture and design of some of the most advanced & complex software systems/products in the industry to create a company-wide impact
• You will be involved in continuously upgrading and building new technology skills and methodologies.
• You will be responsible for innovating, researching, proposing, and discussing the design with your peers.
• You must have the ability to take ownership of Modules delivery and lead a team.
• You will be a key member of the hiring panel across CIQ.
• You will be the gatekeeper of the tech decisions of the team and contribute heavily to the tech strategy, working closely with product and design teams.

• 5+ Years in developing in designing and developing complex and scalable software modules.
• The ideal candidate will be an experienced Java developer with exceptional software system design, problem-solving, and object-oriented coding skills.
• Good hands-on experience in data engineering - ETL pipelines, batch, and streaming data processing (Hadoop, Spark, Storm, Kafka, presto, etc), data analytics & reporting - prior experience with optimizing for storage space, compute time, etc
• Strong expertise in concurrency constructs and debugging memory leaks, expert-level skills in object-oriented, low-level class/interface designs.
• Hands-on experience with building high-performance, highly available, and scalable distributed systems, scaling and evolving them.
• Hands-on experience with one of the key cloud providers (AWS, GCP, Azure) for the creation and scaling of large-scale distributed systems (compute, messaging, notifications, caching, data stores, monitoring, CI/CD, etc).
• Exposure to multiple kinds of data storage and retrieval strategies - Relational, Non-relational, Document, Graph, Object, Time Series databases.
• BS or MS in Computer Science/Engineering, Mathematics, Statistics, or a similar degree will be considered

As a DataOps Lead, you will be responsible for managing, design highly-scalable and Available solution for data pipelines that provides the foundation for collecting, storing, modelling, and analyzing massive data sets from multiple channels.

This position reports to DevOps Architect.

Responsibilities:

• Align Sigmoid with key Client initiatives
• Interface daily with customers across leading Fortune 500 companies to understand strategic requirements
• Connect with VP and Director level clients on a regular
• Travel to client locations
• Ability to understand business requirements and tie them to technologysolutions

• Strategically support Technical Initiatives
• Design, manage & deploy highly scalable and fault-tolerant distributed components using Big data
• Ability to evaluate and choose technology stacks that best fit client data strategy and constraints

• Drive Automation and massive deployments
• Ability to drive good engineering practices from bottom up
• Develop industry leading CI/CD, monitoring and support practices inside the team
• Develop scripts to automate devops processes to reduce team effort
• Work with the team to develop automation and resolve issue
• Support TB scale pipelines
• Perform root cause analysis for production errors
• Support developers in day to day devops operations
• Excellent experience in Application support, integration development and data
• Design roster and escalation matrix for team
  
  
• Provide technical leadership and manage it day to day basis
• Guiding devops in day to day design, automation b support tasks
• Play a key role in hiring technical talents to build the future of
• Conduct training for technology stack for developers in house and outside
  
  
• Culture
• Must be a strategic thinker with the ability to think unconventional / out:of:box.
• Analytical and data driven
• Raw intellect, talent and energy are
• Entrepreneurial and Agile : understands the demands of a private, high growth
• Ability to be both a leader and hands on "doer".

Qualifications: - 8 - 12 years track record of relevant work experience and a computer Science or a related technical discipline is required

• Proven track record of building and shipping large-scale engineering products and/or knowledge of cloud infrastructure such as GCP/AWS preferred
• Experience in Shell, Python or any scripting language
• Experience in managing linux systems, build and release tools like jenkins
• Effective communication skills (both written and verbal)
• Ability to collaborate with a diverse set of engineers, data scientists and product managers
• Comfort in a fast-paced start-up environment

Preferred Qualification:

• Support experience in Big Data domain
• Architecting, implementing and maintaining Big Data solutions
• Experience with Hadoop ecosystem (HDFS, MapReduce, Oozie, Hive, lmpala, Spark,
• Kerberos, KAFKA, etc)
• Experience in container technologies like Docker, Kubernetes Et configuration management systems

SLSQ127R200

As a Partner Solutions Architect (PSA) for India, you will work with the technical and sales team members who work directly with our customers. You will develop 'technical champions' within our top Partners, providing enablement on technical matters related to the Databricks product. Working with our partners, you will help our customers to achieve tangible data-driven outcomes through the use of our Databricks Lakehouse Platform, helping data teams complete projects and integrate our platform into their enterprise Ecosystem. As a member of our team, you will exercise and develop expertise in those areas, using open-source projects such as Apache Spark™, MLflow, and Delta Lake; and major public cloud infrastructure and services. the product. You will use this expertise to become a trusted advisor to C&SI partners.

The impact you will have:

• Provide partners with the level of enablement they need to assist their clients in evaluating and adopting Databricks including hands-on Apache Spark™ programming and integration with the wider cloud ecosystem
• Engage with the partner technical community by leading workshops, seminars, and meet-ups
• You will be a Big Data Analytics expert on aspects of architecture and design and will share this with our partner network
• Show expertise by producing creative technical solutions and blog posts

What we look for:

• 8 years of customer facing experience working with external clients or partners across a variety of industry markets
• Core strength in either data engineering or data science
• Experience demonstrating technical concepts, including presenting and whiteboarding
• Experience developing architectures within a public cloud (AWS, Azure, or GCP)
• Hands on experience in SQL, Python, Scala, or Java
• Expertise in at least one of the following:
• Data Engineering technologies (Ex: Apache Spark™, Hadoop, Kafka)
• Data Warehousing (Ex: SQL, OLTP/OLAP/DSS)
• Data Science and Machine Learning technologies (Ex: pandas, scikit-learn, HPO)

FEQ227R52

As a Solutions Architect (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible data-driven outcomes through the use of our Databricks Lakehouse Platform, helping data teams complete projects and integrate our platform into their enterprise Ecosystem. You'll grow as a leader in your field, while finding solutions to our customers' biggest challenges in big data, analytics, data engineering and data science problems.

The impact you will have:

• You will be a Big Data Analytics expert on aspects of architecture and design
• Lead your clients through evaluating and adopting Databricks including hands-on Apache Spark™ programming and integration with the wider cloud ecosystem
• Support your customers by authoring reference architectures, how-tos, and demo applications
• Integrate Databricks with 3rd-party applications to support customer architectures
• Engage with the technical community by leading workshops, seminars and meet-ups
• Together with your Account Executive, you will form successful relationships with clients throughout your assigned territory to provide technical and business value

What we look for:

• Strong consulting / customer facing experience , working with external clients across a variety of industry markets
• Core strength in either data engineering or data science technologies
• 8+ years of experience demonstrating technical concepts, including demos, presenting and white-boarding
• 8+ years of experience designing architectures within a public cloud (AWS, Azure or GCP)
• 6+ years of experience with Big Data technologies, including Apache Spark™, AI, Data Science, Data Engineering, Hadoop, Cassandra, and others
• Coding experience in Python, R, Java, Apache Spark™ or Scala

Overview of Role

We are seeking a highly skilled Cloud Data Engineer to join our Managed Services team. In this role, you will be the technical backbone for our enterprise clients, responsible for designing, building, and maintaining high-performance data platforms using Snowflake and Azure Databricks. You will act as a trusted advisor, ensuring that our customers' data ecosystems are scalable, secure, and cost-optimized across multi-cloud environments.

Key Responsibilities

• Platform Engineering: Design and implement end-to-end data lakehouse architectures using Azure Databricks (Delta Lake),Azure HDInsights and Snowflake Cloud Data Warehouse.
• Pipeline Development: Build scalable, metadata-driven ETL/ELT pipelines using Azure Data Factory (ADF), PySpark, and SnowSQL, including ingestion workflows from HDInsight-managed Hadoop and Kafka clusters.
• Managed Services Support: Provide Tier-3 technical support for client environments, including performance tuning, complex bug fixes, and architectural optimizations.
• Multi-Cloud Integration: Oversee data movement and integration strategies across Azure, AWS, and GCP to ensure seamless "Data Everywhere" capabilities for clients.
• Cost & Performance Governance: Monitor and optimize Snowflake credit consumption and Databricks cluster usage to ensure clients receive maximum ROI.
• Security & Compliance: Implement enterprise-grade security including Role-Based Access Control (RBAC), Row-Level Security (RLS), and data masking (Dynamic Data Masking in Snowflake / Unity Catalog in Databricks).

Required Technical Skillset

Experience & Qualifications

• Experience: 5+ years in Data Engineering, with at least 3 years of hands-on experience in both Snowflake and Databricks.
• Managed Services Background: Proven experience supporting external customers with strict SLAs and complex governance requirements.
• Multi-Cloud (Plus): Direct experience deploying Snowflake or Databricks on AWS or GCP is highly desirable.
• Certifications (Preferred): * SnowPro Core or Advanced Architect
• Databricks Certified Data Engineer Professional
• Microsoft Certified: Azure Data Engineer Associate (DP-203)

ABOUT THE ROLE

You are a seasoned Data Scientist, passionate about building robust, real-time machine learning solutions to combat financial crime. Working within the Risk & Fraud Team, you will leverage advanced statistical modeling and machine learning to detect, prevent, and adapt to evolving fraud threats. You thrive on solving complex problems with highly imbalanced data and delivering tangible risk reduction impact in a fast-paced environment.

You strongly believe in agile principles and use them to deliver value incrementally. You are eager to learn about new methodologies and practices and apply them directly in your work.

As a Senior Data Scientist you’ll be:

• Model Development & Risk Mitigation: Design, develop, and implement advanced ML/Statistical models to predict and prevent various fraud typologies. Focus on driving impact by optimising costs and reducing risk using ML/Stats models.
• Specialised Data Handling: Employ advanced techniques to manage and model highly imbalanced, large datasets characteristic of the fraud domain.
• Adaptive Systems: Build and maintain models that can quickly adapt to new and evolving fraud typologies and emerging threats.
• Real-Time MLOps: Develop, optimise, and deploy ML models for real-time/low-latency inference in production settings.
• Data & Feature Engineering: Utilize, enrich, and contribute to the feature store ecosystem, ensuring high-quality, scalable features for risk models.
• Performance Monitoring: Implement and maintain robust drift monitoring and model performance tracking to ensure deployed models remain effective and stable.
• Collaboration: Work closely with ML Engineers to productionize models leveraging AWS/GCP tech stack, and collaborate with Business and Product teams to understand requirements and solutionise data products.
• Exploration: Identify creative solutions in order to build relevant training data sets and explore the value of new data structures like knowledge graphs for relational fraud detection.

WHAT ARE WE LOOKING FOR

• You have 6+ years of experience in Software Development or Machine Learning, with a strong emphasis on practical model development and deployment.
• You are Strong in Python and have expert knowledge with Machine Learning tools/libraries (e.g., scikit-learn, statmodels, TensorFlow, Keras, or PyTorch).
• You have experience with big-data technologies such as Spark, SparkML, Hadoop etc. and have handled large data in a distributed processing environment. AWS, GCP, or Azure (anyone) cloud knowledge is preferred.
• You are proficient in ML training, optimising, feature selection and engineering, hyperparameter tuning and have knowledge about trade-offs in using different algorithms.
• You have demonstrated experience in developing and deploying a variety of ML-algorithms (e.g., logistic regressions, boosted trees, neural networks) that work in real-time settings.
• You have a good working knowledge with basic data table operations (SQL etc.), and data transform in the warehouse (dbt etc.).
• You are comfortable with ambiguity and are a self-starter—you take initiative in spotting opportunities and finding ways to solve challenges with data.
• Familiarity with Financial Services and Fintech space is preferred.
• You will be helping optimise all aspects of our sales funnel including finding ways to increase lead quality, reduce our cost of acquisition, optimise lead allocation, and improve the likelihood of successful lending outcomes for our members

Highly Desirable Skills:

• Exposure to Cost-Sensitive Learning techniques, where the economic impact of prediction errors is a key optimization factor.
• A decent idea and practical exposure to MLOps principles (e.g., model versioning, continuous integration/deployment for ML).
• Experience with Drift monitoring tools and frameworks.
• Exposure to Knowledge Graphs or graph database applications.

• Competitive Compensation -  competitive salary and share options
• Time Off – Generous annual leave on top of bank holidays.
• Parental Leave – Paid maternity, paternity, and adoption leave to support your family journey.
• Sabbatical – Extended unpaid and paid leave options after completing milestone years with Tide.
• Health Insurance – Private family insurance with additional OPD coverage and top-up options.
• Life & Accident Cover – Comprehensive accidental and life insurance protection.
• Mental Wellbeing – Access to therapy sessions, courses, meditations, and workshops.
• Volunteering & Development Days – Paid days annually for volunteering or personal growth.
• Learning & Development – Annual budget for books, courses, coaching, and more.
• WOO (Work Outside the Office) – Work from abroad for up to 90 days annually.
• Home Office Setup – Contribution towards setting up your home office
• Laptop Ownership – Keep your old laptop and get a new one when it’s time for a replacement.
• Snacks & Meals – Office perks with snacks, coffee, tea, and lunch (location dependent).

TIDEAN WAYS OF WORKING

At Tide, we champion a flexible workplace model that supports both in-person and remote work to cater to the specific needs of our different teams. 

While remote work is supported, we believe in the power of face-to-face interactions to foster team spirit and collaboration. Our offices are designed as hubs for innovation and team-building, where we encourage regular in-person gatherings to foster a strong sense of community.

Hadoop Admin
Location:  Bangalore 

Experience - 9-12 yrs

About Us 

“Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. 

WHY JOIN CAPCO?

You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.

MAKE AN IMPACT

Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.

#BEYOURSELFATWORK

Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.

CAREER ADVANCEMENT

With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.

DIVERSITY & INCLUSION

We believe that diversity of people and perspective gives us a competitive advantage.

MAKE AN IMPACT

Hadoop Admin
Location:  Bangalore 

Experience - 5-8 yrs 

Job Title: Senior Data Engineer - Scala

Job Description:

The Senior Data Engineer will be responsible for designing, developing, and maintaining scalable data pipelines and building out new API integrations to support continuing increases in data volume and complexity. They will collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.

Responsibilities:

• Design, construct, install, test and maintain highly scalable data management systems & Data Pipeline.
• Ensure systems meet business requirements and industry practices.
• Build high-performance algorithms, prototypes, predictive models, and proof of concepts.
• Research opportunities for data acquisition and new uses for existing data.
• Develop data set processes for data modeling, mining and production.
• Integrate new data management technologies and software engineering tools into existing structures.
• Create custom software components and analytics applications.
• Install and update disaster recovery procedures.
• Collaborate with data architects, modelers, and IT team members on project goals.
• Provide senior level technical consulting to peer data engineers during data application design and development for highly complex and critical data projects.

Qualifications:

• Bachelor's degree in computer science, Engineering, or related field, or equivalent work experience.
• Proven 5-8 years of experience as a Senior Data Engineer or similar role.
• Experience with big data tools: Python, Hadoop, Spark, Pyspark & Scala
• Expert level SQL skills for data manipulation (DML) and validation (DB2).
• Experience with data pipeline and workflow management tools.
• Experience with object-oriented/object function scripting languages: Python, Java, Go lang etc.
• Strong problem solving and analytical skills.
• Excellent verbal communication skills.
• Good interpersonal skills.
• Ability to provide technical leadership for the team.

Mission

Databricks helps data teams solve the world’s toughest problems. As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition Databricks is venture-backed and founded by the original creators of popular open source projects: Apache Spark™, Delta Lake and MLflow.

As a Staff Backline Engineer you will help our customers to be successful with the Databricks Data Intelligence platform by resolving important technical customer escalations and the support team. You will be the technical bridge between support and engineering and the first line of defense for engineering. You will ensure that all issues are vetted by you before it reaches the engineering team. You will report to the Senior Backline Manager of the Backline Escalations Team.

Outcomes

• Troubleshoot, resolve and suggest deep code-level analysis of Spark to address complex customer issues related to Apache Spark™ core internals, Spark SQL, Structured Streaming and Databricks Delta.
• Provide best practices guidance around Spark runtime performance and usage of Spark core libraries and APIs for custom-built solutions developed by Databricks customers.
• Help the support team with detailed troubleshooting guides and runbooks.
• Contribute to automation and tooling programs to make daily troubleshooting efficient.
• Work with the Spark Engineering Team and spread awareness of upcoming features and releases.
• Identify Spark bugs and suggest possible workarounds.
• Demonstrate ownership and coordinate with engineering and escalation teams to achieve resolution of customer issues and requests
• Participate in weekend and weekday on call rotation.

Competencies

• 12+ years of industry experience developing, testing, and sustaining Python or Java or Scala-based applications.
• Comfortable with compiling, building and navigating the Apache Spark source code.
• Comfortable with identifying and applying patches/bug fixes to the Apache Spark source code.
• Experience in Big Data/Hadoop/Spark/Kafka/Elasticsearch data pipelines.
• Hands-on experience with SQL-based database systems.
• Experience in JVM, GC, Thread dump-based troubleshooting is required.
• Experience with AWS or Azure related services.
• Bachelor's degree in Computer Science or a related field is required.

Why Join Us?

• Innovative Environment: Work with cutting-edge technology in a fast-paced, innovative company.
• Career Growth: Opportunities for professional development and career advancement.
• Team Culture: Collaborate with a talented and motivated team dedicated to excellence and continuous improvement.

Mission

Databricks helps data teams solve the world’s toughest problems. As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition Databricks is venture-backed and founded by the original creators of popular open source projects: Apache Spark™, Delta Lake and MLflow.

As a Sr Backline Engineer you will help our customers to be successful with the Databricks Data Intelligence platform by resolving important technical customer escalations and the support team. You will be the technical bridge between support and engineering and the first line of defense for engineering. You will ensure that all issues are vetted by you before it reaches the engineering team. You will report to the Senior Backline Manager of the Backline Escalations Team.

Outcomes

• Troubleshoot, resolve and suggest deep code-level analysis of Spark to address complex customer issues related to Apache Spark™ core internals, Spark SQL, Structured Streaming and Databricks Delta.
• Provide best practices guidance around Spark runtime performance and usage of Spark core libraries and APIs for custom-built solutions developed by Databricks customers.
• Help the support team with detailed troubleshooting guides and runbooks.
• Contribute to automation and tooling programs to make daily troubleshooting efficient.
• Work with the Spark Engineering Team and spread awareness of upcoming features and releases.
• Identify Spark bugs and suggest possible workarounds.
• Demonstrate ownership and coordinate with engineering and escalation teams to achieve resolution of customer issues and requests
• Participate in weekend and weekday on call rotation.

Competencies

• 8+ years of industry experience developing, testing, and sustaining Python or Java or Scala-based applications.
• Comfortable with compiling, building and navigating the Apache Spark source code.
• Comfortable with identifying and applying patches/bug fixes to the Apache Spark source code.
• Experience in Big Data/Hadoop/Spark/Kafka/Elasticsearch data pipelines.
• Hands-on experience with SQL-based database systems.
• Experience in JVM, GC, Thread dump-based troubleshooting is required.
• Experience with AWS or Azure related services.
• Bachelor's degree in Computer Science or a related field is required.

As a Senior Data Engineer, you will design, build, and manage components of our highly available real-time and batch data pipelines handling petabytes of data. Our pipeline platform is designed to ingest and process billions of events per day, and make the resulting aggregations and insights available within minutes in our analytical data stores. Data Analytics is at the core of our business, and we’re constantly innovating to make our systems more performant, timely, cost-effective, and capable while maintaining high reliability. You will build on top of our core data infrastructure and pipelines using technologies and tools tailored for massive data sets including Flink, Spark, Kafka, Iceberg and Druid while working in the AWS cloud environment.  

If you are interested in building systems that can consume and explore billions of data points a day, work with petabytes of data, and want to push what is possible with data, this is the place for you!

As a Senior Data Engineer, you’ll get to:

• Architect, build, and own real-time and batch data aggregation systems to deliver quality analytical reports for our internal and external customers.
• Collaborate with Data Scientists, Backend Engineers, Data & Infrastructure Operations, and Products Managers to deliver new features and capabilities for customers.
• Develop clean, safe, testable, and cost-efficient solutions.
• Make well-informed decisions with deep knowledge of both the internal and external impacts on teams and projects. Foresee shortcomings ahead of time and be able to drive to resolution.

You’ll be a good fit if you have:

• Bachelors in CS or equivalent.
• 6+ years of Software Engineering or Data Engineering experience with a recent focus on big data. 
• Strong development skills in Java or Scala and Python.
• Solid background in the fundamentals of computer science, distributed systems, large scale data processing as well as database schema design and data warehousing.
• Practical experience managing AWS or Google Cloud environments.
• Experience in containerized deployment or Kubernetes is a big plus!
• Good understanding of a broad spectrum of NoSQL, traditional RDBMS, and analytical/columnar data stores including Postgres, Druid, Vertica, Redshift, Hadoop, Hive, Cassandra, Aerospike, and Redis.
• Ability to build systems that balance scalability, availability, and latency.
• Strong ability to advocate for the continual deployment and automation tools, monitoring, and self-healing systems that can help improve the lives of our engineers.
• Great communication skills and you are a team player who has a proven track record of building strong relationships with management, co-workers, and customers.
• A desire to learn and grow, push yourself and your team, share lessons with others and provide constructive and continuous feedback, and be receptive to feedback from.

This role will be based at our Bengaluru, KA office and follows a Hybrid schedule that will be aligned with our Return to Office guidelines. 

We are seeking an experienced and highly skilled Senior Data Scientist to lead our efforts in optimizing ad display on native Android surfaces. In this role, you will design and implement data-driven strategies to maximize ad effectiveness, user engagement, and revenue. You will collaborate closely with product managers, engineers, and cross-functional teams to drive innovation, improve ad relevance, and ensure a seamless user experience.

As a Senior Data Scientist, you’ll get to:

• Develop and refine data-driven ad optimization strategies tailored to native Android environments, focusing on user engagement, personalization, and revenue uplift.
• Design, implement, and improve predictive models for ad targeting, recommendation, and bidding strategies using cutting-edge machine learning and statistical techniques.
• Lead the design and analysis of experiments to test ad placements, formats, and targeting methods. Use data from A/B tests and multivariate testing to validate hypotheses and inform decisions.
• Analyze user behavior patterns to understand engagement and dropout points, leveraging insights to optimize ad positioning, timing, and relevance.
• Partner with product managers, engineers, designers, and marketing teams to align ad strategies with business objectives and user experience goals. Communicate insights and recommendations effectively to both technical and non-technical stakeholders.
• Ensure the scalability of ad models across a wide range of Android devices and varying network conditions. Work closely with engineering teams to deploy and monitor models in a production environment.
• Provide mentorship and guidance to junior data scientists, fostering a collaborative and innovative team environment. Lead by example in developing high-quality, scalable solutions for complex ad optimization challenges.

You’ll be a good fit if you have:

• PhD (preferred) or Master's Degree (required) in Computer Science, Data Science, Statistics, Machine Learning, or a related field.
• 6+ years of experience in data science or machine learning, with a strong focus on ad technology or user experience optimization.
• Demonstrable experience in working with ad serving, ad tech stacks, and optimization techniques, especially within Android or mobile ecosystems.
• Expertise in machine learning frameworks (TensorFlow, PyTorch, or similar).
• Advanced proficiency in Python, or Kotlin.
• Experience with data processing and pipeline tools (e.g., Spark, Hadoop, Airflow).
• Deep understanding of A/B testing, causal inference, and other experimentation methods.
• Familiarity with ad tech, programmatic advertising, and user behavior metrics, particularly in the context of mobile and Android platforms.
• Excellent analytical, problem-solving, and communication skills. Proven ability to articulate complex data science concepts to stakeholders across different domains.

 Nice to have: 

• Previous experience optimizing ad displays on native mobile or Android surfaces.
• Familiarity with the Android SDK and understanding of native Android UI/UX design principles.
• Knowledge of reinforcement learning, multi-armed bandit models, and contextual targeting techniques.

This role is based at our Bengaluru, India office and follows a Hybrid schedule that will be aligned with our Return to Office guidelines.

Role Summary

We are building a next-generation Core Infrastructure platform focused on:

• Zero-trust security and identity-based access
• Multi-region and multi-account scalability (multi cloud in future)
• Highly automated, self-service infrastructure
• Reliable and observable systems at scale

This role will own foundational infrastructure systems—networking, identity, compute platforms, and automation frameworks—that power all services.

Core Areas of Ownership

[1] Core Infrastructure & Cloud Platform

• Design and evolve infrastructure on:
• Amazon Web Services
• Kubernetes
• Build and scale:
• Multi-region and multi-account architectures
• Secure and scalable service connectivity (VPC, cross-account, cross-region)

[2] Security & Zero Trust

• Drive adoption of:
• Identity-based access (eliminate shared credentials)
• Implement:
• Secrets management using HashiCorp Vault
• Policy enforcement using Open Policy Agent
• Design:
• Secure service-to-service communication
• Fine-grained IAM and access control systems

[3] Infrastructure as Code & Automation

• Build infrastructure using:
• Terraform
• Pulumi
• Ansible
• Create:
• Reusable modules and abstractions
• Fully automated provisioning workflows
• Integrate with CI/CD:
• GitHub Actions
• Jenkins

[4] Cluster & Infrastructure Lifecycle

• Own lifecycle of:
• Kubernetes clusters (e.g., EKS)
• Databases (eg, rds/aurora/elastic cache. etc)
• Automate:
• Cluster upgrades and migrations
• Node scaling and patching

[5] Multi-Region & Migration Engineering

• Design:
• Region-agnostic infrastructure patterns
• Enable:
• Automated regions bootstrap and failover
• Lead:
• Migration initiatives (region, account, or cloud)

[6] Observability & Reliability

• Build and operate:
• Metrics, logging, and tracing systems using:
• Prometheus
• Grafana
• ELK stack
• Datadog
• Improve:
• System reliability, alerting, and incident response

[7 ] Governance & Standards

• Define and enforce:
• Resource tagging strategies
• Data classification policies
• Ensure:
• Cost visibility and auditability

[8] Developer Productivity & Platform

• Build:
• Self-service infrastructure workflows
• Improve:
• Developer experience through automation and tooling
• Contribute to:
• Internal platform evolution

Responsibilities

• Architect, build, and scale core infrastructure systems
• Automate infrastructure lifecycle to minimize human intervention
• Design secure connectivity across services, VPCs, accounts, and regions
• Debug and resolve complex production issues across the stack
• Write production-quality code, tools, and frameworks
• Collaborate with engineering teams to standardize infrastructure usage

Minimum Qualifications

• 10+ years in a Software Engineering role or equivalent experience
• 5+ years of experience in infrastructure engineering
• Strong hands-on experience with:
• Amazon Web Services
• Kubernetes
• Terraform or Pulumi
• Strong understanding of:
• Networking (VPC, routing, DNS, connectivity)
• IAM and access control
• Experience with:
• Automating infrastructure workflows
• High-availability and scalable systems
• Proficiency in:
• Python / Go / Bash

Preferred Qualifications

• Experience with:
• Multi-region or multi-account architectures
• Automating infrastructure migrations and upgrades (e.g., EKS upgrades)
• Secrets management platforms (e.g., HashiCorp Vault)
• Familiarity with:
• Policy-as-code (e.g., Open Policy Agent)
• Observability systems (Prometheus, Grafana, datadog)
• Exposure to:
• Data infrastructure (Hadoop, Trino, Spark)
• Service mesh (e.g., Istio)

Sigmoid empowers enterprises to make smarter, data-driven decisions by blending advanced data engineering with AI consulting. We collaborate with some of the world’s leading data-rich organizations across sectors such as CPG-retail, BFSI, life sciences, manufacturing, and more to solve complex business challenges. Our global team specializes in cloud data modernization, predictive analytics, generative AI, and DataOps, supported by 10+ delivery centers and innovation hubs, including a major global presence in Bengaluru and operations across the USA, Canada, UK, Netherlands, Poland, Singapore, and India.

Recognized as a leader in the data and analytics space, Sigmoid is backed by Peak XV Partners and has consistently received accolades for innovation and rapid growth. Highlights include being named a ‘Leader’ in ISG’s Specialty Analytics Services for Supply Chain (2024), a two-time ‘India Future Unicorn’ by Hurun India, and a four-time honoree on both the Inc. 500 and Deloitte Technology Fast 500 lists.

Technical Lead – Data Engineering

As a Technical Lead, you will be responsible in building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.

This position reports to Engineering Manager.

Responsibilities: 

• Align Sigmoid with key Client initiatives
  • Interface daily with customers across leading Fortune 500 companies to understand strategic requirements
  • Connect with VP and Director level clients on a regular basis.
  • Travel to client locations
  • Ability to understand business requirements and tie them to technology solutions
• Facilitate in Technical Aspects
  • Design, develop and evolve highly scalable and fault-tolerant distributed components using Big data technologies.
  • Excellent experience in Application development and support, integration development and data management.
• Provide technical leadership and manage it day to day basis
  • Guiding developers in day to day design and coding tasks
  • Play a key role in hiring technical talents to build the future of Sigmoid.
• Stay up-to-date on the latest technology to ensure the greatest ROI for customer & Sigmoid
  • Hands on coder with good understanding on enterprise level code
  • Design and implement APIs, abstractions and integration patterns to solve challenging distributed computing problems
  • Experience in defining technical requirements, data extraction, data transformation, automating jobs, productionizing jobs, and exploring new big data technologies within a Parallel Processing environment
• Culture
  • Must be a strategic thinker with the ability to think unconventional / out:of:box.
  • Analytical and data driven orientation.
  • Raw intellect, talent and energy are critical.
  • Entrepreneurial and Agile : understands the demands of a private, high growth company.
  • Ability to be both a leader and hands on "doer". 

Qualifications: -

• 8+ years of track record of relevant work experience and a computer Science or a related technical discipline is required
• Experience in architecture and delivery of Enterprise scale applications and capable in developing framework, design patterns etc. Should be able to understand and tackle technical challenges, propose comprehensive solutions and guide junior staff
• Proven track record of building and shipping large-scale engineering products and/or knowledge of cloud infrastructure such as GCP/AWS preferred
• Experience working with large, complex data sets from a variety of sources
• Experience with Hadoop, Spark, or similar stack a must
• Experience with functional and object-oriented programming, Python or Scala a must
• Effective communication skills (both written and verbal)
• Ability to collaborate with a diverse set of engineers, data scientists and product managers
• Technical knowledge in Spark, Hadoop & GCS Stack.
• Comfort in a fast-paced start-up environment   

Preferred Qualification:

• Experience in agile methodology
• Development and support experience in Big Data domain
• Architecting, developing, implementing and maintaining Big Data solutions
• Experience with database modeling and development, data mining and warehousing.
• Experience with Hadoop ecosystem (HDFS, MapReduce, Oozie, Hive, Impala, Spark, Kerberos, KAFKA, etc)

You will be responsible for building a highly-scalable and extensible robust application. This position reports to the Engineering Manager.

Responsibilities:

• Align Sigmoid with key Client initiatives
  • Interface daily with customers across leading Fortune 500 companies to understand strategic requirements
  • Ability to understand business requirements and tie them to technology solutions
  • Open to work from client location as per the demand of the project / customer.
• Facilitate in Technical Aspects
  • Develop and evolve highly scalable and fault-tolerant distributed components using Java technologies.
  • Excellent experience in Application development and support, integration development and quality assurance.
• Provide technical leadership and manage it day to day basis
  • Interface daily with customers across leading Fortune 500 companies to understand strategic requirements
• Stay up-to-date on the latest technology to ensure the greatest ROI for customer & Sigmoid
  • Hands on coder with good understanding on enterprise level code.
  • Design and implement APIs, abstractions and integration patterns to solve challenging distributed computing problems
  • Experience in defining technical requirements, data extraction, data transformation, automating jobs, productionizing jobs, and exploring new big data technologies within a Parallel Processing environment
• Culture
  • Must be a strategic thinker with the ability to think unconventional / out:of:box.
  • Analytical and solution driven orientation.
  • Raw intellect, talent and energy are critical.
  • Entrepreneurial and Agile : understands the demands of a private, high growth company.
  • Ability to be both a leader and hands on "doer".

Qualifications: -

• 3-5 year track record of relevant work experience and a computer Science or a related technical discipline is required
• Experience in development of Enterprise scale applications and capable in developing framework, design patterns etc. Should be able to understand and tackle technical challenges, and propose comprehensive solutions.
• Experience with functional and object-oriented programming, Java (Preferred) or Python is a must.
• Hand-On knowledge in Map Reduce, Hadoop, PySpark, Hbase and ElasticSearch.
• Development and support experience in Big Data domain
• Experience with database modelling and development, data mining and warehousing.
• Unit, Integration and User Acceptance Testing.
• Effective communication skills (both written and verbal)
• Ability to collaborate with a diverse set of engineers, data scientists and product managers
• Comfort in a fast-paced start-up environment.

Preferred Qualification:

• Experience in Agile methodology.
• Proficient with SQL and its variation among popular databases.
• Experience working with large, complex data sets from a variety of sources.

As a Technical Project Manager, you will be leading a team to  build a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.

 Responsibilities : 

• Align Sigmoid with key Client initiatives
  • Interface daily with customers across leading Fortune 500 companies to understand strategic requirements
  • Connect with CIO, VP and Director level clients on a regular basis.
  • Travel to client locations
  • Ability to understand business requirements and tie them to technology solutions
• Build a delivery plan with domain experts and stay on track
  • Design, develop and evolve highly scalable and fault-tolerant distributed components using Big data technologies.
  • Excellent experience in Application development and support, integration development and data management.
• Build team and manage it day to day basis
  • Play the key role of hiring manager to build the future of Sigmoid.
  • Guiding developers in day to day design and coding tasks, stepping in to code if needed.
  • Define your team structure, Hire and train your team as needed
• Stay up-to-date on the latest technology to ensure the greatest ROI for customer & Sigmoid
  • Hands on coder with good understanding on enterprise level code
  • Design and implement APIs, abstractions and integration patterns to solve challenging distributed computing problems
  • Experience in defining technical requirements, data extraction, data transformation, automating jobs, productionizing jobs, and exploring new big data technologies within a Parallel Processing environment
• Culture
  • Must be a strategic thinker with the ability to think unconventional / out:of:box.
  • Analytical and data driven orientation.
  • Raw intellect, talent and energy are critical.
  • Entrepreneurial and Agile : understands the demands of a private, high growth company.
  • Ability to be both a leader and hands on "doer".

 Qualifications :-

• 10+ year track record of relevant work experience and a Computer Science or related technical discipline is required
• Dynamic leader who has directly managed team of highly competent developers in fast paced work environment
• Experience in Architecture and delivery of Enterprise scale applications.

 Preferred Qualification:

• Experience in agile methodology
• Development and support experience in Big Data domain
• Architecting, developing, implementing and maintaining Big Data solutions
• Experience with database modeling and development, data mining and warehousing.
• Experience with Hadoop ecosystem (HDFS, MapReduce, Oozie, Hive, Impala, Spark, Kerberos, KAFKA, etc)

Sigmoid works with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various role as a Software Development Engineer II

This position will be a part of growing team working towards building world class large scale Big Data architectures. This individual should have sound understanding of programming principles, experience in programming in Java, Python or similar languages  and can expect to spend a majority of their time coding.

Responsibilities:

As an Engineering Manager, you will be leading a team to build a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.

• Align Sigmoid with key Client initiatives
• Interface daily with customers across leading Fortune 500 companies to understand strategic requirements
• Connect with CIO, VP and Director level clients on a regular basis.
• Travel to client locations
• Ability to understand business requirements and tie them to technology solutions
• Build a delivery plan with domain experts and stay on track
• Design, develop and evolve highly scalable and fault-tolerant distributed components using Big data technologies.
• Excellent experience in Application development and support, integration development and data management.
• Build team and manage it day to day basis
• Play the key role of hiring manager to build the future of Sigmoid.
• Guiding developers in day to day design and coding tasks, stepping in to code if needed.
• Define your team structure, Hire and train your team as needed
• Stay up-to-date on the latest technology to ensure the greatest ROI for customer & Sigmoid
• Hands on coder with good understanding on enterprise level code
• Design and implement APIs, abstractions and integration patterns to solve challenging distributed computing problems
• Experience in defining technical requirements, data extraction, data transformation, automating jobs, productionizing jobs, and exploring new big data technologies within a Parallel Processing environment
• Culture
• Must be a strategic thinker with the ability to think unconventional / out:of:box.
• Analytical and data driven orientation.
• Raw intellect, talent and energy are critical.
• Entrepreneurial and Agile : understands the demands of a private, high growth company.
• Ability to be both a leader and hands on "doer".  

Qualifications :-

• 10+ year track record of relevant work experience and a Computer Science or related technical discipline is required
• Dynamic leader who has directly managed team of highly competent developers in fast paced work environment
• Experience in Architecture and delivery of Enterprise scale applications.

Preferred Qualification:

• Experience in agile methodology
• Development and support experience in Big Data domain
• Architecting, developing, implementing and maintaining Big Data solutions
• Experience with database modeling and development, data mining and warehousing.
• Experience with Hadoop ecosystem (HDFS, MapReduce, Oozie, Hive, Impala, Spark, Kerberos, KAFKA, etc)

Hadoop Admin
Location:  Bangalore 

Experience - 5-8 yrs

About Us 

“Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. 

WHY JOIN CAPCO?

You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.

MAKE AN IMPACT

Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.

#BEYOURSELFATWORK

Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.

CAREER ADVANCEMENT

With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.

DIVERSITY & INCLUSION

We believe that diversity of people and perspective gives us a competitive advantage.

MAKE AN IMPACT

Hadoop Admin
Location:  Bangalore 

Experience - 5-8 yrs