We’re looking for a Sr Big Data Engineer who expects more from their career. It’s chance to extend and improve dunnhumby’s Data Engineering Team. It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers.    

Key Responsibilities 

• Design end-to-end data solutions, including data lakes, data warehouses, ETL/ELT pipelines, APIs, and analytics platforms. 
• Architect scalable and low-latency data pipelines using tools like Apache Kafka, Flink, or Spark Streaming to handle high-velocity data streams. 
• Design /Orchestrate end-to-end automation using orchestration frameworks such as Apache Airflow to manage complex workflows and dependencies. 
• Design intelligent systems that can detect anomalies, trigger alerts, and automatically reroute or restart processes to maintain data integrity and availability. 
• Define and implement data governance, metadata management, and data quality standards. 
• Lead architectural reviews and technical design sessions to guide solution development. 
• Partner with business and IT teams to translate business needs into data architecture requirements. 
• Ensure security, compliance, and regulatory requirements are addressed in all data solutions. 
• Evaluate and recommend improvements to existing data architecture and processes. 
  
  

Technical Expertise

• Bachelors or masters degree in computer science, Information Systems, Data Science, or related field. 
• Extensive experience with high level programming languages - Python, Java or Scala 
• 5+ years of experience in data architecture, data engineering, or a related field. 
• Proficient in data pipeline tools such as Apache Spark, Kafka, Airflow, or similar. 
• Experience with data governance frameworks and tools (e.g., Collibra, Alation, OpenMetadata). 
• Strong knowledge of cloud platforms (Azure or Google Cloud), especially with cloud-native data services. 
• Experience working in Agile or DevOps environments. 
• Experience with modern data stack tools (e.g., dbt, Snowflake, Databricks). 
• Experience with Hive, Oozie, Airflow, HBase, MapReduce, Spark along with working knowledge of Hadoop/Spark Toolsets. 
  
• Extensive Experience working with Git and Process Automation  
  
• In depth understanding of relational database management systems (RDBMS) and Data Flow Development. 

We’re looking for a Senior Engineer (C/C++) who expects more from their career. It’s a chance to extend and improve dunnhumby’s  team. We’re a Backend Developers  team working with a wide variety of tools and technologies. We handle the whole lifecycle of our teams’ solutions, from inception and development to their deployment and maintenance via Infrastructure as Code. Joining our engineering team, you’ll work with passionate people to build, extend, and maintain the platform that underpins all our client engagements.

Required Skills:

• 6-10 years of experience in software development.
• 6+ years of experience in C/C++, Python and Shell Scripting.
• Fluency in working with databases.
• Have sound understanding of Object-Oriented Programming and development principles.
• Experience working in an Agile Scrum or Kanban development environment.
• Solid understanding of high-quality coding, testing, and development practices
• HLD, LLD, Design Principles , Distributed Computing and Functional programming

Good to Have Skills:

• Experience working with version control software (preferably Git).
• Experience with CI/CD pipelines.
• Experience of working with Dockers and Containers.
• Experience of working with Kubernetes.
• Experience of working with Airflow.
• Experience of working on Cloud environments (GCP and Azure)

Location:  Gurgaon, India

About Us:

Sauce Labs is the world’s largest full-lifecycle, test automation platform, and the company behind Selenium. Trusted by 80% of the world’s top ten largest financial institutions and over 300,000 enterprise users, Sauce Labs provides the only AI platform capable of turning business intent into autonomous testing and quality assurance. With a proprietary dataset of 8.7 billion test runs, Sauce Labs empowers the Fortune 2000 to bridge the gap between AI-driven code generation and enterprise-grade software quality. Learn more at saucelabs.com.

The Role:

We are seeking a highly skilled and motivated Senior Data Engineer to join our global team. As a Senior Data Engineer, you will design, build, and maintain the systems and infrastructure that enable efficient data collection, processing, and analysis. Your work will empower the organization to make data-driven decisions and support advanced analytics and machine learning initiatives.

Responsibilities:

• Design, develop, and maintain robust and scalable data pipelines to extract, transform, and load (ETL/ELT) data from various sources.
• Integrate data from a variety of formats and sources, including APIs, cloud platforms, and on-premise databases.
• Optimize data workflows and processing for performance and reliability.
• Work closely with the AI  & data analytics teams to understand data requirements and deliver tailored solutions.
• Collaborate with other engineering teams to design and optimize data architectures, ensuring data availability and consistency across the organization.
• Ensure data quality, integrity, and compliance with organizational and regulatory standards.
• Develop and enforce data governance policies and procedures.
• Monitor and optimize the performance of data infrastructure and pipelines.
• Document data engineering processes, workflows, and infrastructure for transparency and maintainability.

Required Skills:

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field. A Master’s degree is a plus.
• 5+ years of experience working as a data engineer or a similar role.
• Strong knowledge of data modeling and schema design.
• Proficient in SQL and some programming languages such as Python.
• Strong working knowledge of data warehousing solutions (Snowflake, Redshift, BigQuery).
• Hands-on experience with ETL/ELT tools and workflows.
• Familiarity with cloud platforms (Google Cloud, AWS, Azure) and their data-related services.
• Knowledge of orchestration / data processing tools (Airflow, dbt).
• Ability to troubleshoot data-related issues and identify root causes.
• Experience with containerization and orchestration tools (e.g., Docker, Kubernetes) is a plus.
• Experience with big data tools and platforms (e.g.  Kafka, Spark) is a plus
• Excellent communication and collaboration skills.
• Ability to work in a fast-paced, dynamic environment with multiple stakeholders.

This position is required to be in the office 5 days a week.

Please note our privacy terms when applying for a job at Sauce Labs.

Sauce Labs is proud to be an Equal Opportunity employer and values diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender identity/expression/status, sexual orientation, age, marital status, veteran status or disability status.

Security responsibilities at Sauce

At Sauce, we will commit to supporting the health and safety of employees and properties, partnering with internal stakeholders to learn and act on ever-evolving security protocols and procedures. You’ll be expected to fully comply with all policies and procedures related to security at the department and org wide level and exercise a ‘security first’ approach to how we design, build & run our products and services.

About WPP Media 

WPP is the creative transformation company. We use the power of creativity to build better futures for our people, planet, clients and communities. For more information, visit wpp.com. 

WPP Media is WPP’s global media collective. In a world where media is everywhere and in everything, we bring the best platform, people, and partners together to create limitless opportunities for growth. For more information, visit wppmedia.com 

At WPP Media, we believe in the power of our culture and our people. It’s what elevates us to deliver exceptional experiences for both our clients and each other. In this role it will be critical to embrace WPP & WPP Media’s shared core values: 

• Be Extraordinary by Leading Collectively to Inspire transformational Creativity. 
• Create an Open environment by Balancing People and Client Experiences by Cultivating Trust. 
• Lead Optimistically by Championing Growth and Development to Mobilize the Enterprise. 

Skills and Experience:

If this opportunity looks right for you, we are looking for candidates who have:

Essential Criteria

• Proven experience (5+ years) as a Backend Software Developer, with a strong portfolio of projects involving data processing and API development.
• Proficiency in one or more backend programming languages (e.g., Python, Java, Go, Node.js). Python is highly preferred given its prevalence in data science and ML.
• Strong experience with cloud platforms, particularly Google Cloud Platform (GCP), including services like Cloud Functions, Cloud Run, App Engine, Pub/Sub, Cloud Storage, and BigQuery.
• Demonstrable experience in designing, building, and maintaining RESTful APIs and microservices.
• Solid understanding of database technologies, both relational (e.g., PostgreSQL, MySQL) and NoSQL (e.g., MongoDB, Firestore), and experience with data modelling.
• Experience with data pipeline tools and concepts (e.g., Apache Beam/Dataflow, Airflow) for ETL/ELT processes.
• Familiarity with version control systems (e.g., Git) and agile development methodologies.
• Basic understanding of machine learning concepts and how to integrate ML models into backend systems.
• Basic understanding of the total marketing process and the strategic role of insights and media.
• An appreciation for how data insights are used in various media channels (e.g., paid search, programmatic display, social media, SEO) to inform strategy.
• Excellent problem-solving skills and attention to detail.
• Experience working with off-shore or distributed teams is highly desirable.
• Experience integrating data into Google BigQuery from various sources, including direct API connections and data integration platforms (e.g., Adverity).
• Experience with leveraging AI/ML capabilities within the GCP ecosystem, such as connecting to large language models (e.g., Google's Gemini API) or utilising platforms like Vertex AI to enrich and analyse data stored in BigQuery.

Preferred Criteria

• Experience with stream processing technologies (e.g., Kafka, Pub/Sub).
• Knowledge of containerization technologies (e.g., Docker, Kubernetes).
• Experience with CI/CD pipelines.
• Familiarity with data security and privacy best practices.
• Experience in the media, advertising, or marketing technology (AdTech/MarTech) industry.
• Certifications in relevant cloud technologies.

Life at WPP Media & Benefits:

Our passion for shaping the next era of media includes investing in our employees to help them do their best work, and we’re just as committed to employee growth as we are to responsible media investment. WPP Media employees can tap into the global WPP Media & WPP networks to pursue their passions, grow their networks, and learn at the cutting edge of marketing and advertising. We have a variety of employee resource groups and host frequent in-office events showcasing team wins, sharing thought leadership, and celebrating holidays and milestone events. Our benefits include access to internal learning platforms, certifications, training sessions, life insurance, wellness programs, significant paid time off, preferential partner discounts, employee mental health awareness day and more.

WPP Media is an equal opportunity employer and considers applicants for all positions without discrimination or regard to particular characteristics. We are committed to fostering a culture of respect in which everyone feels they belong and has the same opportunities to progress in their careers.
 
 We believe the best work happens when we're together, fostering creativity, collaboration, and connection. If you require accommodation or flexibility, please discuss this with the hiring team during the interview process.

Research shows that candidates from underrepresented backgrounds often don't apply for roles if they don't meet all the criteria.  At WPP Media, we strongly encourage you to apply if you’re interested: we'd love to know how you can positively impact our team with your experience!

As an Equal Opportunities Employer, we believe that diversity is vital and positively influences the environment in which we operate. We are committed to fostering a diverse and inclusive work environment that is free of discrimination, harassment or bullying. Race, color, ancestry, religion, gender, gender identity, national origin, sexual orientation, age, marital status or disability status have no bearing on our hiring decisions, and we encourage all applicants.

We view everyone as an individual and we understand that inclusion is more than just diversity – it’s about belonging. We celebrate the fact that everyone is unique and that’s what makes us so good at what we do. We pride ourselves on being a company that embraces difference and truly represents the global clients we work with.

Life at WPP Media & Benefits 

Our passion for shaping the next era of media includes investing in our employees to help them do their best work, and we’re just as committed to employee growth as we are to responsible media investment. WPP Media employees can tap into the global WPP Media & WPP networks to pursue their passions, grow their networks, and learn at the cutting edge of marketing and advertising. We have a variety of employee resource groups and host frequent in-office events showcasing team wins, sharing thought leadership, and celebrating holidays and milestone events. Our benefits include competitive medical, group retirement plans, vision, and dental insurance, significant paid time off, preferential partner discounts, and employee mental health awareness days.   

WPP Media is an equal opportunity employer and considers applicants for all positions without discrimination or regard to characteristics. We are committed to fostering a culture of respect in which everyone feels they belong and has the same opportunities to progress in their careers.

We believe the best work happens when we're together, fostering creativity, collaboration, and connection. That's why we’ve adopted a hybrid approach, with teams in the office around four days a week. If you require accommodations or flexibility, please discuss this with the hiring team during the interview process.