Company Overview

At CommerceIQ, we help consumer brands accelerate their retail ecommerce market share growth and profitability through machine learning algorithms. We are building the world’s most complete and sophisticated Retail Ecommerce Management Platform, which connects and intelligently automates the management of retail ecommerce channels like Amazon, Walmart, and Instacart, across the entire ecommerce operational chain of retail media management, sales operations, supply chain, and digital self analytics.

We are in hyper growth mode, having recently raised our Series D funding at unicorn valuation (>$1B) and ended our third year of triple-digit revenue growth. Continued acceleration of our growth is fueled by landing new customers, expanding our platform through new products, managing new retail ecommerce platforms, and delivering exceptional customer service to unlock high net retention rates.

What You’ll Be Doing

As a Lead ML Engineer in the Data Science team, you will work closely with the engineering, product, and operations teams to build state-of- the-art ML based solutions for B2B SaaS products. This will entail applying advanced ML algorithms at scale for core products and developing robust end to end production pipelines which includes Human-in-the-Loop component to boost the quality. 

In this role, you will find innovative ways to apply emerging technologies to improve business processes and drive more value for customers. The ideal candidate will have a strong background in machine learning model development, natural language processing and understanding, and data analysis which they can utilize to manage and improve our company’s AI/ML initiatives. 

• Architect and Own multiple AI driven end to end pipelines that allows for deployment and scalability of machine learning models
• Build tools and capabilities that help with data ingestion to feature engineering, data management and organization
• Build tools and capabilities for scalability through distributed optimization 
• Deploy  cutting edge algorithms like LLMs etc. on GPUs at scale
• Work with stakeholders on the research and software engineering side of the company to understand how to support their teams
• Build tools and capabilities for model management and model performance monitoring
• Build operating services at scale with high availability and reliability
• Propose and implement the best engineering practices for scaling ML-powered features, with a goal to enable the fast iteration of and efficient experimentation with novel features
• Contribute and influence the ML infrastructure roadmap in collaboration with Data Science team

What we are looking for -

• Bachelor’s or Masters in Computer Science or Maths/Stats from a reputed college with 5+ years of experience in solving of experience in machine learning engineering problems 
• Experience and understanding of the entire machine learning pipeline from data ingestion to production
• Experience with machine learning operations, software engineering, and architecture
• Experience with large-scale systems including parallel computing and GPUs
• Experience architecting and building an AI pipelines that supports productionization of ML models
• Experience with MLOps systems
• Strong programming skills in a scientific computing language such as Python, SQL
• Experience using frameworks for machine learning and data science like scikit-learn, pandas, NumPy
• Experience working with ML tools such as Tensorflow, Keras, and Pytorch
• Ability to take successful, complex research ideas from experimentation to production
• Excellent written and oral communication skills and the capability to drive cross-functional requirements with product and engineering teams
• Good depth and breadth in machine learning (theory and practice), optimization methods, data mining, statistics and linear algebra

Why you will love to work with us -

We have multiple brands, which are among the biggest brands operating on amazon, as our customers. You will be responsible for working with their data and developing models and algorithms to drive lift in tune of hundreds of thousands of dollars.

• Opportunity to work on cutting edge technologies in text and images data like LLMs, OCR, transformer based embeddings models
• Deploy code using the most sophisticated tech stack like AWS, GCP etc.
• You will own projects end to end i.e., from exploration to final production
• You will be empowered to make decisions. It implies more responsibilities but high learning
• Immense opportunities to learn and develop ML based SaaS products for brands and get company-wide recognition
• Forget endless meetings. Get things done and start making an impact from day 1
• Work hard, have amazing fun, create history, build the future of eCommerce 
• Start-up environment with a strong culture and values to accelerate your career 

The Challenge 

We are looking for a Senior level SDET to support our product development teams. As the Senior SDET, you will play a crucial role in shaping and leading our software testing strategy. You will be responsible for designing, developing, and implementing robust test automation frameworks, mentoring a team of SDETs (Software Development Engineer in Test), and ensuring the overall quality and reliability of our software products. 

Your Mission 

As a Senior SDET, you will: 

Provide technical leadership and guidance to the SDET team.
Collaborate with development and QE (Quality Engineering) teams to integrate testing into the software development process.
Design, develop, and maintain scalable and efficient test automation frameworks and test architectures.
Rub shoulders with developers in writing unit and integration tests using their tools and frameworks.
Ensure the frameworks support various testing types, including functional, integration, and performance testing.
Mentor and guide junior SDETs, providing technical expertise and career development support.
Conduct training sessions to enhance the skills of the testing team.
Foster a culture of innovation, collaboration, and continuous learning within the team.
Collaborate with cross-functional teams to develop comprehensive test plans.
Execute and oversee the execution of test cases, ensuring thorough coverage of functional and non-functional requirements.
Analyze test results and provide meaningful insights to improve product quality.
Work closely with developers, product managers, and other stakeholders to understand requirements and user stories.
Communicate effectively with team members and stakeholders, providing clear updates on testing progress and issues.
Add, maintain, and update scripts in existing automation suite, helping with running the suite across various checkpoints in the release cycle. 
Participate in various POCs (Proof of Concept) to keep the automation framework and technology relevant and current to product offerings. 
Conduct peer reviews of test code and automation frameworks. 

You Are

You are a seasoned SDET with an automate anything anywhere attitude who is looking for a challenging technical leadership role in a dynamic and innovative company.
You can efficiently find the underlying cause of a failure (in an integrated environment) and alert the right team.
You are consistently willing to pitch in to support a long running deployment, even after hours.
You are willing to learn and pick up new skillsets to support the ever-changing technology landscape like Cloud computing & AI (Artificial Intelligence).
You can understand complex product and deployment architectures and create efficient test solutions.
You want to be part of a team that is passionate about delivering high-quality software solutions.
Your Experience Includes 
Bachelor's degree in Computer Science, Engineering, or related technical or business field. 
4+ years of relevant experience working as a developer, automation engineer or SDET. 
4+ years of experience coding in Java and must have strong practical knowledge of OOPs and Core Java principles. 
4+ years of experience contributing to Test-Driven Development or BDD (Behavior Driven Development) with tools like Cucumber, Junit, Mockito, or TestNG.
3+ years of experience with CI/CD tools like Jenkins, Circle CI, or Azure DevOps with the ability to create test pipelines using Java or Groovy.
4+ years of experience with Selenium or Cypress frameworks for automating GUI (User Interface) and E2E tests of the application.
4+ years of experience with REST Assured or similar tools like Postman for automating APIs.
4+ years of experience working in a highly automated CI/CD environment. 
4+ years of experience with source control tools such as Bitbucket, GitHub or GitLab. 
2+ years of experience mining meaningful logs for troubleshooting using tools like Splunk, Dynatrace or Coralogix.
3+ years of experience working in a cloud shop preferably Azure with exposure to various Azure services like Gateways, Redis, Storage, VMs (virtual machines) and Kubernetes clusters. 
3+ years of experience in testing mobile applications, both native and websites using Appium on both real devices and simulators either in a private farm of 3rd party vendors like Sauce Labs or BrowserStack.
Strong analytical, critical thinking and problem-solving skills.
Ability to work as part of a team, demonstrate initiative, solve problems independently and mentor others.
Passion for high quality work and attention to detail.
Strong oral and written communication skills.

Extra Awesome

Prior exposure to AI/ML systems and how to use them in testing thus making test pipeline more intelligent.
Experience in analyzing the CPU Utilization, Memory usage, Network usage, Garbage Collection and DB Parameters and DB Reports to verify the performance of the applications.
Ability to spin up scalable test architecture using Docker or Kubernetes.
Experience with Kubernetes and extended usage patterns for test grids, auto scale properties.

About the role

We are building a founding firmware engineering team in India and are looking for strong Firmware Engineers who want to own the foundation of new hardware platforms from day one. This role is focused on low level firmware development, early board bring up, and system level enablement across microcontrollers and infotainment class SoCs.

As a founding member of this team, you will work close to the hardware and have end to end ownership from first power on through a stable, production ready platform. Your work will define boot flows, OS bring up, performance characteristics, and power behavior that future products and teams will build on.

This is a deeply hands-on role for engineers who enjoy operating at the boundary of hardware and software, solving hard problems, and setting technical direction rather than inheriting it. You will collaborate closely with global teams, silicon vendors, and hardware partners while helping establish best practices and technical standards for the India organization.

At Applied Intuition, you will:

• Lead board bring up for new hardware platforms including microcontrollers and infotainment SoCs
• Develop and debug bootloaders and early boot software
• Bring up and customize FreeRTOS, QNX, Linux, and Android on new boards
• Work on Linux kernel and device driver enablement for custom hardware
• Optimize boot time, system startup, and runtime performance
• Drive power optimization across boot, idle states, and active workloads
• Debug complex hardware and software issues using JTAG, logic analyzers, and low level logs
• Collaborate closely with hardware teams, BSP vendors, and silicon partners
• Support system integration, validation, and bring up on real target hardware

We're looking for someone who has:

• 4+ years of strong experience in firmware or low level embedded systems development
• A Bachelor's degree in Computer Science, Embedded Software, Mechatronics, or equivalent
• Hands on experience with board bring up for MCUs or SoCs
• Deep knowledge of FreeRTOS and or QNX for embedded systems
• Experience working with Linux kernel or Android at the platform level
• Solid understanding of bootloaders such as U Boot or custom boot flows
• Strong C and C++ programming skills
• Experience debugging early boot and hardware dependent issues
• Understanding of power management, boot optimization, and performance tuning
• Comfort working close to hardware and reading schematics and datasheets
• Ability to work independently and take ownership from bring up to stabilization

Nice to have:

• Experience with BSP customization and silicon vendor SDKs
• Familiarity with secure boot, firmware update flows, or OTA mechanisms
• Experience supporting customer facing engineering or production bring up
• Experience with cloud-connected vehicle platforms, SDV architectures, and AI-driven automotive applications
• Knowledge of functional safety (ASIL levels), cybersecurity (ISO 21434), and AUTOSAR tooling

Compensation at Applied Intuition for eligible roles includes base salary, equity, and benefits. Base salary is a single component of the total compensation package, which may also include equity in the form of options and/or restricted stock units, comprehensive health, dental, vision, life and disability insurance coverage, learning and wellness stipends, and paid time off. Note that benefits are subject to change and may vary based on jurisdiction of employment.

Applied Intuition pay ranges reflect the minimum and maximum intended target base salary for new hire salaries for the position. The actual base salary offered to a successful candidate will additionally be influenced by a variety of factors including experience, credentials & certifications, educational attainment, skill level requirements, interview performance, and the level and scope of the position.

Please reference the job posting’s subtitle for where this position will be located. For pay transparency purposes, the base salary range for this full-time position in the location listed is: 2,165,800 - 5,000,000 INR annually.

P-926

The Applied AI team at Databricks sits at the forefront of advancing AI/ML-powered products. Databricks’ customers are continuously creating new assets (tables, notebooks, dashboards, datarooms, pipelines, sql queries, ml models etc.) on the platform. Finding an asset is a critical user journey for Databricks’ customers which helps them accomplish their tasks. 

As our Search product continues to evolve, we are seeking multiple  ML Engineers from junior levels to more senior levels to drive enhancements to our Search Quality. In 2026, we will focus on enhancing search ranking, improving query understanding, building robust evals and growing the coverage of assets to enable seamless search at scale.

Key Responsibilities

• Drive the development and deployment of ML based search and discovery relevance models and systems integrated with Databricks' products and services. 
• Design and implement automated ML and NLP pipelines for data preprocessing, query understanding and rewrite, ranking and retrieval, and model evaluation, enabling rapid experimentation and iteration. 
• Collaborate with product managers and cross-functional teams to drive technology-first initiatives that enable novel business strategies and product roadmaps for the search and discovery experience. 
• Contribute to building a robust framework for evaluating search ranking improvements - both offline and online.

What We’re Looking For

• BS+ (M.S. or PhD preferred) in Computer Science, or a related field.
• 5+ years experience developing search relevance systems at scale in production or in high-impact research environments.
• Experience applying LLM to search relevance
• Experience in one or more of the following:  
• Query understanding
• NLP
• Text mining
• Recommendations
• Personalization
• Discovery
• Conversational AI 
• Strong understanding of computer science fundamentals.
• Contributions to well-used open-source projects. 

Why Join Us?
At Databricks, we are building state-of-the-art AI solutions that redefine how users interact with data and our products. You’ll have the opportunity to shape the future of AI-driven products at Databricks, work with cutting-edge models, and collaborate with a world-class team of AI and ML experts.

If you're excited about pushing the boundaries of AI in real-world applications, we’d love to hear from you!

Job Title: Senior Data Engineer - Scala

Job Description:

The Senior Data Engineer will be responsible for designing, developing, and maintaining scalable data pipelines and building out new API integrations to support continuing increases in data volume and complexity. They will collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.

Responsibilities:

• Design, construct, install, test and maintain highly scalable data management systems & Data Pipeline.
• Ensure systems meet business requirements and industry practices.
• Build high-performance algorithms, prototypes, predictive models, and proof of concepts.
• Research opportunities for data acquisition and new uses for existing data.
• Develop data set processes for data modeling, mining and production.
• Integrate new data management technologies and software engineering tools into existing structures.
• Create custom software components and analytics applications.
• Install and update disaster recovery procedures.
• Collaborate with data architects, modelers, and IT team members on project goals.
• Provide senior level technical consulting to peer data engineers during data application design and development for highly complex and critical data projects.

Qualifications:

• Bachelor's degree in computer science, Engineering, or related field, or equivalent work experience.
• Proven 5-8 years of experience as a Senior Data Engineer or similar role.
• Experience with big data tools: Python, Hadoop, Spark, Pyspark & Scala
• Expert level SQL skills for data manipulation (DML) and validation (DB2).
• Experience with data pipeline and workflow management tools.
• Experience with object-oriented/object function scripting languages: Python, Java, Go lang etc.
• Strong problem solving and analytical skills.
• Excellent verbal communication skills.
• Good interpersonal skills.
• Ability to provide technical leadership for the team.

P-1408

The Applied AI team at Databricks sits at the forefront of advancing AI/ML-powered products. Databricks’ customers are continuously creating new assets (tables, notebooks, dashboards, datarooms, pipelines, sql queries, ml models etc.) on the platform. Some of them can have hundreds of millions of assets. Finding an asset is a critical user journey for Databricks’ customers which helps them accomplish their tasks. 

As our Search product continues to evolve, we are seeking a Staff Engineer to lead enhancements to our Search Quality. In 2025, we will focus on enhancing search ranking, improving query understanding, building robust evals and growing the coverage of assets to enable seamless search at scale.

Key Responsibilities

• Drive the development and deployment of ML based search and discovery relevance models and systems integrated with Databricks' products and services. 
• Design and implement automated ML and NLP pipelines for data preprocessing, query understanding and rewrite, ranking and retrieval, and model evaluation, enabling rapid experimentation and iteration. 
• Collaborate with product managers and cross-functional teams to drive technology-first initiatives that enable novel business strategies and product roadmaps for the search and discovery experience. 
• Contribute to building a robust framework for evaluating search ranking improvements - both offline and online.

What We’re Looking For

• BS+ (M.S. or PhD preferred) in Computer Science, or a related field.
• 10+ years experience developing search relevance systems at scale in production or in high-impact research environments.
• Experience applying LLM to search relevance
• Experience in one or more of the following:  
• Query understanding
• NLP
• Text mining
• Recommendations
• Personalization
• Discovery
• Conversational AI 
• Strong understanding of computer science fundamentals.
• Contributions to well-used open-source projects. 

Why Join Us?
At Databricks, we are building state-of-the-art AI solutions that redefine how users interact with data and our products. You’ll have the opportunity to shape the future of AI-driven products at Databricks, work with cutting-edge models, and collaborate with a world-class team of AI and ML experts.

If you're excited about pushing the boundaries of AI in real-world applications, we’d love to hear from you!

P-1408

The Applied AI team at Databricks sits at the forefront of advancing AI/ML-powered products. Databricks’ customers are continuously creating new assets (tables, notebooks, dashboards, datarooms, pipelines, sql queries, ml models etc.) on the platform. Some of them can have hundreds of millions of assets. Finding an asset is a critical user journey for Databricks’ customers which helps them accomplish their tasks. 

As our Search product continues to evolve, we are seeking a Staff Engineer to lead enhancements to our Search Quality. In 2026, we will focus on enhancing search ranking, improving query understanding, building robust evals and growing the coverage of assets to enable seamless search at scale.

Key Responsibilities

• Drive the development and deployment of ML based search and discovery relevance models and systems integrated with Databricks' products and services. 
• Design and implement automated ML and NLP pipelines for data preprocessing, query understanding and rewrite, ranking and retrieval, and model evaluation, enabling rapid experimentation and iteration. 
• Collaborate with product managers and cross-functional teams to drive technology-first initiatives that enable novel business strategies and product roadmaps for the search and discovery experience. 
• Contribute to building a robust framework for evaluating search ranking improvements - both offline and online.

What We’re Looking For

• BS+ (M.S. or PhD preferred) in Computer Science, or a related field.
• 10+ years experience developing search relevance systems at scale in production or in high-impact research environments.
• Experience applying LLM to search relevance
• Experience in one or more of the following:  
• Query understanding
• NLP
• Text mining
• Recommendations
• Personalization
• Discovery
• Conversational AI 
• Strong understanding of computer science fundamentals.
• Contributions to well-used open-source projects. 

Why Join Us?
At Databricks, we are building state-of-the-art AI solutions that redefine how users interact with data and our products. You’ll have the opportunity to shape the future of AI-driven products at Databricks, work with cutting-edge models, and collaborate with a world-class team of AI and ML experts.

If you're excited about pushing the boundaries of AI in real-world applications, we’d love to hear from you!

P-1407

The Applied AI team at Databricks sits at the forefront of advancing AI/ML-powered products. Databricks’ customers are continuously creating new assets (tables, notebooks, dashboards, datarooms, pipelines, sql queries, ml models etc.) on the platform. Some of them can have hundreds of millions of assets. Finding an asset is a critical user journey for Databricks’ customers which helps them accomplish their tasks. 

As our Search product continues to evolve, we are seeking multiple ML Engineers from junior levels to more senior levels to drive enhancements to our Search Quality. In 2026, we will focus on enhancing search ranking, improving query understanding, building robust evals and growing the coverage of assets to enable seamless search at scale.

Key Responsibilities

• Drive the development and deployment of ML based search and discovery relevance models and systems integrated with Databricks' products and services. 
• Design and implement automated ML and NLP pipelines for data preprocessing, query understanding and rewrite, ranking and retrieval, and model evaluation, enabling rapid experimentation and iteration. 
• Collaborate with product managers and cross-functional teams to drive technology-first initiatives that enable novel business strategies and product roadmaps for the search and discovery experience. 
• Contribute to building a robust framework for evaluating search ranking improvements - both offline and online.

What We’re Looking For

• BS+ (M.S. or PhD preferred) in Computer Science, or a related field.
• 6+ years experience developing search relevance systems at scale in production or in high-impact research environments.
• Experience applying LLM to search relevance
• Experience in one or more of the following:  
• Query understanding
• NLP
• Text mining
• Recommendations
• Personalization
• Discovery
• Conversational AI 
• Strong understanding of computer science fundamentals.
• Contributions to well-used open-source projects. 

Why Join Us?
At Databricks, we are building state-of-the-art AI solutions that redefine how users interact with data and our products. You’ll have the opportunity to shape the future of AI-driven products at Databricks, work with cutting-edge models, and collaborate with a world-class team of AI and ML experts.

If you're excited about pushing the boundaries of AI in real-world applications, we’d love to hear from you!

P-1407

The Applied AI team at Databricks sits at the forefront of advancing AI/ML-powered products. Databricks’ customers are continuously creating new assets (tables, notebooks, dashboards, datarooms, pipelines, sql queries, ml models etc.) on the platform. Some of them can have hundreds of millions of assets. Finding an asset is a critical user journey for Databricks’ customers which helps them accomplish their tasks. 

As our Search product continues to evolve, we are seeking multiple ML Engineers from junior levels to more senior levels to drive enhancements to our Search Quality. In 2026, we will focus on enhancing search ranking, improving query understanding, building robust evals and growing the coverage of assets to enable seamless search at scale.

Key Responsibilities

• Drive the development and deployment of ML based search and discovery relevance models and systems integrated with Databricks' products and services. 
• Design and implement automated ML and NLP pipelines for data preprocessing, query understanding and rewrite, ranking and retrieval, and model evaluation, enabling rapid experimentation and iteration. 
• Collaborate with product managers and cross-functional teams to drive technology-first initiatives that enable novel business strategies and product roadmaps for the search and discovery experience. 
• Contribute to building a robust framework for evaluating search ranking improvements - both offline and online.

What We’re Looking For

• BS+ (M.S. or PhD preferred) in Computer Science, or a related field.
• 6+ years experience developing search relevance systems at scale in production or in high-impact research environments.
• Experience applying LLM to search relevance
• Experience in one or more of the following:  
• Query understanding
• NLP
• Text mining
• Recommendations
• Personalization
• Discovery
• Conversational AI 
• Strong understanding of computer science fundamentals.
• Contributions to well-used open-source projects. 

Why Join Us?
At Databricks, we are building state-of-the-art AI solutions that redefine how users interact with data and our products. You’ll have the opportunity to shape the future of AI-driven products at Databricks, work with cutting-edge models, and collaborate with a world-class team of AI and ML experts.

If you're excited about pushing the boundaries of AI in real-world applications, we’d love to hear from you!

Sigmoid works with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various role as a Software Development Engineer II

This position will be a part of growing team working towards building world class large scale Big Data architectures. This individual should have sound understanding of programming principles, experience in programming in Java, Python or similar languages  and can expect to spend a majority of their time coding.

Responsibilities:

As an Engineering Manager, you will be leading a team to build a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.

• Align Sigmoid with key Client initiatives
• Interface daily with customers across leading Fortune 500 companies to understand strategic requirements
• Connect with CIO, VP and Director level clients on a regular basis.
• Travel to client locations
• Ability to understand business requirements and tie them to technology solutions
• Build a delivery plan with domain experts and stay on track
• Design, develop and evolve highly scalable and fault-tolerant distributed components using Big data technologies.
• Excellent experience in Application development and support, integration development and data management.
• Build team and manage it day to day basis
• Play the key role of hiring manager to build the future of Sigmoid.
• Guiding developers in day to day design and coding tasks, stepping in to code if needed.
• Define your team structure, Hire and train your team as needed
• Stay up-to-date on the latest technology to ensure the greatest ROI for customer & Sigmoid
• Hands on coder with good understanding on enterprise level code
• Design and implement APIs, abstractions and integration patterns to solve challenging distributed computing problems
• Experience in defining technical requirements, data extraction, data transformation, automating jobs, productionizing jobs, and exploring new big data technologies within a Parallel Processing environment
• Culture
• Must be a strategic thinker with the ability to think unconventional / out:of:box.
• Analytical and data driven orientation.
• Raw intellect, talent and energy are critical.
• Entrepreneurial and Agile : understands the demands of a private, high growth company.
• Ability to be both a leader and hands on "doer".  

Qualifications :-

• 10+ year track record of relevant work experience and a Computer Science or related technical discipline is required
• Dynamic leader who has directly managed team of highly competent developers in fast paced work environment
• Experience in Architecture and delivery of Enterprise scale applications.

Preferred Qualification:

• Experience in agile methodology
• Development and support experience in Big Data domain
• Architecting, developing, implementing and maintaining Big Data solutions
• Experience with database modeling and development, data mining and warehousing.
• Experience with Hadoop ecosystem (HDFS, MapReduce, Oozie, Hive, Impala, Spark, Kerberos, KAFKA, etc)

You will be responsible for building a highly-scalable and extensible robust application. This position reports to the Engineering Manager.

Responsibilities:

• Align Sigmoid with key Client initiatives
  • Interface daily with customers across leading Fortune 500 companies to understand strategic requirements
  • Ability to understand business requirements and tie them to technology solutions
  • Open to work from client location as per the demand of the project / customer.
• Facilitate in Technical Aspects
  • Develop and evolve highly scalable and fault-tolerant distributed components using Java technologies.
  • Excellent experience in Application development and support, integration development and quality assurance.
• Provide technical leadership and manage it day to day basis
  • Interface daily with customers across leading Fortune 500 companies to understand strategic requirements
• Stay up-to-date on the latest technology to ensure the greatest ROI for customer & Sigmoid
  • Hands on coder with good understanding on enterprise level code.
  • Design and implement APIs, abstractions and integration patterns to solve challenging distributed computing problems
  • Experience in defining technical requirements, data extraction, data transformation, automating jobs, productionizing jobs, and exploring new big data technologies within a Parallel Processing environment
• Culture
  • Must be a strategic thinker with the ability to think unconventional / out:of:box.
  • Analytical and solution driven orientation.
  • Raw intellect, talent and energy are critical.
  • Entrepreneurial and Agile : understands the demands of a private, high growth company.
  • Ability to be both a leader and hands on "doer".

Qualifications: -

• 3-5 year track record of relevant work experience and a computer Science or a related technical discipline is required
• Experience in development of Enterprise scale applications and capable in developing framework, design patterns etc. Should be able to understand and tackle technical challenges, and propose comprehensive solutions.
• Experience with functional and object-oriented programming, Java (Preferred) or Python is a must.
• Hand-On knowledge in Map Reduce, Hadoop, PySpark, Hbase and ElasticSearch.
• Development and support experience in Big Data domain
• Experience with database modelling and development, data mining and warehousing.
• Unit, Integration and User Acceptance Testing.
• Effective communication skills (both written and verbal)
• Ability to collaborate with a diverse set of engineers, data scientists and product managers
• Comfort in a fast-paced start-up environment.

Preferred Qualification:

• Experience in Agile methodology.
• Proficient with SQL and its variation among popular databases.
• Experience working with large, complex data sets from a variety of sources.

Position Summary:

Avathon’s Industrial AI Suite is the world's leading AI enabled SaaS platform that provides asset performance management and prescriptive analytics software to ever growing Aviation, Manufacturing, Mining, Renewable and Oil & gas energy power plants by combining the power of machine learning, big data, and deep domain expertise. Our Data Engineering and Science platform works across multiple capital intensive industrial asset types to offer insights to our customers.

Join us in developing and applying cutting-edge Enterprise Data Engineering solutions for commercial and industrial AI SaaS applications. We are looking for candidates with strong expertise in large scale Data Engineering, building scalable ETL pipelines to enable our AI enabled Saas Asset Performance Management. As a Senior Data platform Engineer you will be working closely with team members across domains with deep technical skills and Industrial AI domain. 

What you will do:

• Work on engineering projects to design, construct, install, test and maintain highly scalable data management systems (data lakes, warehouses, pipelines) to ensure secure, efficient data flow and accessibility for analytics and AI/ML
• Building robust ETL pipelines and automating data workflows. Focus on automating data management, implementing DevOps principles (CI/CD, monitoring), and collaborating on data architecture.
• Utilise Key tools include Python, SQL, Cloud platforms (AWS/Azure/GCP), Kafka, Spark, and Docker. 
• Developing and maintaining scalable ETL and MLOps pipelines and workflows.
• Enforcing data quality rules to ensure consistency, completeness, and accuracy across ETL processes.
• Designing, constructing, testing, and maintaining highly scalable data management systems.
• Mentoring a team of Data Analysts, Data Engineers, and Data Quality Specialists.
• Fostering a culture of continuous learning, collaboration, and data-driven decision-making.

You’ll have:

• Excellent programming skills in Python, along with deep expertise in relational databases (MSSQL/MySQL/Postgres).
• 5+ years of hands-on experience in data engineering with a solid foundation in architecture principles.
• 1+ years of leadership or mentorship experience of data teams.
• Strong understanding of serverless architectures and building scalable ETL pipelines.
• Effective communication and leadership skills, capable of driving projects to completion.
• People and project management experience is a plus.

It would be great if you had:

• Experience in Industrial Engineering Systems like IoT time series data or even old legacy systems e.g. PLC, SCADA systems.
• Experience with cloud-native tools, particularly AWS or GCP.
• Willingness to adopt new technologies to enhance data quality and ETL processes.
• Hands-on experience in DevOps, focusing on cloud-native technologies.
• Expertise in debugging and troubleshooting ETL pipelines, data transformations, and integrity issues.

Other requirements:

This is 5 days onsite work week schedule

A design/ coding challenge is a prerequisite for this position.