Jobs › Companies › Caterpillar › Lead Data Quality Assurance Engineer, Data Annotation Services

About this Lead Data Quality Assurance Engineer, Data Annotation Services role at Caterpillar

Caterpillar · Onsite · Irving, Texas

Career Area:

Technology, Digital and Data

Job Description:

Your Work Shapes the World at Caterpillar Inc.

When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other.  We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

Help Build the Future of Caterpillar

At Caterpillar, technology always has a purpose: solving our customers’ toughest challenges. Through Cat Technology, we are building the intelligence layer that connects machines, data, and people to make jobsites safer, more productive, and more sustainable. With over 1.6 million connected assets generating real-world data daily, we are creating the foundation for AI, autonomy, edge computing, and intelligent machines that continuously learn and improve at global scale.


Be Part of What’s Next in Autonomous Construction Sites

Construction autonomy is one of the most challenging applications of AI. As a Lead Data Quality Assurance Engineer, you will lead the quality strategy for training data powering robotics, computer vision, autonomous systems, Physical AI, and Vision-Language-Action (VLA) models. You will combine data quality engineering, test automation, and machine learning expertise to ensure the datasets used by Caterpillar’s AI systems are accurate, scalable, and trustworthy while leading a small team of QA engineers and collaborating across engineering, annotation, and product teams.


Job Summary:

Lead the development and execution of quality assurance processes, standards, and automation frameworks for annotation and captioning datasets supporting robotics, autonomous driving, computer vision, and Physical AI initiatives. Drive continuous improvement of dataset quality by establishing metrics, evaluating AI-assisted labeling technologies, managing vendor quality, and implementing scalable validation solutions across the data lifecycle.


What You Will Do:

  • Lead the annotation quality strategy and roadmap, providing technical leadership and mentorship to a team of QA engineers while defining standards, guidelines, acceptance criteria, and governance processes for perception and VLA datasets.
  • Design and implement automated validation frameworks, testing methodologies, and quality gates that verify annotation accuracy, consistency, completeness, schema compliance, and sensor synchronization across multimodal datasets.
  • Define and monitor dataset quality metrics, dashboards, audits, and benchmarking processes to measure dataset health, identify root causes of labeling defects, and drive continuous quality improvements with internal teams and external annotation providers.
  • Evaluate and validate human, AI-assisted, and automated labeling solutions, including technologies such as NVIDIA Cosmos Curator and Cosmos Reason, while helping develop AI-driven QA capabilities and agentic workflows for scalable review and defect analysis.
  • Partner with machine learning, platform, product, and vendor teams to integrate quality processes into data pipelines, communicate risks and tradeoffs, and ensure trusted datasets are delivered to support AI model development.

What You Will Have:

  • Bachelor’s degree in Computer Science, Software Engineering, Data Science, Artificial Intelligence, Robotics, or a related technical field.
  • 5+ years of experience in data quality engineering, annotation quality assurance, or test automation for computer vision, robotics, autonomous systems, Physical AI, or machine learning environments.
  • Experience leading small technical teams, providing mentorship, setting technical direction, and collaborating with external vendors or distributed teams.
  • Strong Python development skills with experience building automated validation frameworks, data quality tooling, and production-grade software using modern engineering practices and containerized environments.
  • Experience with annotation platforms (Labelbox, Supervisely, Roboflow, or similar), SQL, data analysis tools, and machine learning evaluation metrics such as precision, recall, IoU, F1, and mAP.
  • Experience validating perception datasets that include camera and LiDAR sensor data and investigating data quality issues across collection, annotation, and processing workflows.

Top Candidates Will Have:

  • Experience with computer vision, robotics, autonomous driving, multimodal AI, Physical AI, and 3D perception systems.
  • Experience evaluating AI-assisted annotation workflows, auto-labeling technologies, agentic AI systems, or LLM/VLM-based quality automation solutions.
  • Familiarity with ML frameworks and tooling such as PyTorch, TensorFlow, ONNX, MLflow, or Weights & Biases.
  • Experience with Vision-Language-Action (VLA) datasets, caption quality evaluation, sensor fusion, and autonomous machine data pipelines.
  • Experience building human-in-the-loop quality processes, managing annotation vendor performance, and working with cloud-based data platforms and MLOps environments.

Additional Details:

  • This position requires the candidate to work full-time onsite in Irving, TX (Dallas).
  • Domestic relocation assistance is available for this position.
  • Visa sponsorship is available for this position.

 

 

Summary Pay Range:

$128,470.00 - $208,770.00

Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar. 

Benefits:

Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits.

  • Medical, dental, and vision benefits*

  • Paid time off plan (Vacation, Holidays, Volunteer, etc.)*

  • 401(k) savings plans*

  • Health Savings Account (HSA)*

  • Flexible Spending Accounts (FSAs)*

  • Health Lifestyle Programs*

  • Employee Assistance Program*

  • Voluntary Benefits and Employee Discounts*

  • Career Development*

  • Incentive bonus*

  • Disability benefits

  • Life Insurance

  • Parental leave

  • Adoption benefits

  • Tuition Reimbursement

       

* These benefits also apply to part-time employees

 

 

 

 

 

 

 

 

Posting Dates:

Any offer of employment is conditioned upon the successful completion of a drug screen.

Caterpillar is an Equal Opportunity Employer, Including Veterans and Individuals with Disabilities.  Qualified applicants of any age are encouraged to apply.

Not ready to apply? Join our Talent Community.

Ready to apply to Caterpillar?
Apply to Caterpillar

How this QA Engineer salary compares

This role pays $168,620/yr — above the typical range for QA Engineer roles.

$79,132 median $133,000 $191,100

Typical range $105,500–$160,975/yr, from 1,792 comparable QA Engineer listings on JobsRadar (pay annualized to USD). See QA Engineer salary insights →

About Caterpillar

There’s more to work at Caterpillar than just the work itself. We hire smart, friendly people and it shows in our culture. We hold ourselves to high standards and make sure our values of integrity, excellence, teamwork, commitment and sustainability come to life in the way we work. We make sure our employees feel continuously challenged while also supported. We provide professional growth opportunities, including leadership programs. We celebrate the diversity of our team, while also working together as one Caterpillar. Our culture, like everything at our company, is made possible by each employee’s contribution. Person by person, we create the environment we work in, and we are proud of the

See all jobs at Caterpillar →

Similar jobs

Caterpillar
Senior Data Quality Assurance Engineer, Data Annotation Services
Caterpillar
⚡ Apply early Irving, Texas Onsite $112,710–$183,140 🛂 Visa sponsorship
● New 👁 Seen ✓ Applied 6d ago
Caterpillar
Senior Software Test Engineer
Caterpillar
⚡ Apply early Irving, Texas Onsite $112,710–$183,140 🛂 Visa sponsorship
● New 👁 Seen ✓ Applied 2mos ago
Accenture
Test Automation Engineer
Accenture
⚡ Apply early Bengaluru Onsite
● New 👁 Seen ✓ Applied 2h ago
RTX
Principal Systems Engineer, Integration & Test Lead
RTX
⚡ Apply early US-TX-MCKINNEY-513WH ~ 2501 W... Hybrid
● New 👁 Seen ✓ Applied 4h ago
Redwood Materials
Senior Electrical Hardware Test Engineer, Energy Storage
Redwood Materials
⚡ Apply early San Francisco, California, Uni... Onsite $145,000–$192,000
● New 👁 Seen ✓ Applied 5h ago
PS
Software Development Engineer in Test
Platform Science
⚡ Apply early Minnetonka, Minnesota, United... Hybrid $83,000–$115,000
● New 👁 Seen ✓ Applied 5h ago
TraceLink, Inc
Senior Software Engineer in Test - Agentic AI
TraceLink, Inc
⚡ Apply early APAC - India - Pune Onsite
● New 👁 Seen ✓ Applied 5h ago
Xona Space Systems
Manufacturing Engineer - Space Hardware, Electronics & Test
Xona Space Systems
⚡ Apply early Burlingame, California Onsite $146,000–$205,000
● New 👁 Seen ✓ Applied 7h ago
OpenAI
Robotics Test Engineer
OpenAI
⚡ Apply early San Francisco Onsite $287,000–$381,000
● New 👁 Seen ✓ Applied 7h ago

Sign up for suggestions tailored to the jobs you open and the searches you save.

More jobs at Caterpillar

See all jobs at Caterpillar →

Apply now
🤖

Whoa — hold up

JobsRadar was built for real people having a rough time in their job search — not for automated requests. You're clicking way too fast and you're now temporarily blocked.

Come back later. If you're genuinely job hunting, we've got your back — just act like a human.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Get an edge on your job hunt.

Join our Telegram channel for the stuff that helps you land the role — salary benchmarks, the weekly market pulse, and new-feature drops. No spam, just signal.

Join the channel — it's free