Jobs › Companies › TransUnion › P03

Sobre este puesto de P03 en TransUnion

TransUnion · Híbrido · Bengaluru

TransUnion's Job Applicant Privacy Notice

Team Overview

The team is responsible for building, enhancing, and operating scalable data engineering solutions and distributed data processing platforms. The team processes large volumes of data, including terabyte-scale datasets, through recurring batch workloads and production pipelines, with a strong focus on performance, scalability, reliability, and cost efficiency.
The role will contribute to developing and optimizing data-intensive applications using Apache Spark, Scala, Python, and cloud technologies, with a preference for Google Cloud Platform (GCP). The team works on identity resolution and data-driven solutions, where linking identities and analyzing relationships across devices, digital identifiers, and other data signals are important. Experience in identity resolution, AdTech, MarTech, or digital identity platforms will be a strong advantage.
The team also explores AI/ML concepts and AI-assisted development approaches to improve engineering productivity and enable innovative solutions. This is a hybrid position and involves regular performance of job responsibilities virtually as well as in-person at an assigned TU office location for a minimum of two days a week.

Role Overview And Core Responsibilities

* Design, develop, test, and maintain scalable data processing applications using Apache Spark and Scala.
* Build and operate production-grade distributed data pipelines capable of processing terabytes of data per execution.
* Develop and maintain recurring batch processing workloads, including weekly and scheduled pipelines, ensuring timely completion, reliability, and data quality.
* Optimize large-scale Spark jobs for execution time, memory utilization, parallelism, resource consumption, and cloud infrastructure costs.
* Design robust data processing workflows with appropriate error handling, retries, checkpointing, recovery mechanisms, and idempotency.
* Monitor production jobs, troubleshoot failures and performance bottlenecks, and perform root-cause analysis to ensure operational stability.
* Develop cloud-based data engineering solutions, preferably on Google Cloud Platform (GCP), with AWS experience also considered.
* Work with technologies such as Google Dataproc, BigQuery, cloud object storage, Parquet, and equivalent cloud data services.
* Write clean, efficient, reusable, and maintainable code using Scala, Python, and shell scripting.
* Apply strong analytical and problem-solving skills to resolve complex data processing and distributed computing challenges.
* Contribute to platform enhancements, automation, workflow orchestration, and continuous improvement of data engineering systems.
* Leverage AI/ML concepts and AI-assisted development tools where appropriate to improve development productivity and engineering quality.
* Collaborate with engineers, architects, and cross-functional stakeholders to deliver scalable, reliable, and maintainable solutions.
* Follow software engineering best practices, including code reviews, automated testing, version control, CI/CD, monitoring, and production support.


Required Knowledge And Experiences

Core technical requirements

* Strong hands-on experience with Apache Spark and Scala for distributed data processing.
* Demonstrated experience designing, developing, and operating production-grade data pipelines processing terabytes of data per run.
* Experience managing large-scale recurring batch workloads, preferably weekly or more frequently, with responsibility for successful execution, performance, reliability, and data quality.
* Strong understanding of Spark performance optimization, including partitioning, shuffles, joins, caching, memory management, parallelism, and resource tuning.
* Experience troubleshooting failed or slow-running production jobs and implementing robust recovery, retry, and fault-tolerance mechanisms.
* Working knowledge of cloud platforms, preferably Google Cloud Platform (GCP); AWS experience is also acceptable.
* Familiarity with GCP Dataproc, BigQuery, cloud object storage, and distributed data formats such as Parquet, or equivalent AWS technologies.
* Proficiency in Python and shell scripting for automation, data processing, and operational workflows.
* Strong analytical thinking, problem-solving, debugging, and root-cause analysis skills.
* Good understanding of distributed computing, data structures, algorithms, and software engineering fundamentals.
* Familiarity with Git, CI/CD, automated testing, workflow orchestration, and production monitoring.

Preferred qualifications

* Experience operating terabyte-scale Spark workloads in production with defined execution schedules and delivery SLAs.
* Experience processing billions of records, handling incremental data loads, and optimizing large-scale data transformations.
* Experience with cloud cost optimization, workload sizing, capacity planning, and resource utilization.
* Exposure to machine learning pipelines, identity resolution, entity resolution, or graph-based data processing.
* Basic understanding of AI/ML concepts and familiarity with LLMs, generative AI, or AI-assisted software development tools.
* Ability to independently own complex engineering problems from design and implementation through production deployment and ongoing operations.

* Experience in identity resolution, identity graphs, entity resolution, or digital identity platforms, including linking and reconciling identifiers across multiple data sources.
*Experience in MarTech (Marketing Technology) or AdTech (Advertising Technology), particularly with digital identifiers such as mobile advertising IDs, cookies, IP addresses, device signals, or email identifiers.
*Familiarity with audience segmentation, household or individual identity mapping, cross-device identity, or identity graph construction.


TransUnion Overview:

At TransUnion, we encourage and are committed to creating a real, positive impact and shared sense of purpose within our Workforce for Good, which empowers our people to grow, innovate and contribute to a better future for our communities and customers. We strive to build an environment where our associates are in the driver’s seat of their professional development— while having access to help along the way. We recognize that success comes when our associates thrive both professionally and personally; that’s why we prioritize work/life flexibility and offer resources for our teams across the globe to collaborate and drive excellence.

 

Be a part of our Workforce for Good – you’ll work with great people, pioneering products and cutting-edge technology.


TransUnion Job Title



Sr Developer, Software Development
¿Listo para postularte en TransUnion?
Postúlate en TransUnion

Sobre TransUnion

View TransUnion's Job Applicant Privacy Notice TransUnion is a global information and insights company with over 12,000 associates operating in more than 30 countries. We make trust possible by ensuring each person is reliably represented in the marketplace. We do this with a Tru™ picture of each person: an actionable view of consumers, stewarded with care. Through our acquisitions and technology investments we have developed innovative solutions that extend beyond our strong foundation in core credit into areas such as marketing, fraud, risk and advanced analytics. As a result, consumers and businesses can transact with confidence and achieve great things. We call this Information for Good®

Ver todos los empleos en TransUnion →

Empleos similares

TransUnion
Account Manager - Insurance Marketing
TransUnion
⚡ Postúlate pronto Chicago - 555 West Adams St Presencial $75,750–$126,250
● Nuevo 👁 Visto ✓ Postulado hace 37m
TransUnion
Major Account Executive Banking
TransUnion
⚡ Postúlate pronto TUM - D.F. Del. Miguel Hidalgo Presencial
● Nuevo 👁 Visto ✓ Postulado hace 37m
TransUnion
Senior Director, Developer Experience
TransUnion
⚡ Postúlate pronto Chicago - 555 West Adams St Híbrido $187,500–$312,500
● Nuevo 👁 Visto ✓ Postulado hace 37m
TransUnion
Senior Finance Manager
TransUnion
⚡ Postúlate pronto Makati City Híbrido
● Nuevo 👁 Visto ✓ Postulado hace 9h
TransUnion
Data Analyst
TransUnion
⚡ Postúlate pronto Hyderabad Híbrido
● Nuevo 👁 Visto ✓ Postulado hace 9h
TransUnion
Managers, Data Science & Analytics
TransUnion
⚡ Postúlate pronto New York, New York Presencial $187,615–$187,615
● Nuevo 👁 Visto ✓ Postulado hace 1d
TransUnion
Data Science & Analytics Internship - Summer 2027
TransUnion
⚡ Postúlate pronto Chicago, Illinois Híbrido
● Nuevo 👁 Visto ✓ Postulado hace 1d
TransUnion
Senior Analysts, Data Science & Analytics
TransUnion
⚡ Postúlate pronto White Plains, New York Presencial $115,045–$115,045
● Nuevo 👁 Visto ✓ Postulado hace 1d
TransUnion
Data Scientist
TransUnion
⚡ Postúlate pronto Chicago, Illinois Híbrido $67,500–$112,500
● Nuevo 👁 Visto ✓ Postulado hace 1d

Regístrate para recibir sugerencias adaptadas a los empleos que abres y las búsquedas que guardas.

Más empleos en TransUnion

Ver todos los empleos en TransUnion →

Postúlate ahora
🤖

Un momento — para

JobsRadar se creó para personas reales que están pasando un mal momento en su búsqueda de empleo — no para solicitudes automatizadas. Estás haciendo clic demasiado rápido y ahora estás bloqueado temporalmente.

Vuelve más tarde. Si de verdad estás buscando empleo, cuentas con nosotros — solo compórtate como una persona.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Toma ventaja en tu búsqueda de empleo.

Únete a nuestro canal de Telegram para lo que te ayuda a conseguir el puesto — referencias salariales, el pulso semanal del mercado y avisos de nuevas funciones. Sin spam, solo señal.

Únete al canal — es gratis