Jobs Companies eBay Unified Data Platform Architect

Sobre este puesto de Unified Data Platform Architect en eBay

eBay · Presencial · Bengaluru, India

At eBay, we're more than a global ecommerce leader — we’re changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in more than 190 markets around the world. We’re committed to pushing boundaries and leaving our mark as we reinvent the future of ecommerce for enthusiasts.

Our customers are our compass, authenticity thrives, bold ideas are welcome, and everyone can bring their unique selves to work — every day. We're in this together, sustaining the future of our customers, our company, and our planet.

Join a team of passionate thinkers, innovators, and dreamers — and help us connect people and build communities to create economic opportunity for all.

About the Role
We are looking for a Principal Software Engineer to provide technical leadership for the design and evolution of large-scale data platforms and distributed systems.
This is a senior individual contributor role with responsibility for solving complex, ambiguous engineering problems and establishing technical direction across multiple systems and teams. You will architect platforms that process and serve data at significant scale, combining large-scale batch and streaming computation with reliable backend services and cloud-native infrastructure.
The ideal candidate has deep expertise in distributed systems and data infrastructure, with strong hands-on experience in Java, Hadoop, Apache Spark, Apache Flink, Apache Airflow, and Kubernetes. Python experience is also important for data processing, platform automation, and engineering productivity.
You will remain technically hands-on while influencing architecture, engineering standards, and long-term platform strategy across the organization.
Responsibilities
  • Define the architecture and long-term technical direction for large-scale data platforms and distributed processing systems.
  • Lead the design of highly scalable, reliable backend and data infrastructure supporting business-critical workloads.
  • Architect and build high-performance backend services and platform components primarily in Java, with Python used where appropriate for data processing, orchestration, automation, and tooling.
  • Design and evolve large-scale batch and real-time data processing architectures using Apache Spark and Apache Flink.
  • Establish architectural patterns for data ingestion, transformation, computation, orchestration, storage, and serving across the data lifecycle.
  • Design reliable workflow and dependency-management capabilities using Apache Airflow and related orchestration technologies.
  • Define architecture and operational patterns for running large-scale data and backend workloads on Kubernetes.
  • Solve complex distributed-systems challenges involving scalability, state management, fault tolerance, consistency, partitioning, backpressure, resource management, and recovery.
  • Drive improvements in platform reliability, performance, observability, developer productivity, and infrastructure efficiency.
  • Identify systemic bottlenecks and lead architectural initiatives that improve throughput, latency, availability, and cost at scale.
  • Establish technical standards and reusable platform capabilities that enable multiple engineering and data teams.
  • Lead architecture reviews and provide technical guidance for high-impact initiatives spanning multiple systems and organizational boundaries.
  • Partner with architects, senior engineers, engineering leaders, product teams, data engineers, and infrastructure teams to translate business requirements into long-term technical strategy.
  • Mentor senior engineers and raise the technical bar through design reviews, code reviews, technical guidance, and engineering best practices.
  • Evaluate emerging technologies and make strategic build-versus-buy and architectural decisions for the data platform.
  • Lead complex migrations and modernization initiatives while maintaining production reliability and minimizing disruption to dependent systems.
Minimum Qualifications
  • 10+ years of software engineering experience, including significant experience designing and operating large-scale distributed systems or data platforms.
  • Deep expertise in Java and strong software engineering fundamentals.
  • Proficiency with Python for data engineering, automation, or platform development.
  • Extensive experience designing and building production backend services and distributed systems.
  • Deep hands-on experience with Apache Spark and large-scale distributed data processing.
  • Strong experience with the Hadoop ecosystem, including technologies such as HDFS, Hive, and YARN.
  • Experience designing and operating real-time or stateful streaming systems using Apache Flink.
  • Experience designing large-scale workflow orchestration using Apache Airflow or comparable technologies.
  • Strong production experience with Kubernetes, containers, and cloud-native application architectures.
  • Deep understanding of distributed-systems concepts including partitioning, replication, consistency, fault tolerance, distributed state, scheduling, resource management, and failure recovery.
  • Strong understanding of both batch and streaming architectures and the tradeoffs between different processing models.
  • Demonstrated experience driving architecture and technical decisions across multiple teams or major platform initiatives.
  • Proven ability to operate effectively in ambiguous problem spaces and turn broad business or platform requirements into executable technical strategies.
  • Track record of mentoring senior engineers and influencing engineering practices beyond an immediate team.
Preferred Qualifications
  • Experience architecting platforms processing petabyte-scale datasets and/or billions of events per day.
  • Deep knowledge of Apache Spark and Apache Flink.
  • Experience with modern data lake and lakehouse technologies such as Apache Iceberg
  • Experience designing multi-tenant data platforms, including workload isolation, resource governance, capacity management, and cost optimization.
  • Strong knowledge of data formats, partitioning strategies, schema evolution, metadata management, and data lifecycle management.
  • Experience with data governance, lineage, data quality, and platform observability.
  • Experience designing highly available control-plane or platform services supporting large numbers of internal users and workloads.
Core Technology Areas
Languages: Java, Python
Distributed Processing: Apache Spark, Apache Flink
Data Platform: Hadoop, HDFS, Hive, YARN, Iceberg
Streaming: Apache Kafka
Orchestration: Apache Airflow
Infrastructure: Kubernetes, Docker
Architecture: Distributed Systems, Batch & Streaming Processing, Data Lake/Lakehouse, Cloud-Native Data Infrastructu

Additional Details

eBay is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, veteran status, and disability, or other legally protected status. If you have a need that requires accommodation, please contact us at [email protected]. We will make every effort to respond to your request for accommodation as soon as possible. View our accessibility statement to learn more about eBay's commitment to ensuring digital accessibility for people with disabilities.

 

We use cookies to enhance your experience and may use AI tools for administrative tasks in the hiring process. To learn how we handle your personal data and use AI responsibly, please visit our Talent Privacy Notice, Privacy Center, and AI Hiring Guidelines.

¿Listo para postularte en eBay?
Postúlate en eBay

Sobre eBay

We Empower People and Create Economic Opportunity eBay Inc. (NASDAQ: EBAY) is a global commerce leader that connects millions of buyers and sellers around the world. We exist to enable economic opportunity for individuals, entrepreneurs, businesses and organizations of all sizes.

Ver todos los empleos en eBay →

Empleos similares

Hewlett Packard Enterprise
Enterprise Architect – ServiceNow & AI Automation
Hewlett Packard Enterprise
⚡ Postúlate pronto Bengaluru, Karnātaka, India Híbrido
● Nuevo 👁 Visto ✓ Postulado hace 57m
Wells Fargo
Principal Architect (Enterprise Architecture/ Application Mordernization)
Wells Fargo
⚡ Postúlate pronto Bengaluru, India Presencial
● Nuevo 👁 Visto ✓ Postulado hace 8h
Roku
Senior Anaplan Architect
Roku
⚡ Postúlate pronto Bengaluru, India Presencial
● Nuevo 👁 Visto ✓ Postulado hace 12h
MongoDB
Advisory Partner Solutions Architect
MongoDB
⚡ Postúlate pronto India Presencial
● Nuevo 👁 Visto ✓ Postulado hace 19h
Databricks
Solutions Architect
Databricks
⚡ Postúlate pronto Bengaluru, India Presencial
● Nuevo 👁 Visto ✓ Postulado hace 20h
1GLOBAL
Oracle ECE Architect - Lisbon Based
1GLOBAL
⚡ Postúlate pronto Lisbon, Lisbon, Portugal Presencial
● Nuevo 👁 Visto ✓ Postulado hace 1d
MI
Customer Value Architect
Mixpanel
⚡ Postúlate pronto Bengaluru, Karnataka, India (H... Híbrido
● Nuevo 👁 Visto ✓ Postulado hace 1d
MI
Senior Customer Value Architect
Mixpanel
⚡ Postúlate pronto Bengaluru, Karnataka, India (H... Híbrido
● Nuevo 👁 Visto ✓ Postulado hace 1d
GSK
VP, Chief Enterprise Architect
GSK
⚡ Postúlate pronto UK – London – New Oxford Stree... Presencial
● Nuevo 👁 Visto ✓ Postulado hace 1d

Regístrate para recibir sugerencias adaptadas a los empleos que abres y las búsquedas que guardas.

Más empleos en eBay

Ver todos los empleos en eBay →

Postúlate ahora
🤖

Un momento — para

JobsRadar se creó para personas reales que están pasando un mal momento en su búsqueda de empleo — no para solicitudes automatizadas. Estás haciendo clic demasiado rápido y ahora estás bloqueado temporalmente.

Vuelve más tarde. Si de verdad estás buscando empleo, cuentas con nosotros — solo compórtate como una persona.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Toma ventaja en tu búsqueda de empleo.

Únete a nuestro canal de Telegram para lo que te ayuda a conseguir el puesto — referencias salariales, el pulso semanal del mercado y avisos de nuevas funciones. Sin spam, solo señal.

Únete al canal — es gratis