Jobs › Companies › Weekday AI › Lead Data Engineer

À propos de ce poste Lead Data Engineer chez Weekday AI

Weekday AI · Sur site · Delhi, Delhi, India

𝗧𝗵𝗶𝘀 𝗿𝗼𝗹𝗲 𝗶𝘀 𝗳𝗼𝗿 𝗼𝗻𝗲 𝗼𝗳 𝘁𝗵𝗲 𝗪𝗲𝗲𝗸𝗱𝗮𝘆'𝘀 𝗰𝗹𝗶𝗲𝗻𝘁𝘀

𝗦𝗮𝗹𝗮𝗿𝘆 𝗿𝗮𝗻𝗴𝗲: 𝗥𝘀 𝟰𝟬𝟬𝟬𝟬𝟬𝟬 - 𝗥𝘀 𝟲𝟬𝟬𝟬𝟬𝟬𝟬 (𝗶𝗲 𝗜𝗡𝗥 𝟰𝟬-𝟲𝟬 𝗟𝗣𝗔)

Experience: 6+ yrs

Location: NCR, Delhi, India

As a Lead Data Engineer, you will spearhead the design, development, and optimization of large-scale data pipelines that support both batch and real‑time data processing initiatives across the organization. You will collaborate closely with data scientists, product managers, and infrastructure teams to ensure data integrity, scalability, and high performance at every stage of the pipeline, while driving continuous improvement through automation, monitoring, and best practices. Your leadership will shape the data architecture, protect data quality, and enable timely, actionable insights that inform business decisions. In a fast‑moving environment, you will balance technical excellence with strategic vision, fostering a culture of collaboration and innovation within the data engineering team.

Requirements

𝗞𝗲𝘆 𝗥𝗲𝘀𝗽𝗼𝗻𝘀𝗶𝗯𝗶𝗹𝗶𝘁𝗶𝗲𝘀

• Design and implement robust, end‑to‑end batch data pipelines using tools such as Apache Spark, Hadoop, and Airflow.

• Develop real‑time streaming pipelines with technologies like Apache Kafka, Flink, or Spark Structured Streaming to deliver low‑latency analytics.

• Optimize pipeline performance through partitioning, indexing, and efficient data format selection (e.g., Parquet, ORC).

• Establish data governance, quality checks, and automated monitoring to ensure data reliability and compliance.

• Lead capacity planning and scaling strategies for data infrastructure, including cluster management and cost optimization.

• Mentor and coach junior data engineers, fostering a collaborative and growth‑oriented team culture.

• Collaborate with Data Scientists to translate analytical requirements into scalable pipeline solutions.

• Drive integration of data pipelines with downstream applications, dashboards, and reporting tools.

• Stay current with emerging data engineering technologies and evaluate their applicability to business needs.

• Participate in incident response and root cause analysis to quickly resolve data pipeline failures.

𝗪𝗵𝗮𝘁 𝗠𝗮𝗸𝗲𝘀 𝗬𝗼𝘂 𝗮 𝗚𝗿𝗲𝗮𝘁 𝗙𝗶𝘁

• 6+ years of experience in data engineering with a proven track record in both batch and real‑time processing.

• Deep knowledge of distributed computing frameworks such as Hadoop, Spark, and Flink.

• Proficiency in message queuing and stream processing systems like Kafka, Pulsar, or RabbitMQ.

• Strong scripting skills in Python, Scala, or Java, and experience with SQL on large datasets.

• Hands‑on experience with cloud data services (AWS Glue, Redshift, BigQuery, Snowflake, or Azure Data Factory).

• Familiarity with containerization (Docker, Kubernetes) and CI/CD pipelines for data workloads.

• Demonstrated ability to architect and scale data pipelines to handle petabyte‑scale volumes.

• Excellent communication skills, capable of translating technical concepts for non‑technical stakeholders.

• A proactive problem‑solver with a passion for data quality, governance, and automation.

• Leadership aptitude, with experience building, mentoring, and growing data engineering teams.

Prêt à postuler chez Weekday AI ?
Postuler chez Weekday AI

À propos de Weekday AI

At Weekday (backed by YC; also Product Hunt #1 product of the day), we are building the next frontier in hiring. We have built the largest database of white collar talent in India and have built outreach tools on top of it to generate highest response rates.

Voir tous les emplois chez Weekday AI →

Emplois similaires

CA
Lead Engineer, Data Platform
Careers at Tide
⚡ Postuler tôt India, Delhi NCR Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 12 h
Smart Working Solutions
Senior Python Engineer - Data ( Remote, Full-Time) [AS340]
Smart Working Solutions
⚡ Postuler tôt India · lieu restreint
● Nouveau 👁 Vu ✓ Postulé il y a 3 j
Rockwell Automation
Senior Data Engineer
Rockwell Automation
⚡ Postuler tôt Pune, India Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 1 sem.
Smart Working Solutions
Senior Data Engineer / Developer (Remote, Full-Time) [HR221]
Smart Working Solutions
⚡ Postuler tôt India · lieu restreint
● Nouveau 👁 Vu ✓ Postulé il y a 2 sem.
Esri
Product Engineer - Geospatial Data Science
Esri
⚡ Postuler tôt New Delhi, Delhi, India Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 2 sem.
Rhombus Power, Inc.
Assistant Forward Deployment Data Engineer
Rhombus Power, Inc.
⚡ Postuler tôt New Delhi, Delhi, India Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 1 mois
WIN Home Inspection
Senior Data Engineer
WIN Home Inspection
⚡ Postuler tôt Delhi NCR Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 1 mois
WIN Home Inspection
Data Engineer
WIN Home Inspection
⚡ Postuler tôt Greater Delhi Area Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 1 mois
ERM
AI Data Solution Engineer
ERM
⚡ Postuler tôt New Delhi, India Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 3 mois

Inscrivez-vous pour des suggestions adaptées aux emplois que vous ouvrez et aux recherches que vous enregistrez.

Plus d’emplois chez Weekday AI

Voir tous les emplois chez Weekday AI →

Postuler maintenant
🤖

Doucement — un instant

JobsRadar a été conçu pour de vraies personnes qui traversent une période difficile dans leur recherche d’emploi — pas pour des requêtes automatisées. Vous cliquez beaucoup trop vite et vous êtes maintenant temporairement bloqué.

Revenez plus tard. Si vous cherchez réellement un emploi, nous sommes de votre côté — agissez simplement comme un être humain.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Prenez une longueur d’avance dans votre recherche d’emploi.

Rejoignez notre canal Telegram pour ce qui vous aide à décrocher le poste — références salariales, le pouls hebdomadaire du marché et les annonces de nouveautés. Pas de spam, que du signal.

Rejoindre le canal — c’est gratuit