Jobs โ€บ Companies โ€บ Weekday AI โ€บ Lead Data Engineer

About this Lead Data Engineer role at Weekday AI

Weekday AI ยท Onsite ยท Delhi, Delhi, India

๐—ง๐—ต๐—ถ๐˜€ ๐—ฟ๐—ผ๐—น๐—ฒ ๐—ถ๐˜€ ๐—ณ๐—ผ๐—ฟ ๐—ผ๐—ป๐—ฒ ๐—ผ๐—ณ ๐˜๐—ต๐—ฒ ๐—ช๐—ฒ๐—ฒ๐—ธ๐—ฑ๐—ฎ๐˜†'๐˜€ ๐—ฐ๐—น๐—ถ๐—ฒ๐—ป๐˜๐˜€

๐—ฆ๐—ฎ๐—น๐—ฎ๐—ฟ๐˜† ๐—ฟ๐—ฎ๐—ป๐—ด๐—ฒ: ๐—ฅ๐˜€ ๐Ÿฐ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ - ๐—ฅ๐˜€ ๐Ÿฒ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ (๐—ถ๐—ฒ ๐—œ๐—ก๐—ฅ ๐Ÿฐ๐Ÿฌ-๐Ÿฒ๐Ÿฌ ๐—Ÿ๐—ฃ๐—”)

Experience: 6+ yrs

Location: NCR, Delhi, India

As a Lead Data Engineer, you will spearhead the design, development, and optimization of large-scale data pipelines that support both batch and realโ€‘time data processing initiatives across the organization. You will collaborate closely with data scientists, product managers, and infrastructure teams to ensure data integrity, scalability, and high performance at every stage of the pipeline, while driving continuous improvement through automation, monitoring, and best practices. Your leadership will shape the data architecture, protect data quality, and enable timely, actionable insights that inform business decisions. In a fastโ€‘moving environment, you will balance technical excellence with strategic vision, fostering a culture of collaboration and innovation within the data engineering team.

Requirements

๐—ž๐—ฒ๐˜† ๐—ฅ๐—ฒ๐˜€๐—ฝ๐—ผ๐—ป๐˜€๐—ถ๐—ฏ๐—ถ๐—น๐—ถ๐˜๐—ถ๐—ฒ๐˜€

โ€ข Design and implement robust, endโ€‘toโ€‘end batch data pipelines using tools such as Apache Spark, Hadoop, and Airflow.

โ€ข Develop realโ€‘time streaming pipelines with technologies like Apache Kafka, Flink, or Spark Structured Streaming to deliver lowโ€‘latency analytics.

โ€ข Optimize pipeline performance through partitioning, indexing, and efficient data format selection (e.g., Parquet, ORC).

โ€ข Establish data governance, quality checks, and automated monitoring to ensure data reliability and compliance.

โ€ข Lead capacity planning and scaling strategies for data infrastructure, including cluster management and cost optimization.

โ€ข Mentor and coach junior data engineers, fostering a collaborative and growthโ€‘oriented team culture.

โ€ข Collaborate with Data Scientists to translate analytical requirements into scalable pipeline solutions.

โ€ข Drive integration of data pipelines with downstream applications, dashboards, and reporting tools.

โ€ข Stay current with emerging data engineering technologies and evaluate their applicability to business needs.

โ€ข Participate in incident response and root cause analysis to quickly resolve data pipeline failures.

๐—ช๐—ต๐—ฎ๐˜ ๐— ๐—ฎ๐—ธ๐—ฒ๐˜€ ๐—ฌ๐—ผ๐˜‚ ๐—ฎ ๐—š๐—ฟ๐—ฒ๐—ฎ๐˜ ๐—™๐—ถ๐˜

โ€ข 6+ years of experience in data engineering with a proven track record in both batch and realโ€‘time processing.

โ€ข Deep knowledge of distributed computing frameworks such as Hadoop, Spark, and Flink.

โ€ข Proficiency in message queuing and stream processing systems like Kafka, Pulsar, or RabbitMQ.

โ€ข Strong scripting skills in Python, Scala, or Java, and experience with SQL on large datasets.

โ€ข Handsโ€‘on experience with cloud data services (AWS Glue, Redshift, BigQuery, Snowflake, or Azure Data Factory).

โ€ข Familiarity with containerization (Docker, Kubernetes) and CI/CD pipelines for data workloads.

โ€ข Demonstrated ability to architect and scale data pipelines to handle petabyteโ€‘scale volumes.

โ€ข Excellent communication skills, capable of translating technical concepts for nonโ€‘technical stakeholders.

โ€ข A proactive problemโ€‘solver with a passion for data quality, governance, and automation.

โ€ข Leadership aptitude, with experience building, mentoring, and growing data engineering teams.

Ready to apply to Weekday AI?
Apply to Weekday AI

About Weekday AI

At Weekday (backed by YC; also Product Hunt #1 product of the day), we are building the next frontier in hiring. We have built the largest database of white collar talent in India and have built outreach tools on top of it to generate highest response rates.

See all jobs at Weekday AI โ†’

Similar jobs

CA
Lead Engineer, Data Platform
Careers at Tide
โšก Apply early India, Delhi NCR Onsite
โ— New ๐Ÿ‘ Seen โœ“ Applied 12h ago
Smart Working Solutions
Senior Python Engineer - Data ( Remote, Full-Time) [AS340]
Smart Working Solutions
โšก Apply early India ยท location restricted
โ— New ๐Ÿ‘ Seen โœ“ Applied 3d ago
Rockwell Automation
Senior Data Engineer
Rockwell Automation
โšก Apply early Pune, India Onsite
โ— New ๐Ÿ‘ Seen โœ“ Applied 1w ago
Smart Working Solutions
Senior Data Engineer / Developer (Remote, Full-Time) [HR221]
Smart Working Solutions
โšก Apply early India ยท location restricted
โ— New ๐Ÿ‘ Seen โœ“ Applied 2w ago
Esri
Product Engineer - Geospatial Data Science
Esri
โšก Apply early New Delhi, Delhi, India Onsite
โ— New ๐Ÿ‘ Seen โœ“ Applied 2w ago
Rhombus Power, Inc.
Assistant Forward Deployment Data Engineer
Rhombus Power, Inc.
โšก Apply early New Delhi, Delhi, India Onsite
โ— New ๐Ÿ‘ Seen โœ“ Applied 1mo ago
WIN Home Inspection
Senior Data Engineer
WIN Home Inspection
โšก Apply early Delhi NCR Onsite
โ— New ๐Ÿ‘ Seen โœ“ Applied 1mo ago
WIN Home Inspection
Data Engineer
WIN Home Inspection
โšก Apply early Greater Delhi Area Onsite
โ— New ๐Ÿ‘ Seen โœ“ Applied 1mo ago
ERM
AI Data Solution Engineer
ERM
โšก Apply early New Delhi, India Onsite
โ— New ๐Ÿ‘ Seen โœ“ Applied 3mos ago

Sign up for suggestions tailored to the jobs you open and the searches you save.

More jobs at Weekday AI

See all jobs at Weekday AI โ†’

Apply now
๐Ÿค–

Whoa โ€” hold up

JobsRadar was built for real people having a rough time in their job search โ€” not for automated requests. You're clicking way too fast and you're now temporarily blocked.

Come back later. If you're genuinely job hunting, we've got your back โ€” just act like a human.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Get an edge on your job hunt.

Join our Telegram channel for the stuff that helps you land the role โ€” salary benchmarks, the weekly market pulse, and new-feature drops. No spam, just signal.

Join the channel โ€” it's free