Jobs Companies State Street Delivery Lead – Data Engineering & Databricks (Architecture Focus) - Assistant Vice President

About this Delivery Lead – Data Engineering & Databricks (Architecture Focus) - Assistant Vice President role at State Street

State Street · Onsite · Hyderabad, India

Role Summary & Role Description:

  • The Delivery Lead will drive end-to-end delivery of data engineering platforms with a strong focus on Databricks and modern cloud-based architectures.
  • This role combines delivery leadership with deep technical ownership of solution architecture, ensuring scalable, secure, and high-performing data solutions aligned to business outcomes.
  • The individual will lead cross-functional global teams and act as a bridge between business stakeholders, architects, and engineering teams.

Key Responsibilities:

  • Own and drive end-to-end delivery of data engineering and analytics initiatives with strong governance and execution discipline.
  • Define and implement scalable data architecture using Databricks, cloud platforms, and big data technologies.
  • Lead solution design discussions and translate business requirements into robust technical architecture.
  • Establish delivery frameworks including Agile execution, release planning, and risk management.
  • Provide leadership to globally distributed teams and ensure alignment across engineering, QA, and business teams.
  • Drive stakeholder communication with clear reporting on delivery progress, risks, and mitigation plans.
  • Promote engineering excellence, code quality, and performance optimization practices across teams.

Data Engineering & Databricks Expertise (Primary Skill):

  • Strong hands-on experience with Databricks for building and managing data pipelines and workflows.
  • Expertise in Spark (Python/Scala) and distributed data processing frameworks.
  • Experience designing and implementing ETL/ELT pipelines on cloud platforms (AWS/Azure).
  • Deep understanding of data lakehouse architecture, Delta Lake, and modern data platforms.
  • Ability to optimize data processing performance, scalability, and cost-efficiency.
  • Experience in data governance, lineage, metadata management, and regulatory compliance requirements.

Architecture & Design Skills:

  • Proven experience in designing enterprise-scale data architecture and solutions.
  • Strong understanding of data modeling (conceptual, logical, physical) and integration design patterns.
  • Experience defining architecture standards, best practices, and design governance frameworks.
  • Ability to evaluate and recommend modern data tools and frameworks based on business needs.
  • Experience integrating on-premise systems with cloud-based data platforms.

Core / Must Have Skills:

  • 15+ years of experience in technology delivery with strong leadership exposure.
  • Extensive experience in Data Engineering and Big Data ecosystems (Hadoop, Spark, Databricks).
  • Strong programming expertise in Python/Scala and SQL.
  • Experience with cloud platforms such as AWS or Azure.
  • Strong understanding of CI/CD, DevOps, and data pipeline automation.
  • Excellent communication, stakeholder management, and leadership skills.

Good to Have Skills:

  • Experience with Kafka or other streaming technologies.
  • Knowledge of containerization tools such as Docker and Kubernetes.
  • Exposure to financial services or regulatory reporting environments.
  • Experience working in global, distributed teams across time zones.

Education & Experience:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
  • Proven experience leading large-scale transformation or data modernization programs.

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs at StateStreet.com/careers

Read our CEO Statement

Ready to apply to State Street?
Apply to State Street

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success. We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future. As an Equal Opportunity Employer, we consider all

See all jobs at State Street →

Similar jobs

State Street
Legal Counsel, Markets -Vice President
State Street
⚡ Apply early London, England Onsite
● New 👁 Seen ✓ Applied 8h ago
State Street
Third-Party Risk Management - Assistant Manager
State Street
⚡ Apply early Mumbai, India Onsite
● New 👁 Seen ✓ Applied 8h ago
State Street
Core Operations - Senior Associate
State Street
⚡ Apply early Bangalore, India Onsite
● New 👁 Seen ✓ Applied 8h ago
State Street
Alternative Investments Reporting Developer, Officer
State Street
⚡ Apply early Princeton, New Jersey Onsite $65,000–$106,250
● New 👁 Seen ✓ Applied 8h ago
State Street
IAM Engineering & Operations Lead, VP
State Street
⚡ Apply early Burlington Massachusetts Onsite $120,000–$202,500
● New 👁 Seen ✓ Applied 8h ago
State Street
Project Manager - Transfer Agency Product Change, Officer
State Street
⚡ Apply early Dublin 2, Ireland Onsite
● New 👁 Seen ✓ Applied 2d ago
State Street
Investment Compliance - Team Lead
State Street
⚡ Apply early Bangalore, India Onsite
● New 👁 Seen ✓ Applied 2d ago
State Street
Client Implementation Data Integration Analyst, Officer
State Street
⚡ Apply early Quincy, Massachusetts Onsite $60,000–$101,250
● New 👁 Seen ✓ Applied 2d ago
State Street
Senior SIEM & Security Platforms Engineer , Assistant Vice president
State Street
⚡ Apply early Kilkenny, Ireland Onsite
● New 👁 Seen ✓ Applied 2d ago

Sign up for suggestions tailored to the jobs you open and the searches you save.

More jobs at State Street

See all jobs at State Street →

Apply now
🤖

Whoa — hold up

JobsRadar was built for real people having a rough time in their job search — not for automated requests. You're clicking way too fast and you're now temporarily blocked.

Come back later. If you're genuinely job hunting, we've got your back — just act like a human.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Get an edge on your job hunt.

Join our Telegram channel for the stuff that helps you land the role — salary benchmarks, the weekly market pulse, and new-feature drops. No spam, just signal.

Join the channel — it's free