Job Posting Title:

Req ID:

Job Description:

Disney Entertainment and ESPN Product & Technology Technology is at the heart of Disney’s past, present, and future. Disney Entertainment and ESPN Product & Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more – all working to build and advance the technological backbone for Disney’s media business globally.

The team marries technology with creativity to build world-class products, enhance storytelling, and drive velocity, innovation, and scalability for our businesses. We are Storytellers and Innovators. Creators and Builders. Entertainers and Engineers. We work with every part of The Walt Disney Company’s media portfolio to advance the technological foundation and consumer media touch points serving millions of people around the world.

Here are a few reasons why we think you’d love working here:

1. Building the future of Disney’s media: Our Technologists are designing and building the products and platforms that will power our media, advertising, and distribution businesses for years to come.

2. Reach, Scale & Impact: More than ever, Disney’s technology and products serve as a signature doorway for fans' connections with the company’s brands and stories. Disney+. Hulu. ESPN. ABC. ABC News…and many more. These products and brands – and the unmatched stories, storytellers, and events they carry – matter to millions of people globally.

3. Innovation: We develop and implement groundbreaking products and techniques that shape industry norms and solve complex and distinctive technical problems.

Commerce, Data & Identity provides the core product management functions for areas crucial to Disney’s media businesses. These include initiatives and products that power digital commerce, identity, and growth, as well as those that reach uniquely across The Walt Disney Company enterprise, such as messaging and privacy, among others. Additionally, it is responsible for the data engineering, science, and products for Disney Entertainment & ESPN, along with their interconnection with other parts of The Walt Disney Company.

Job Summary:

The Data Platforms Team, a segment under the Disney Entertainment and ESPN Product & Technology (DEEPT) organization is looking for a Lead Data Engineer to join our Sports & Preferences Data Team. Product Performance Data is critical to making product level decisions for the DEET Portfolio whether it’s related to product design, measuring advertising effectiveness, helping users discover new content or building new businesses in emerging markets. This data is deeply valuable and gives us insights into how we can continue improving our service for our users, advertisers and our content partners. Our Sports & Preferences data Engineering team is seeking a highly motivated Lead Data Engineer with a strong technical background who is passionate about designing and building systems to process data at scale to provide business value, create models and features that unlock powerful insights, and work across software and data disciplines to solve difficult unique problems at scale. Our tech stack includes AWS, Databricks, Airflow, Spark, Databricks and languages include Scala and Python.

Responsibilities and Duties of the Role:

• Contribute to the architecture, design and growth of our Data Products and Data pipelines in Scala and Python / Spark while maintaining uptime SLAs.

• Design and develop scalable data warehousing solutions, building ETL pipelines in Big Data cloud environments.

• Implement the Lakehouse architecture, working with key partners to shift towards a Lakehouse-centric data platform.

• Lead a module and be well versed with the Business functionality to support Data questions and analysis for the Business stakeholders.

• Able to understand Business Use Cases/ problems and provide relevant Business & technical solutions.

• Our tech stack includes AWS, Snowflake, Spark, Databricks, Delta Lake and Airflow and languages include Python, Scala.

• Collaborate with Data Product Managers, Data Architects and Data Engineers to design, implement, and deliver successful data solutions.

• Maintain detailed documentation of your work and changes to support data quality and data governance.

• Ensure high operational efficiency and quality of your solutions to meet SLAs and support commitment to our customers (Data Science, Data Analytics teams)

• Be an active participant and advocate of agile/scrum practice to ensure health and process improvements for your team.

• Be a problem solver; when presented with new challenges, you are expected to research and network to find solutions.

• Seek out answers to business problems and look for opportunities to automate processes & optimize Cost.

• Engage with and understand our customers, forming relationships that allow us to understand and prioritize both innovative new offerings and incremental platform improvements.

Required Education, Experience/Skills/Training:

Basic Qualifications

• At least 7 years of data engineering experience developing large data pipelines.

• Strong hands-on Experience with Cloud technologies like AWS (S3, EMR, EC2) and building data pipelines.

• Strong algorithmic problem-solving expertise

• Strong SQL skills and ability to create queries to extract data, build performant datasets and perform Data Analysis.

• Strong Hands-on experience with distributed systems such as Spark, Pyspark to query and process data.

• Strong fundamental Python programming skills.

• Solid experience with data integration toolsets (i.e Airflow) and writing and maintaining Data Pipelines with Databricks.

• Demonstrated competency in data modeling and analysis techniques.

• Strong attention to detail and excellent analytical skills

• Verbal and written communication skills and ability to collaborate with others effectively.

Preferred Qualifications

• Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake, Redshift, Big Query)

• Experience in Data Modeling techniques and Data Warehousing standard methodologies and practices

• Experience with Software Application development.

• Good data acumen to understand domain /functional knowledge and to be able to articulate analysis of data points in business context for stakeholders.

• Demonstrated excellent interpersonal skills, communication skills including ability to partner with others and build consensus in a cross-functional team toward a desired outcome.

• Experience working with a test first mentality.

• Deep Understanding of AWS or other cloud providers as well as infrastructure as code • Familiar with Scrum and Agile methodologies.

Required Education

• Bachelor’s degree in computer science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience

Job Posting Segment:

Job Posting Primary Business:

Primary Job Posting Category:

Employment Type:

Primary City, State, Region, Postal Code:

Alternate City, State, Region, Postal Code:

Date Posted: