Skip to main content

Senior Data Engineer (Machine Learning, Personalization)

Apply NowApply Later NOTE: We have a new application system, please create a new account if you have not done so yet when applying. Job ID 7122794720220515 Location New York, New York, United States Business Disney Media & Entertainment Distribution Date posted Jul. 20, 2022 Flex Type Hybrid Preferred, Remote Possible

- This role is considered hybrid, which means the employee will work a portion of their time on-site from a Company designated location and the remainder of their time remotely. A remote opportunity may be possible for qualified candidates under certain circumstances and, if granted, the employee would work remotely on an ongoing basis.

Job Summary:

Data Engineers on the Disney Streaming Machine Learning and Innovation team develop and maintain systems and datasets that are used for content recommendation and personalization on Disney Streaming’s suite of streaming video apps, notably Disney+ and Hulu. In this role you will partner with Applied Machine Learning Engineers and Data Scientists to help manage and scale processes to create algorithm input features and datasets. As a member of this team you will collaborate across Engineering and Data teams to identify internal and external data sources to design and implement ETL strategy, automation frameworks, and scalable data pipelines.


  • Partner with technical and non-technical colleagues to understand algorithm feature and data requirements

  • Work with Engineering teams to collect required data from internal and external systems

  • Develop and maintain ETL routines using orchestration tools such as Airflow and Jenkins

  • Collaborate with machine learning practitioners to design and build data forward solutions

  • Deploy scalable streaming and batch data pipelines to support petabyte scale datasets

  • Enforce common data design patterns to increase code maintainability

  • Create ETL architecture designs and conduct reviews

  • Perform ad hoc data analysis as necessary

  • Partner with team leads to identify, design, and implement internal process improvements

  • Drive and maintain a culture of quality, innovation, and experimentation

  • Work in an Agile environment that focuses on collaboration and teamwork

Basic Qualifications:

  • 3+ years of data engineering experience

  • Bachelor’s degree in computer science, engineering, math, statistics, or relevant experience

  • Deep knowledge of the Python data ecosystem

  • Experience in building large datasets and scalable services

  • Experience deploying and running services in AWS and in engineering big-data solutions using technologies like Databricks, EMR, S3, and Spark

  • Experience loading and querying cloud-hosted databases such as Redshift and Snowflake

  • Experience designing and developing backend microservices for large scale distributed systems using gRPC or REST

  • Experience with large-scale distributed data processing systems and cloud infrastructure such as AWS or GCP and container systems such as Docker or Kubernetes

  • Excellent communication and people engagement skills

Preferred Qualifications:

  • Knowledge of the Scala and Java data ecosystems

  • Experience building streaming pipelines using Kafka, Spark, Flink, or Samza

  • Drive and maintain a culture of quality, innovation, and experimentation

  • Mentor colleagues on best practices and technical concepts of building large scale solutions

Additional Information:

Location: New York, NY, San Francisco, CA or Seattle, WA preferred but also open to US Remote for the right candidate


Additional Information!:


About Disney Media & Entertainment Distribution:

Comprised of the Company’s international business units and various direct-to-consumer streaming services, Disney Media & Entertainment Distribution (DMED) aligns technology, media distribution and advertising sales into a single business segment to create and deliver personalized entertainment experiences to consumers around the world.

About The Walt Disney Company:

The Walt Disney Company, together with its subsidiaries and affiliates, is a leading diversified international family entertainment and media enterprise with the following business segments: media networks, parks and resorts, studio entertainment, consumer products and interactive media. From humble beginnings as a cartoon studio in the 1920s to its preeminent name in the entertainment industry today, Disney proudly continues its legacy of creating world-class stories and experiences for every member of the family. Disney’s stories, characters and experiences reach consumers and guests from every corner of the globe. With operations in more than 40 countries, our employees and cast members work together to create entertainment experiences that are both universally and locally cherished.

This position is with Disney Streaming Technology LLC, which is part of a business we call Disney Media & Entertainment Distribution.

Disney Streaming Technology LLC is an equal opportunity employer. Applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Disney fosters a business culture where ideas and decisions from all people help us grow, innovate, create the best stories and be relevant in a rapidly changing world.

Apply NowApply Later

Watch Our Jobs

Sign up to receive new job alerts and company information based on your preferences.

For Disney Job Alerts to work, JavaScript must be enabled in your browser.