Data Engineer

Describe what the person will do in the role - how he/she will impact the organisation. The Data Engineer will help us in the ongoing mission of delivering outstanding services to our users allowing Disney Entertainment to be more data-driven. You will work closely with the senior members of our team to monitor and drive improvements for reliability and observability of critical data pipelines and deliverables. This is a high-impact role where your work informs decisions affecting millions of consumers, with a direct tie to The Walt Disney Company's revenue.

You will be making an outsized impact in an organisation that values data as its top priority. We are a tight and driven team with big goals, so we seek people who are passionate about solving the toughest challenges and working at scale, using, supporting, and building distributed systems in a fast-paced collaborative team environment. The candidate will also be required to work on-call shifts and weekend shifts on rotation. We also support a healthy work-life balance.

Responsibilities:

• You will assist with on-call rotations as an Incident Commander to help categorise and track real-time data incidents, and loop in engineering resources as needed to ensure a timely resolution.
• You will help drive our problem management process to ensure the root cause of data incidents is analysed and understood, and follow-up work is prioritised with our partner teams.
• You will play a key role in our long-term Incident and Problem Management strategy by contributing to the development of a Data Reliability Observability Platform that will assist in quantifying incident impacts, automate issue detection and track the overall health of our data and data pipelines.
• You will partner with our support and data quality teams, defining success KPI's, ensuring observability and automation coverage of our pipelines and helping create dashboards and visualisations for teams to monitor the overall health of our data

Requirements:

• Inclusive of Licenses/Certs (include functional experience as well as behavioural attributes and/or leadership capabilities).
• 3+ years of relevant data engineering experience.
• Good understanding of data modelling principles, including dimensional modelling and data normalisation principles.
• Experience with process engineering and continuous improvement.
• Detailed problem-solving approach, coupled with a strong sense of drive and ownership.
• Strong communication skills - written and verbal presentations.
• Comfortable working in a fast-paced and highly collaborative environment.
• Familiarity with Agile Scrum principles and ceremonies.

Preferred Qualifications:

• 2+ years of work experience implementing and reporting on business key performance indicators in data warehousing environments; exposure to reliability engineering best practices is a plus.
• 2+ years of experience using analytic SQL, working with traditional relational databases and/or distributed systems (Snowflake or Redshift), required.
• 1+ years of experience with programming languages (e. g., Python, Pyspark), preferred.
• Experience with Snowflake, Databricks/EMR/Spark, and/or Airflow.
• Bachelor's degree in computer science, information systems, or related field or equivalent work experience.