Data Engineer
RWA.xyz
CloudSpark
Lead Data Engineer
The Walt Disney Company
full-time
Posted on:
Location Type: Hybrid
Location: Santa Monica • California, New York, Washington • 🇺🇸 United States
Visit company websiteSalary
💰 $152,200 - $204,100 per year
Job Level
Senior
Tech Stack
AirflowAmazon RedshiftDistributed SystemsETLPySparkPythonSparkSQL
About the role
- Lead the successful design and implementation of complex technical problems related to content performance metrics
- Lead and contribute to the design and growth of Data Products and Data Warehouses around content movements and metrics
- Partner with technical and non-technical colleagues to understand data and reporting requirements
- Collaborate with Data Product Managers, Data Architects and other Data Engineers to design, implement, and deliver data solutions
- Design table structures and define ETL pipelines to build performant, reliable, and scalable data solutions
- Source internal and external data and define ETL strategies
- Develop Data Quality checks and implement automated data quality monitoring
- Develop and maintain ETL routines using ETL and orchestration tools such as Airflow
- Serve as an advanced resource and mentor to junior data engineers, coaching to improve skills and productivity
Requirements
- 7+ years of data engineering experience developing large data pipelines
- Strong understanding of data modeling principles including Dimensional modeling and data normalization principles
- Good understanding of SQL engines and ability to conduct advanced performance tuning
- 4+ years of experience implementing and reporting on business key performance indicators in data warehousing environments (required/preferred as listed)
- 5+ years of experience using analytic SQL and working with traditional relational databases and/or distributed systems (Snowflake or Redshift) (required)
- 3+ years of experience with programming languages (e.g., Python, PySpark) (preferred)
- 3+ years of experience with data orchestration/ETL tools (Airflow, NiFi) (preferred)
- Experience with Snowflake, Databricks/EMR/Spark & Airflow a plus
- Familiarity with Agile Scrum principles and ceremonies
- Strong communication skills – written and verbal presentations
- Ability to think strategically, analyze and interpret market and consumer information
- Excellent conceptual and analytical reasoning competencies
- Bachelor’s Degree in Computer Science, Information Systems or related field, or equivalent work experience (Master’s Degree a plus)
Benefits
- A bonus and/or long-term incentive units may be provided
- Medical benefits
- Financial benefits
- Other benefits (unspecified)
- Primarily on-site with occasional work from home (flexible work arrangement)
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data engineeringdata modelingDimensional modelingdata normalizationSQLperformance tuninganalytic SQLETLdata orchestrationdata quality monitoring
Soft skills
communication skillsstrategic thinkinganalytical reasoningmentoringcollaboration
