Lead Data Engineer
The Walt Disney Company
AirflowAmazon RedshiftDistributed SystemsETLPySparkPythonSparkSQL
Senior Data Engineer
CGS Federal (Contact Government Services)
full-time
Posted on:
Location Type: Hybrid
Location: Los Angeles • California • 🇺🇸 United States
Visit company websiteSalary
💰 $144,768 - $209,109 per year
Job Level
Senior
Tech Stack
ETLPostgresPythonSQL
About the role
- Complete development efforts across data pipeline to store, manage, store, and provision to data consumers.
- Being an active and collaborating member of an Agile/Scrum team and following all Agile/Scrum best practices.
- Write code to ensure the performance and reliability of data extraction and processing.
- Support continuous process automation for data ingest.
- Achieve technical excellence by advocating for and adhering to lean-agile engineering principles and practices such as API-first design, simple design, continuous integration, version control, and automated testing.
- Work with program management and engineers to implement and document complex and evolving requirements.
- Help cultivate an environment that promotes customer service excellence, innovation, collaboration, and teamwork.
- Collaborate with others as part of a cross-functional team that includes user experience researchers and designers, product managers, engineers, and other functional specialists.
Requirements
- Must be a US Citizen.
- Must be able to obtain a Public Trust Clearance.
- 7+ years of IT experience including experience in design, management, and solutioning of large, complex data sets and models.
- Experience with developing data pipelines from many sources from structured and unstructured data sets in a variety of formats.
- Proficiency in developing ETL processes, and performing test and validation steps.
- Proficiency to manipulate data (Python, R, SQL, SAS).
- Strong knowledge of big data analysis and storage tools and technologies.
- Strong understanding of the agile principles and ability to apply them.
- Strong understanding of the CI/CD pipelines and ability to apply them.
- Experience with relational database, such as, PostgreSQL.
- Work comfortably in version control systems, such as, Git Repositories.
Benefits
- Health, Dental, and Vision
- Life Insurance
- 401k
- Flexible Spending Account (Health, Dependent Care, and Commuter)
- Paid Time Off and Observance of State/Federal Holidays
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data pipeline developmentETL processesdata manipulationPythonRSQLSASbig data analysisPostgreSQLCI/CD pipelines
Soft skills
collaborationcustomer service excellenceinnovationteamworkagile principlesproblem-solvingcommunicationadaptabilityleadershipcross-functional teamwork
Certifications
Public Trust Clearance
