Lead Data Engineer
The Walt Disney Company
AirflowAmazon RedshiftDistributed SystemsETLPySparkPythonSparkSQL
Data Engineer
CGS Federal (Contact Government Services)
full-time
Posted on:
Location Type: Hybrid
Location: New York City • New York • 🇺🇸 United States
Visit company websiteSalary
💰 $112,597 - $152,811 per year
Job Level
SeniorLead
Tech Stack
ETLPostgresPythonSQL
About the role
- -Complete development efforts across data pipeline to store, manage, store, and provision to data consumers.
- -Being an active and collaborating member of an Agile/Scrum team and following all Agile/Scrum best practices.
- -Write code to ensure the performance and reliability of data extraction and processing.
- -Support continuous process automation for data ingest.
- -Achieve technical excellence by advocating for and adhering to lean-agile engineering principles and practices such as API-first design, simple design, continuous integration, version control, and automated testing.
- -Work with program management and engineers to implement and document complex and evolving requirements.
- -Help cultivate an environment that promotes customer service excellence, innovation, collaboration, and teamwork.
- -Collaborate with others as part of a cross-functional team that includes user experience researchers and designers, product managers, engineers, and other functional specialists.
Requirements
- -Must be a US Citizen.
- -Must be able to obtain a Public Trust Clearance.
- -7+ years of IT experience including experience in design, management, and solutioning of large, complex data sets and models.
- -Experience with developing data pipelines from many sources from structured and unstructured data sets in a variety of formats.
- -Proficiency in developing ETL processes, and performing test and validation steps.
- -Proficiency to manipulate data (Python, R, SQL, SAS).
- -Strong knowledge of big data analysis and storage tools and technologies.
- -Strong understanding of the agile principles and ability to apply them.
- -Strong understanding of the CI/CD pipelines and ability to apply them.
- -Experience with relational database, such as, PostgreSQL.
- -Work comfortably in version control systems, such as, Git Repositories.
Benefits
- -Health, Dental, and Vision
- -Life Insurance
- -401k
- -Flexible Spending Account (Health, Dependent Care, and Commuter)
- -Paid Time Off and Observance of State/Federal Holidays
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data pipeline developmentETL processesdata manipulationPythonRSQLSASbig data analysisPostgreSQLCI/CD pipelines
Soft skills
collaborationcustomer service excellenceinnovationteamworkagile principlesproblem-solvingcommunicationleadershipadaptabilitycross-functional teamwork
