
AWS Data Engineer
qode.world
full-time
Posted on:
Location Type: Remote
Location: United States
Visit company websiteExplore more
About the role
- Lead and support the delivery of data platform modernization projects.
- Design and develop robust and scalable data pipelines leveraging AWS native services.
- Optimize ETL processes, ensuring efficient data transformation.
- Migrate workflows from on-premise to AWS cloud, ensuring data quality and consistency.
- Design automations and integrations to resolve data inconsistencies and quality issues
- Perform system testing and validation to ensure successful integration and functionality.
- Implement security and compliance controls in the cloud environment.
- Ensure data quality pre- and post-migration through validation checks and addressing issues regarding completeness, consistency, and accuracy of data sets.
- Collaborate with data architects and lead developers to identify and document manual data movement workflows and design automation strategies.
Requirements
- 10+ years’ experience with a core data engineering skillset leveraging AWS native technologies (AWS Glue, Python, Snowflake, S3, Redshift).
- Experience in the design and development of robust and scalable data pipelines leveraging AWS native services.
- Proficiency in leveraging Snowflake for data transformations, optimization of ETL pipelines, and scalable data processing.
- Experience with streaming and batch data pipeline/engineering architectures.
- Familiarity with DataOps concepts and tooling for source control and setting up CI/CD pipelines on AWS.
- Hands-on experience with Databricks and a willingness to grow capabilities.
- Experience with data engineering and storage solutions (AWS Glue, EMR, Lambda, Redshift, S3).
- Strong problem-solving and analytical skills.
- Knowledge of Dataiku is needed
- Graduate/Post-Graduate degree in Computer Science or a related field.
- AWS S3 (data storage, export, recall)
- Athena (querying data lakes)
- Data pipelines (batch & near-real-time)
- Integration with external systems (FHIR)
- Secure data handling (KMS, Macie)
- Cloud-native analytics
- Multi-account, multi-region data architecture
- BI integrations: Power BI, Tableau, QuickSight
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
AWS GluePythonSnowflakeS3RedshiftETLDataOpsDatabricksAWS EMRAWS Lambda
Soft Skills
problem-solvinganalytical skills