AWS Glue Consultant
Datavail
full-time
Posted on:
Location Type: Hybrid
Location: Mumbai • India
Visit company websiteExplore more
About the role
- Design, develop, and maintain scalable ETL/ELT pipelines using AWS services (Glue, Lambda, Step Functions, EMR, etc.).
- Build and optimize data lakes and data warehouses using S3, Redshift, Lake Formation.
- Develop, manage, and optimize SQL/NoSQL data models.
- Implement real-time and batch data processing solutions using Kinesis, Kafka, or similar streaming platforms.
- Ensure data pipelines are reliable, scalable, secure, and cost optimized.
- Implement monitoring and logging using CloudWatch, SNS, and related services.
- Ensure data accuracy, consistency, and completeness across all systems.
- Implement data governance, lineage, and cataloging using Glue Data Catalog or similar tools.
- Work closely with data analysts, scientists, and business stakeholders to deliver trusted datasets.
- Work with cross functional teams to gather data requirements.
- Support BI/reporting teams with optimized datasets.
- Participate in code reviews and contribute to engineering best practices.
Requirements
- 8+ years of experience
- 3+ years of experience as a Data Engineer (or similar role).
- Strong expertise with AWS services such as: S3, Glue, Lambda, Athena, Redshift, EMR, DynamoDB, IAM.
- Proficiency in Python, SQL, and PySpark
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
ETLELTAWS GlueAWS LambdaAWS Step FunctionsAWS EMRSQLNoSQLPythonPySpark
Soft Skills
collaborationcommunicationproblem-solvingdata governancedata accuracydata consistencydata completenesscross-functional teamworkcode reviewengineering best practices