
Senior Data Engineer, AWS
Evnek
contract
Posted on:
Location Type: Hybrid
Location: Bangalore • India
Visit company websiteExplore more
Job Level
About the role
- Design, develop, and maintain scalable data processing pipelines using Python, PySpark, and Spark SQL
- Build and optimize distributed data processing workflows on AWS platforms.
- Leverage AWS data services such as EMR, Glue, Lambda, and S3 for batch and real-time data processing.
- Design and manage data storage solutions using RDS/MySQL, Redshift , and other AWS-native databases.
- Implement effective data modeling, schema design, and schema evolution strategies.
- Perform performance tuning and optimization of Spark jobs and SQL queries.
- Monitor and troubleshoot data pipelines using AWS CloudWatch and logging frameworks.
- Manage secrets and credentials securely using AWS Secrets Manager.
- Collaborate with data architects, analysts, and stakeholders to translate business requirements into technical solutions.
- Debug complex data issues and provide root cause analysis with long-term fixes.
- Ensure data quality, reliability, and scalability across platforms
Requirements
- 10–13 years of overall experience in Data Engineering
- Strong proficiency in Python and SQL
- Extensive hands-on experience with PySpark and Spark SQL
- Strong experience with AWS data services , including: EMR Glue Lambda S3 RDS / MySQL Redshift CloudWatch Secrets Manager
- Solid understanding of distributed computing concepts
- Strong experience in data modeling, schema handling, and performance tuning
- Excellent debugging, analytical, and problem-solving skills.
- Ability to work effectively in a hybrid and collaborative environment
Benefits
- Immediate joiners only
- Hybrid work mode
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
PythonSQLPySparkSpark SQLdata modelingschema designperformance tuningdebuggingdata processing
Soft skills
analytical skillsproblem-solving skillscollaborationcommunication