NorthBay Solutions

AWS Data Engineer

NorthBay Solutions

full-time

Posted on:

Location Type: Remote

Location: Remote • 🇮🇳 India

Visit company website
✨ AI Apply
Apply

Job Level

Mid-LevelSenior

Tech Stack

AirflowAmazon RedshiftApacheAWSDynamoDBEC2ETLPythonSparkSQL

About the role

  • Develop and maintain scalable batch data pipelines on AWS
  • Implement ETL/ELT jobs using AWS Glue and Spark on EMR
  • Build and manage workflow orchestration using Apache Airflow (MWAA)
  • Develop serverless data processing functions using AWS Lambda
  • Work with Amazon Redshift for data warehousing and analytics
  • Implement data storage and retrieval using Amazon DynamoDB
  • Use AWS DataZone for data discovery, governance, and access control
  • Monitor data pipelines and system health using Amazon CloudWatch
  • Troubleshoot data processing failures and performance issues
  • Collaborate with analytics, reporting, and business teams
  • Follow best practices for security, scalability, and cost optimization

Requirements

  • 5–8 years of experience in data engineering or related roles
  • Hands-on experience with: AWS Glue
  • Amazon EMR
  • AWS Lambda
  • Apache Airflow (MWAA)
  • Amazon EC2
  • Amazon CloudWatch
  • Amazon Redshift
  • Amazon DynamoDB
  • AWS DataZone
  • Strong SQL and Python skills
  • Experience with batch data processing and data pipeline development
  • Understanding of data warehousing and ETL concepts
  • Experience working in Agile delivery environments
Benefits
  • Health insurance
  • Remote work options

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
AWS GlueAmazon EMRAWS LambdaApache AirflowAmazon RedshiftAmazon DynamoDBAWS DataZoneSQLPythonETL
Soft skills
collaborationtroubleshootingproblem-solvingcommunicationorganizational