Software Mind

Senior Data Engineer – AWS

Software Mind

full-time

Posted on:

Location Type: Remote

Location: Poland

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

Amazon RedshiftAWSETLJenkinsPySparkPythonSparkSQL

About the role

  • Develop reusable, metadata-driven data pipelines with strong focus on database design and SQL optimization
  • Work extensively with AWS-based datasets and data infrastructure including Redshift, RDS, S3, Glue, Athena, and DMS
  • Support comprehensive ETL development and optimization using advanced SQL techniques and query performance tuning
  • Automate and optimize data platform processes leveraging AWS data services ecosystem
  • Build robust integrations with data sources and consumers using AWS native solutions
  • Proactively resolve performance and data quality issues through SQL optimization and database tuning
  • Leverage DBT for data transformation modeling and Jenkins/GitHub Actions for CI/CD automation
  • Contribute to platform documentation and runbooks with focus on database best practices
  • Propose and implement improvements to data platform architecture using AWS data services

Requirements

  • Strong database expertise: advanced SQL skills, comprehensive data modeling experience, and proven query optimization capabilities
  • AWS data services proficiency: hands-on experience with Redshift, RDS, S3, Glue, Athena, and DMS
  • ETL development: strong background in ETL development and optimization using database-centric approaches
  • Programming: Python/PySpark and advanced SQL for data pipeline development
  • Spark proficiency: expert-level skills in building data pipelines using Databricks on AWS or EMR/EMR Serverless
  • Large-scale data processing: extensive experience working with complex datasets and database performance optimization
  • Library development: skilled in building reusable data transformation modules as Python packages
  • CI/CD expertise: experience with GitHub Actions, Jenkins, and AWS CodePipeline for automated deployments
  • AWS networking/security: Understanding of VPC, subnets, security groups, and IAM
  • Agile methodology: familiar with Scrum development practices
Benefits
  • Flexible employment and remote work
  • International projects with leading global clients
  • International business trips
  • Non-corporate atmosphere
  • Language classes
  • Internal & external training
  • Private healthcare and insurance
  • Multisport card
  • Well-being initiatives
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
SQLETL developmentdata modelingPythonPySparkSparkDBTdata transformationquery optimizationdatabase tuning
Soft Skills
problem-solvingcommunicationcollaborationdocumentation