Urbansoft™

AWS Data Engineer

Urbansoft™

contract

Posted on:

Location Type: Hybrid

Location: Johannesburg • South Africa

Visit company website

Explore more

✨ AI Apply
Apply

Tech Stack

Amazon RedshiftApacheAWSETLPySparkPythonSparkSQL

About the role

  • Design, develop, and maintain scalable data pipelines using AWS services.
  • Write efficient and maintainable Python and PySpark code for data processing.
  • Implement and manage ETL processes using AWS Glue.
  • Develop and optimize SQL queries for data extraction and transformation.
  • Utilize AWS Athena for querying and analyzing large datasets.
  • Work with AWS Redshift for data warehousing solutions.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Ensure data quality and integrity across various data sources.
  • Monitor and troubleshoot data pipeline issues to ensure smooth operations.
  • Stay updated with the latest industry trends and best practices in data engineering and AWS technologies.

Requirements

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • 4+ years of experience in data engineering or a related role.
  • Must be strong in MDM knowledge: Experience with building or integrating MDM systems — e.g., designing golden records, matching/merging, data mastering, data stewardship workflows.
  • Python: Proficient in writing Python code for data processing and automation.
  • Spark: Strong understanding of Apache Spark and experience with PySpark.
  • AWS Data Stack: Glue, S3, Lambda, Redshift, Athena, Step Functions.
  • SQL: Advanced skills in SQL, with the ability to write complex queries.
  • AWS Athena: Experience with AWS Athena for querying large datasets.
  • Redshift: Familiarity with AWS Redshift, including data warehousing concepts and usage.
  • Data Warehousing: Solid understanding of data warehousing principles and best practices.
Benefits
  • Remote work options
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
PythonPySparkSQLETLAWS GlueAWS AthenaAWS RedshiftData WarehousingData ProcessingData Quality
Soft Skills
CollaborationCommunicationProblem SolvingMonitoringTroubleshooting
Certifications
Bachelor's degree in Computer ScienceBachelor's degree in Information Technology