
Data Engineer
invygo
full-time
Posted on:
Location Type: Hybrid
Location: Cairo • Egypt
Visit company websiteExplore more
Tech Stack
About the role
- Design, implement, and maintain ETL/ELT pipelines using AWS and custom scripts.
- Ensure robust data syncing between DWH and data sources.
- Develop and maintain scrapers of websites and mobile applications.
- Set up alerts and monitoring for data anomalies (e.g. missing data, syncing issues).
- Implement data quality assurance and validation frameworks.
- Improve query and system performance, including optimization of Redshift clusters, table vacuuming, and scheduling batch jobs.
- Work closely with DevOps for data flow integration across environments.
- Transition legacy ETLs to modern platforms and ensure scheduled exports run reliably.
- Eliminate redundant procedures and replace outdated solutions.
Requirements
- 3+ years of proven experience as a Data Engineer
- Excellent programming skills in Python and SQL.
- Hands-on experience with AWS (DMS, Redshift, S3, Glue).
- Familiarity with data scraping techniques and frameworks.
- Strong understanding of data warehousing concepts and performance tuning.
- Experience with data migration.
- Knowledge of DevOps practices and working in Agile environments.
- Ability to work independently and collaboratively in a fast-paced environment.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
ETLELTPythonSQLdata scrapingdata quality assurancedata validationperformance tuningdata migrationAWS
Soft Skills
independent workcollaborative workfast-paced environment