FREE ACCESS
5,000–10,000 jobs/day

See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.

Data Engineer
Talent SafariData Engineer at Paystack focusing on building and maintaining data pipelines and infrastructure. Collaborate with cross-functional teams on data ingestion, processing, and management.
Tech Stack
Tools & technologiesAirflowAmazon RedshiftApacheCloudETLJavaScriptKafkaKubernetesMongoDBMySQLPostgresPythonScalaSQLTableauTerraform
About the role
Key responsibilities & impact- Design, develop, and maintain robust data pipelines using ETL and ELT methodologies.
- Implement and manage real-time data streaming solutions utilizing Kafka, Debezium, and Kafka Connect.
- Build, schedule, and maintain custom workflows using Apache Airflow.
- Work with a variety of database technologies, including MySQL, PostgreSQL, MongoDB, and analytical/big data systems.
- Employ tools like Terraform, Kubernetes, and Helm to manage infrastructure efficiently.
- Develop and maintain continuous integration and deployment pipelines.
- Conduct unit and integration testing for high code quality, data integrity, and system reliability.
- Engage with cross-functional teams to understand data needs and deliver solutions.
- Maintain clear and comprehensive documentation of data processes, workflows, and systems.
- Monitor system performance and address faults in production systems.
Requirements
What you’ll need- Bachelor's degree in Computer Science, Engineering, or a related field.
- Proficiency in Python is essential.
- Knowledge of JavaScript and Scala is advantageous.
- Minimum of 3 years of experience in data engineering roles.
- Minimum of 2 years of experience in software and/or application development roles.
- Hands-on experience with Kafka, Debezium, and Kafka Connect.
- Proficiency in a data pipeline orchestration tool like Apache Airflow (preferred).
- Strong understanding and hands-on experience with MySQL, PostgreSQL, MongoDB, and Redshift.
- Experience with Terraform, Kubernetes, and Helm.
- Solid knowledge of cloud computing concepts.
- Ability to write complex SQL queries.
- Familiarity with unit and integration testing methodologies.
- Experience in setting up and maintaining CI/CD pipelines.
- Exposure to self-service reporting tools like Tableau, Looker, and DOMO.
Benefits
Comp & perks- Competitive salary
- Flexible working hours
- Professional development budget
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
ETLELTPythonJavaScriptScalaSQLunit testingintegration testingdata pipeline orchestrationdata engineering
Soft Skills
cross-functional collaborationcommunicationdocumentationproblem-solving
Certifications
Bachelor's degree in Computer ScienceBachelor's degree in Engineering