Data Engineer

• Design, develop, and maintain robust data pipelines using ETL and ELT methodologies.
• Implement and manage real-time data streaming solutions utilizing Kafka, Debezium, and Kafka Connect.
• Build, schedule, and maintain custom workflows using Apache Airflow.
• Work with a variety of database technologies, including MySQL, PostgreSQL, MongoDB, and analytical/big data systems.
• Employ tools like Terraform, Kubernetes, and Helm to manage infrastructure efficiently.
• Develop and maintain continuous integration and deployment pipelines.
• Conduct unit and integration testing for high code quality, data integrity, and system reliability.
• Engage with cross-functional teams to understand data needs and deliver solutions.
• Maintain clear and comprehensive documentation of data processes, workflows, and systems.
• Monitor system performance and address faults in production systems.

See all jobs on JobTailor

Data Engineer