
Data Engineer
workidentity GmbH
full-time
Posted on:
Location Type: Hybrid
Location: Hamburg • Germany
Visit company websiteExplore more
Salary
💰 €70,000 - €90,000 per year
About the role
- Build and maintain efficient, scalable data pipelines to collect, process, and store data from various sources.
- Ensure data quality, integrity, and availability.
- Design and implement database schemas and structures that enable optimal storage, querying, and processing of data.
- Develop, manage, and optimize ETL processes to extract, transform, and load data from various sources into target systems.
- Ensure timely and accurate data delivery.
- Use Snowflake and Azure Data Factory to manage cloud-based data warehousing and data integration processes.
- Ensure efficient data storage and accessibility.
- Integrate IoT data using Azure IoT Hub to enable real-time data processing and analysis.
- Implement and manage data workflows with Apache Airflow to automate and orchestrate ETL processes and other data-related tasks.
Requirements
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
- Minimum of 5 years' experience as a Data Engineer or in a comparable role.
- Solid experience with data pipeline tools and techniques.
- Strong expertise in Snowflake and Azure Data Factory.
- Experience integrating IoT data via Azure IoT Hub.
- Hands-on experience with Apache Airflow for workflow automation.
- Expert knowledge of ETL processes and related tools.
- Strong SQL skills and experience with relational databases.
- Familiarity with data modeling principles and best practices.
- Experience with data visualization tools, especially Microsoft Power BI.
- Knowledge of cloud computing concepts, particularly Microsoft Azure.
- Experience with additional cloud platforms such as AWS or Google Cloud.
- Familiarity with big data technologies like Hadoop, Spark, or Kafka.
- Experience with Python or other scripting languages.
- Knowledge of data governance and data quality frameworks.
- Very good German and English language skills required.
Benefits
- Permanent full-time position (37.5 hours/week for full-time)
- Flexible working hours
- Hybrid remote work solution (2–4 days remote per week possible)
- 30+ days of vacation
- Internal and external training opportunities
- Vacation pay, bonus payments, company pension (BAV) & capital-forming benefits (VWL)
- On-site gym, canteen with meal subsidies, commuting allowance, company bike (JobRad), employee & team events
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data pipelinesETL processesSQLdata modelingdata visualizationPythonHadoopSparkKafkadata governance
Soft Skills
data qualitydata integritydata availabilitytimely data deliveryworkflow automation