
Senior Data Engineer
Avenga
full-time
Posted on:
Location Type: Remote
Location: Poland
Visit company websiteExplore more
Job Level
About the role
- Design, develop, and optimize data pipelines and workflows using Azure Databricks and Python.
- Implement and maintain data solutions across the Azure Data Platform (Data Lake, Databricks, etc.).
- Develop and maintain APIs supporting data ingestion, data sharing, and interoperability.
- Collaborate closely with business stakeholders to gather requirements and translate them into technical solutions.
- Ensure data quality, security, and compliance across all solutions.
- Integrate data solutions into existing business processes and cross-functional systems.
- Continuously improve performance, cost-efficiency, and scalability of data systems.
Requirements
- Minimum of 4 years of professional experience as a Data Engineer
- Strong knowledge in IICS stack (Informatica Intelligent Cloud Services)
- Strong expertise in Azure Databricks, Python, Spark
- Solid experience with Azure Data Services, such as: Azure Data Lake and Azure Data Factory
- Experience in ingestion tools like: Qlik Recplicate / MQ / MQCC
- Experience with API development (REST/JSON or equivalent).
- Solid understanding of ETL processes, data modeling, and fundamental data architecture principles.
- Familiarity with CI/CD pipelines and version control (Git, etc.).
Benefits
- Private healthcare
- Sports card
- Private insurance
- Cafeteria system
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
PythonAzure DatabricksSparkETL processesdata modelingdata architectureAPI developmentRESTJSONIICS stack
Soft Skills
collaborationrequirement gatheringcommunicationproblem-solvingperformance improvement