Senior Data Engineer, Azure Data and ETL
EUROPEAN DYNAMICS
AzureCloudETLMySQLOraclePostgresPySparkPythonScalaSparkSQL
Senior Data Engineer
StarCompliance
full-time
Posted on:
Location Type: Hybrid
Location: 🇬🇧 United Kingdom
Visit company websiteJob Level
Senior
Tech Stack
AzureCloudETLPythonSQL
About the role
- Enhance the Reference Data Master (RDM) platform to provide consistent, quality internal data products
- Design and build scalable, efficient, and fault-tolerant data products using predominantly T-SQL on SQL Server in Azure and Azure DevOps
- Contribute to the predominantly SQL codebase and investigate/solve data issues
- Work closely with Data team members to identify, refine and build enterprise-level solutions
- Review code, advise and share best-practices with other engineers
- Run spikes and POCs for new technical innovation and share findings
- Ensure the platform remains secure, well-monitored and performant
- Engage with stakeholders to understand requirements and demo work to stakeholders
- Play a key role in Agile ceremonies, backlog refinement, estimations, and ownership of tech-debt backlog
Requirements
- At least 3 years of experience in data engineering in a fast-paced, large-scale production environment
- Demonstrable expert skills in SQL, including efficient and performant query design
- Experience of programming/scripting languages (T-SQL / C# / PowerShell / Python)
- Experience building production systems utilising cloud systems, particularly Microsoft Azure
- Uses coding best practices and understands data architecture patterns
- Deep understanding/experience of ETL/ELT processes
- Familiar with utilizing CI/CD processes (e.g. Azure DevOps) and Git-based code repositories
- Familiar with building and executing automated unit-tests
- Work in an Agile development environment
- Excellent communication, collaboration, and problem-solving skills
- Must be able to undergo rigorous pre-employment background checks (criminal, credit, employment, qualifications, education)
ATS Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
T-SQLSQLC#PowerShellPythonETLELTCI/CDautomated unit-testsdata architecture patterns
Soft skills
communicationcollaborationproblem-solvingcode reviewbest practicesstakeholder engagementAgile methodologiesbacklog refinementestimationsownership
