
Senior Data Engineer
Low Carbon Contracts Company
full-time
Posted on:
Location Type: Hybrid
Location: Leeds • United Kingdom
Visit company websiteExplore more
Salary
💰 £72,000 per year
Job Level
About the role
- Own, design, develop and maintain LCCCs data platform ensuring reliable data across the organisation
- Extensive hands‑on experience designing and delivering scalable, resilient cloud‑based data lake platforms using modern lakehouse architectures
- Drive better data governance through the creation and embedding of principles and processes
- Build and maintain key data governance and management artefacts e.g., Flow Diagram, Data Dictionary, KPI Catalogue
- Define overall approach and data flow for Extract, Transform and Load; and application of this for a given deployment/project
- Identify patterns, anomalies, and structure of data in preparation for Extract Transformation and Load
- Design and implement data pipelines and processes based on business requirements
- Write ETL data validation and data reconciliation queries
- Define high level and low-level design of a data platform to ensure robustness e.g., restorability, traceability, ease to support, etc.
- Define, embed, and drive data management and governance approaches, principles, and processes
- Identify data quality issues through data profiling, analysis, and stakeholder engagement
- Design and maintain the Microsoft Azure modern Datawarehouse architecture, implementation, administration, and support
- Translate complex business requirements into clear, scalable technical designs and delivery plans, ensuring alignment between stakeholder outcomes and engineering execution
Requirements
- Extensive experience in Cloud (preferably Microsoft Azure) Datawarehouse architecture as well as cloud data lakehouse platforms
- Experience of ETL and ELT processes, working with database architecture
- Able to develop and optimise coding in SQL and python
- Experience in creating data pipelines using Cloud (preferably Azure Data Factory)
- Experience with Cloud: ADLS, Databricks, SQL DW, Serverless Architecture
- Experience in CI/CD pipelines and monitoring
- Able to work with large datasets and extrapolate conclusions
- Strong analytical and critical thinking abilities
- Highly desirable: Experience in building and maintaining reliable and scalable ETL on big data platforms as well as experience working with varied forms of data infrastructure
- Data Engineering experience in Microsoft stack
Benefits
- Annual performance based bonus, up to 10%
- 25 days annual leave, plus eight bank holidays
- Up to 8% pension contribution
- Financial support and time off for study relevant to your role, plus a professional membership subscription
- Employee referral scheme (up to £1500), and colleague recognition scheme
- Family friendly policies, including enhanced maternity leave and shared parental leave
- Free, confidential employee assistance, including financial management, family care, mental health, and on-call GP service
- Three paid volunteering days a year
- Season ticket loan and cycle to work schemes
- Family savings on days out and English Heritage, gym discounts, cash back and discounts at selected retailers
- Employee resource groups
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data platform designcloud-based data lakedata governanceETL processesdata pipelinesSQLPythondata validationdata profilingdata engineering
Soft Skills
analytical thinkingcritical thinkingstakeholder engagement