Low Carbon Contracts Company

Senior Data Engineer

Low Carbon Contracts Company

full-time

Posted on:

Location Type: Hybrid

Location: LeedsUnited Kingdom

Visit company website

Explore more

AI Apply
Apply

Salary

💰 £72,000 per year

Job Level

About the role

  • Own, design, develop and maintain LCCCs data platform ensuring reliable data across the organisation
  • Extensive hands‑on experience designing and delivering scalable, resilient cloud‑based data lake platforms using modern lakehouse architectures
  • Drive better data governance through the creation and embedding of principles and processes
  • Build and maintain key data governance and management artefacts e.g., Flow Diagram, Data Dictionary, KPI Catalogue
  • Define overall approach and data flow for Extract, Transform and Load; and application of this for a given deployment/project
  • Identify patterns, anomalies, and structure of data in preparation for Extract Transformation and Load
  • Design and implement data pipelines and processes based on business requirements
  • Write ETL data validation and data reconciliation queries
  • Define high level and low-level design of a data platform to ensure robustness e.g., restorability, traceability, ease to support, etc.
  • Define, embed, and drive data management and governance approaches, principles, and processes
  • Identify data quality issues through data profiling, analysis, and stakeholder engagement
  • Design and maintain the Microsoft Azure modern Datawarehouse architecture, implementation, administration, and support
  • Translate complex business requirements into clear, scalable technical designs and delivery plans, ensuring alignment between stakeholder outcomes and engineering execution

Requirements

  • Extensive experience in Cloud (preferably Microsoft Azure) Datawarehouse architecture as well as cloud data lakehouse platforms
  • Experience of ETL and ELT processes, working with database architecture
  • Able to develop and optimise coding in SQL and python
  • Experience in creating data pipelines using Cloud (preferably Azure Data Factory)
  • Experience with Cloud: ADLS, Databricks, SQL DW, Serverless Architecture
  • Experience in CI/CD pipelines and monitoring
  • Able to work with large datasets and extrapolate conclusions
  • Strong analytical and critical thinking abilities
  • Highly desirable: Experience in building and maintaining reliable and scalable ETL on big data platforms as well as experience working with varied forms of data infrastructure
  • Data Engineering experience in Microsoft stack
Benefits
  • Annual performance based bonus, up to 10%
  • 25 days annual leave, plus eight bank holidays
  • Up to 8% pension contribution
  • Financial support and time off for study relevant to your role, plus a professional membership subscription
  • Employee referral scheme (up to £1500), and colleague recognition scheme
  • Family friendly policies, including enhanced maternity leave and shared parental leave
  • Free, confidential employee assistance, including financial management, family care, mental health, and on-call GP service
  • Three paid volunteering days a year
  • Season ticket loan and cycle to work schemes
  • Family savings on days out and English Heritage, gym discounts, cash back and discounts at selected retailers
  • Employee resource groups
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
data platform designcloud-based data lakedata governanceETL processesdata pipelinesSQLPythondata validationdata profilingdata engineering
Soft Skills
analytical thinkingcritical thinkingstakeholder engagement