Senior Data Engineer
RE Partners
full-time
Posted on:
Location Type: Remote
Location: United Kingdom
Visit company websiteExplore more
Job Level
About the role
- Leading the design and orchestration of modularized, automated, event-driven data engineering pipelines and data modeling approaches.
- Building in quality by design into data engineering practices, enabling a scalable and flexible data architecture and feature rich dataset to support the wider Data function and the entire business.
- Implementing modern code development and data engineering orchestration strategies to target and streamline our data engineering processes.
- Embedding new data techniques into the business through coaching, training, and providing experiment design oversight to more junior data engineers.
- Working with third party partners and software providers to improve and/or implement new data solutions and processes.
- Being the gatekeeper for customer data, aware of our usage and alignment to data privacy standards, in collaboration with Data Governance to ensure best practice standards are applied/maintained.
- Working closely with our Lead Data and ML Engineers to drive the adoption of DevOps and modern code development practices across the Data function.
- Collaborating with Quality and Software Engineering and System teams to drive cross-function visibility and reduction of technical debt across the teams.
- Ensuring that our data engineering processes and pipelines are resilient and future-proof.
- Developing a strong knowledge of all data sources and maintaining relationships with data users/processors across the company.
- Supporting more junior data engineering colleagues from a technical skills development perspective.
Requirements
- Extensive expertise of RDBMS, Python, Hadoop, SQL and Pyspark
- GCP experience, including Dataproc and Dataflow
- Hands on Java experience
- Hands on experience in modern code development practices (Infrastructure-as-Code) and data engineering in the Google Cloud
- Experience of ETL/ELT technical design, automated testing of engineering pipelines, quality assurance and documentation
- Proven experience of data warehousing, data wrangling and data modelling approaches
- Proven experience coaching junior members of data engineering teams and supporting their skills development
- Proven experience working collaboratively with System, Quality Engineering and Software Engineering teams
- Demonstrable experience of critical thinking, communication and problem-solving ability and stakeholder management
- Demonstrate delivery under pressure and to deadline.
- Experience working in an e-commerce/retail market would be beneficial.
Benefits
- Opportunity to work with a diverse, global team of experts
- Referral bonus for bringing in talented friends
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
RDBMSPythonHadoopSQLPysparkGCPDataprocDataflowJavaETL/ELT
Soft Skills
coachingcommunicationproblem-solvingstakeholder managementcritical thinkingdelivery under pressurecollaborationtechnical skills development