Senior Data Engineer
Scott Logic
JavaScriptPySparkPythonSparkSQL
Lead Data Engineer
Scott Logic
full-time
Posted on:
Location Type: Hybrid
Location: Glasgow • 🇬🇧 United Kingdom
Visit company websiteJob Level
Senior
Tech Stack
AWSAzureCloudGoogle Cloud PlatformJavaScriptPySparkPythonSparkSQL
About the role
- Build data platforms and pipelines: data lakes, warehouses, processes to extract/access operational data, and transform datasets into integrated data models.
- Create foundations for data & analytics solutions, including data science and AI.
- Client-facing work: lead teams, set technical direction, advise clients, solve engineering challenges.
- Spend time on-site with clients in the London area on an ad-hoc basis.
- Combine software engineering approach with solid data fundamentals and modern tools.
- Be technology agnostic and adapt existing skillset.
Requirements
- Good experience with technologies and approaches typical in modern data engineering and reporting, including storage, data pipelines, and querying & reporting of analytical data.
- Experience with technologies such as Python, Spark, SQL, Pyspark, PowerBI.
- Background in software engineering, including Front End technologies like JavaScript.
- Problem-solving skills and pragmatic exploration of options.
- Understanding of how to design and build well-structured, maintainable systems.
- Strong communication skills and a collaborative approach.
- Willingness to learn new skills and grow experience.
- It would be great to have experience of relevant cloud services within AWS, Azure or GCP.
- Experience working in an Agile environment.
- Experience working with vendor products such as Snowflake or Data Bricks.
- Experience working with CI/CD tooling.
Benefits
- 25 days’ annual leave, rising to 30 days with each year of service.
- Generous family leave policies.
- Access to an employer pension scheme, private medical services and Group Life Assurance.
- A range of optional benefits such as discounted gym membership and a cycle-to-work scheme.
- A meaningful approach to evaluating your performance and providing feedback on your progress.
- Employee-led clubs and events, free games, books, and refreshments.
- Flexible remote working alongside office time.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
PythonSparkSQLPysparkPowerBIJavaScriptCI/CDdata engineeringdata pipelinesdata modeling
Soft skills
problem-solvingcommunicationcollaborationadaptabilityleadership