Lead Data Engineer
Scott Logic
AWSAzureCloudGoogle Cloud PlatformJavaScriptPySparkPythonSparkSQL
Senior Data Engineer
Scott Logic
full-time
Posted on:
Location Type: Hybrid
Location: Glasgow • 🇬🇧 United Kingdom
Visit company websiteJob Level
Senior
Tech Stack
JavaScriptPySparkPythonSparkSQL
About the role
- Build data platforms, data pipelines and processes to ingest, transform and query analytical data.
- Create data lakes and data warehouses and transform siloed datasets into integrated data models for analytics and ML training.
- Combine software engineering practices with data fundamentals to deliver maintainable systems.
- Work in hands-on, client-facing roles advising clients, setting technical direction and solving engineering challenges.
- Potentially lead teams or take senior/lead responsibility depending on experience.
- Collaborate with clients and colleagues; expect occasional on-site presence in the London area.
Requirements
- Good experience with technologies and approaches typical in modern data engineering and reporting (storage, data pipelines, querying & reporting of analytical data).
- Experience with Python.
- Experience with Spark.
- Experience with SQL.
- Experience with PySpark.
- Experience with PowerBI.
- Background in software engineering, including Front End technologies like JavaScript.
- Problem-solving and pragmatic exploration of options to find effective solutions.
- Understanding of design and building well-structured, maintainable systems.
- Strong communication skills and a collaborative approach to work.
- Willingness to learn new skills and grow experience.
- Ability to be client-facing and spend ad-hoc time on-site with clients in the London area.
Benefits
- 25 days’ annual leave, rising to 30 days with each year of service.
- Generous family leave policies.
- Access to an employer pension scheme.
- Private medical services.
- Group Life Assurance.
- Optional benefits such as discounted gym membership and a cycle-to-work scheme.
- Employee-led clubs and events, free games, books, and refreshments.
- Flexible/remote working arrangements.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
PythonSparkSQLPySparkPowerBIdata engineeringdata pipelinesdata lakesdata warehousessoftware engineering
Soft skills
problem-solvingcommunicationcollaborationclient-facingleadershippragmatic explorationwillingness to learnadaptabilityteamworktechnical direction