
Data & Analytics Engineer
GS1 Canada
full-time
Posted on:
Location Type: Hybrid
Location: North York • 🇨🇦 Canada
Visit company websiteJob Level
Mid-LevelSenior
Tech Stack
ApacheAzureETLPythonSpark
About the role
- Perform end to end automation of ETL/ELT process for various datasets that are being ingested into the Data Platform.
- Design, develop and maintain data ingestion pipelines.
- Create Spark jobs for data transformation and aggregation.
- Develop, enhance, and manage conceptual, enterprise logical (LDM) and physical data models (PDM) to ensure the information models can meet end user and developer needs.
- Understand and apply logical entity-relational design concepts.
- Recommend opportunities for reuse of data models in the new environments.
- Develop dimensional models and views needed for data analytics and reporting.
- Optimize and update logical and physical data models to support new and existing projects.
- Leads the development of creative new data integrations, modifications to existing software, and/or makes decisions regarding integrating software applications data in accordance with agreed upon specifications.
- Serve as a subject matter expert of our solutions and address to a business or technical audience.
- Collaborate with Analysts, Architects and Developers to establish and maintain the Data Platform framework.
- Prepare and maintain technical documentation.
Requirements
- Bachelor's degree in a technical field such as computer science, computer engineering or related field
- 4+ years' experience with Data Modelling.
- 4+ years’ experience with Python programming language
- 4+ years’ experience with Apache Spark streaming and batch framework
- 4+ years’ experience developing data lake
- 2+ years experience of Databricks
- Knowledge of Microsoft Azure Platform
- Strong understanding and experience of relational/non-relational database, including design and implementation
- Strong communication skills required to communicate effectively with business and other stake holders
- Strong Analytical and Problem-Solving Skills
- Excellent Time Management Skills
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
ETLELTdata ingestion pipelinesSparkdata modelingdimensional modelsdata analyticsdata lakePythonDatabricks
Soft skills
communication skillsanalytical skillsproblem-solving skillstime management