Snowflake Data Engineer
Medsuite Inc
ApacheAzureCloudETLKafkaMatillionPythonSparkSQL
Job Level
SeniorLead
Tech Stack
ApacheAzureCloudETLPythonSparkSQL
About the role
- Collects, documents, and analyzes information management and data requirements
- Designs and implements data solutions using client’s data platform technologies
- Creates, reviews and validates conceptual, logical, and physical data models of applications to determine compatibility and fit with architectural principles and optimal solution design.
- Designs, creates and optimizes data flows for migration methods of existing data.
- Works collaboratively with information governance analysts and data architects to ensure that data models and structures are compliant with governance standards.
- Communicates requirements, issues, and options for resolutions to various stakeholders and tailors messages to the audience.
- Understand existing applications, data stores and structures, data flows and elements.
- Reverse engineer legacy ETL to modernize it for the enterprise data platform
- Design and implement future state architectures and data solutions
Requirements
- Over 7 years of demonstrated experience in SQL programming and refactoring
- Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy.
- Experience with reverse engineering legacy ETL builds ( Data Manager ) and source-to-target mappings to design and build future data assets
- Well-rounded hands-on experience in dimensional and relational data modeling, SQL programming and ETL development.
- Experience implementing medallion architecture in Databricks
- Programming experience in SQL, Python and Apache Spark
- Validation/ testing of developed data solutions by comparing to existing or proxy datasets
- Experience with Microsoft Azure or other public cloud offerings
- Experience in Agile delivery
- Experience in IBM Data Manager
- Ability to understand, interpret, develop and maintain requirements and design documents
- Excellent verbal and written communication, critical thinking, time management, priority planning and interpersonal skills.
- Assets: Experience with ERWIN or similar data modelling tool
- Assets: Experience with Denodo data virtualization
- Assets: Experience with Power BI report development
- Assets: Experience working in an Agile environment/team
- Assets: Bilingualism in both official languages (English and French)
