Tech Stack
AzureCloudERPETLMatillionPythonSQLTerraform
About the role
- Design, build, and manage ETL/ELT pipelines using Matillion for structured and semi-structured data.
- Optimize data ingestion, transformation, and loading into Snowflake using Snow pipe, Snow SQL, and other Snowflake utilities.
- Ensure data quality, lineage, and governance across all pipeline stages.
- Build and deploy APIs for data access & integration (using Snowpark containers / Azure Step Functions/API Gateways)
- Implement CI/CD workflows for API lifecycle management and versioning.
- Leverage Cortex services to build intelligent chatbots and semantic search capabilities.
- Integrate Snowflake with Vertex AI and Snowpark Container Services for ML-driven insights and conversational interfaces.
- Work with architects to align with published system standards and cloud-native design principles.
- Collaborate with business stakeholders to translate requirements into scalable technical solutions.
- Participate in DevOps practices including automated testing, deployment, and monitoring.
Requirements
- Bachelor's degree in a quantitative field with 7 years of experience or master’s with 5 years of experience.
- 5+ years of experience in data engineering roles, preferably in cloud environments.
- Hands-on experience with: Matillion ETL and Snowflake (Snow SQL, Snow pipe, Snowpark Container services).
- Azure Step Functions, API Gateway, and cloud-native API development.
- Cortex services for Natural language services (or similar AI/ML platforms).
- Familiarity with DevOps tools (Azure DevOps, Terraform, Git) and CI/CD pipelines.
- Experience in automation the test cases for regression testing, integrating testing as part of the automation / DevOps pipeline
- Experience with programming languages, including Python, SQL, PL/SQL for relational databases
- Excellent communication and documentation skills.
- Exposure to ERP data sources and legacy system migration.
- Any domain experience in the lumber /construction / manufacturing industries is a huge plus.
- 10% Travel
- You must be legally authorized to work in the United States without the need for employer sponsorship
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
ETLELTMatillionSnowflakeSnow SQLSnow pipeAPI developmentCortex servicesPythonSQL
Soft skills
communicationdocumentationcollaboration