Senior Spark Data Engineer
Valtech
AirflowAzurePySparkSparkSQL
Data Engineer, AI Platforms
OpenVPN Inc.
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇨🇦 Canada
Visit company websiteJob Level
Mid-LevelSenior
Tech Stack
BigQueryCloudJavaPostgresPythonSQL
About the role
- Design, build, and optimize robust, scalable data pipelines, leading the migration from legacy systems to our modern, AI-centric platform.
- Evolve our data models and schemas to better support complex analytics, AI training, and fine-tuning workloads.
- Collaborate with AI/ML teams to productionize models, streamline training data delivery, and support the development of sophisticated agentic systems.
- Empower the organization by partnering with BI developers and analysts to design highly efficient queries and unlock new insights.
- Champion data governance and compliance, ensuring our data handling practices remain secure and trustworthy as we innovate.
- Lead the charge in migrating our historical data flows to cutting-edge, AI-driven workflows.
- Redesign our datasets and schemas to be well aligned for training and fine-tuning next-generation models.
- Play an important role in the infrastructure that supports powerful, data-driven Agentic Agents.
- Help us build a data ecosystem that is not only powerful today but is ready for the demands of tomorrow's AI.
Requirements
- Proven experience (4+ years) in a data engineering role, with a track record of building and managing complex data systems.
- Deep expertise in SQL and query optimization.
- Hands-on experience with cloud data warehouses and databases, specifically Google BigQuery and CloudSQL (PostgreSQL).
- Programming experience with Python or JAVA.
- A proactive and self-motivated & managed mindset, perfect for a fully remote environment with a high degree of autonomy.
- Excellent communication and documentation skills; you can clearly articulate complex technical concepts to diverse audiences.
- The ability to work a flexible schedule and the readiness to respond to occasional off-hours emergencies.
Benefits
- Competitive pay rates
- Fully remote work environments
- Self-managed time off
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data engineeringSQLquery optimizationcloud data warehousesGoogle BigQueryCloudSQLPostgreSQLPythonJAVAdata modeling
Soft skills
proactive mindsetself-motivatedcommunication skillsdocumentation skillscollaborationflexibilityautonomyproblem-solvingleadershipdata governance
