Valtech

Senior Spark Data Engineer

Valtech

full-time

Posted on:

Location Type: Remote

Location: Remote • 🇨🇦 Canada

Visit company website
AI Apply
Apply

Job Level

Senior

Tech Stack

AirflowAzurePySparkSparkSQL

About the role

  • Demonstrate deep knowledge of the data engineering domain to build and support automated batch and streaming data pipelines.
  • Provide consultation and lead the design and implementation of complex pipelines.
  • Develop and maintain documentation relating to all assigned systems and projects.
  • Tune queries running over billions of rows of data using Spark as a distributed compute engine.
  • Perform root cause analysis to identify permanent resolutions to software or business process issues.
  • Manage communication with project stakeholders as you develop and execute on timelines.

Requirements

  • Proven industry experience executing data engineering, analytics and/or data science projects
  • Strong/expert Spark (PySpark) on Databricks
  • Hands-on data pipeline development, real world experience with orchestration tools such as Azure Data Factory (ADF) or Airflow
  • Strong/expert level of experience in SQL
  • Collaborative, proactive, communicative, able to work remotely while remaining engaged as a team member.
  • Experience analyzing needs and designing high volume pipelines
Benefits
  • Flexibility, with remote and hybrid work options (country-dependent)
  • Career advancement, with international mobility and professional development programs
  • Learning and development, with access to cutting-edge tools, training and industry experts
  • Medical, dental, and vision insurance for you and your family, plus employer contributions to Health Savings Accounts

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
data engineeringdata pipelinesSparkPySparkSQLdata pipeline developmentorchestration toolsAzure Data FactoryAirflowroot cause analysis
Soft skills
collaborativeproactivecommunicativeteamworkremote work engagement
Samsara

Senior Data Engineer

Samsara
Seniorfull-time$132k–$196k / year🇨🇦 Canada
Posted: 15 hours agoSource: boards.greenhouse.io
Amazon RedshiftAWSAzureBigQueryCloudETLGoogle Cloud PlatformMySQLOraclePostgresPythonRDBMS+1 more
Lightcast

Senior Data Engineer

Lightcast
Seniorfull-time🇨🇦 Canada
Posted: 9 days agoSource: jobs.lever.co
AirflowAWSCloudDistributed SystemsETLHadoopPythonSparkSQL
Nearform

Senior Data Engineer

Nearform
Seniorfull-time🇨🇦 Canada
Posted: 9 days agoSource: boards.greenhouse.io
Amazon RedshiftApacheAWSBigQueryETLPythonSparkSQL
3Pillar Global

Data Engineer, GCP

3Pillar Global
Mid · Seniorfull-time🇨🇦 Canada
Posted: 12 days agoSource: jobs.lever.co
BigQueryCloudETLGoogle Cloud PlatformNumpyPandasPythonSQL