Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (batch,distributed) & real-time, highly available data
Build fault-tolerant, self-healing, adaptive, and highly accurate data computational pipelines
Provide consultation and lead the implementation of complex programs
Develop and maintain documentation relating to all assigned systems and projects
Tune queries running over billions of rows of data in a distributed query engine
Perform root cause analysis to identify permanent resolutions to software or business process issues

Requirements

Bachelor’s degree in computer science, management information systems, or related discipline, or equivalent work experience
Strong/expert Spark (PySpark)
DataBricks
Hands-on data pipeline development, ingest patterns in Azure
Orchestration tools, ADF or Airflow
SQL
Python
Pyspark
Denormalized Data modeling for big data systems

Benefits

Paid time off based on employee grade (A-F), with vacation days ranging from 12-25 days, depending on grade
Company paid holidays
Personal Days
Sick Leave
Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
Life and disability insurance
Employee assistance programs
Other benefits as provided by local policy and eligibility

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

SparkPySparkDataBricksdata pipeline developmentAzureorchestration toolsADFAirflowSQLPython

Soft Skills

consultationleadershipdocumentationroot cause analysis

Certifications

Bachelor’s degree in computer scienceBachelor’s degree in management information systems