Senior Software Engineer, Python, PySpark

Minor Hotels Europe and Americas

Senior Software Engineer tackling complex data challenges for a major social media client. Join Capgemini Engineering to leverage big data technologies in an innovative environment.

Posted 5/15/2026full-timeRemote • 🇨🇦 CanadaSenior💰 CA$62,874 - CA$147,504 per yearWebsite

Tech Stack

Tools & technologies

ApacheAWSCloudDockerHadoopJavaJavaScriptKubernetesNode.jsPySparkPythonSpark

About the role

Key responsibilities & impact

Receive tasks from the Project Lead or Team Lead (TL), prepare functional and design specifications, and align them with all stakeholders
Ensure assigned areas are delivered on time and meet quality expectations
Provide effort estimations, agree on timelines with the manager, and contribute to project planning
Evaluate existing data systems and identify improvement opportunities
Develop best practices for data coding to ensure system-wide consistency
Update and optimize local and metadata models
Assess implemented data systems for discrepancies, variances, and performance efficiency
Troubleshoot and optimize data infrastructure and pipelines
Understand business drivers and analytical use cases, translating them into reliable data products
Design, implement, and maintain cloud-based pipelines that deliver business-critical data efficiently
Identify area-level risks and implement mitigation plans
Report readiness/quality status and escalate critical issues appropriately
Take responsibility for resolving crisis situations within the assigned area of responsibility (AOR)
Initiate and conduct code reviews, and help establish coding standards, conventions, and guidelines
Propose technical and functional improvements to enhance the product
Continuously upgrade professional knowledge and skills
Collaborate closely with cross-functional teams.

Requirements

What you’ll need

5+ years of experience as a Software Engineer with strong Python development skills, including hands-on PySpark and Apache Spark implementation
Mid-level Java proficiency (minimum 2.5/5), with practical experience writing, debugging, and maintaining Java code
3+ years of experience building, operating, and supporting large-scale, scalable Big Data platforms or infrastructure
Strong knowledge of Big Data technologies, including: Apache Spark, Hadoop ecosystem, Parquet / ORC file formats, Apache Flink (or similar stream-processing frameworks)
Proven troubleshooting and production support skills, including the ability to handle SEV-1 / critical production incidents under pressure
Strong ability to organize, document, and communicate solutions, including technical design, root cause analysis (RCA), and operational runbooks
A passion for streamlining systems and processes to make the difficult trivial
Strong OOP skills
Experience with Node.js
Experience with AWS, Kubernetes (K8s), and Docker.

Benefits

Comp & perks

Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade
Company paid holidays
Personal Days
Sick Leave
Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
Life and disability insurance
Employee assistance programs
Other benefits as provided by local policy and eligibility

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

PythonPySparkApache SparkJavaBig DataHadoopApache FlinkOOPdata codingdata modeling

Soft Skills

project planningtroubleshootingcommunicationcollaborationproblem-solvingdocumentationorganizational skillscrisis managementanalytical thinkingstakeholder alignment