Two Circles

Lead Data Engineer – Azure, Databricks, Python

Two Circles

full-time

Posted on:

Location Type: Hybrid

Location: Vancouver • Canada

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AzurePySparkPythonSQL

About the role

  • **What you will do**
  • We're looking for a talented Data Engineer to join our squad of >100 Data & BI Engineers, working on our Audience Intelligence Platform. You will be helping to build the leading data management and analytics platform for the sports industry. In this role, you'll work with cutting-edge technologies to design, build, and optimize scalable data solutions, enabling teams, leagues, and organizations to unlock the full potential of their data. If you're passionate about data engineering, enjoy collaborating in a fast-paced environment, and want to make an impact in the sports industry, we’d love to hear from you!
  • Your role will be varied and evolve as quickly as you can learn and develop. Your initial duties will involve:
  • - Design, build, and test scalable data platform solutions in Azure, leveraging tools like ADF, Databricks, and Function Apps, using Python.
  • - Develop high-quality data products, ensuring efficiency, reliability, and performance across our data pipelines.
  • - Collaborate closely with product and marketing teams to deliver data-driven insights and solutions that provide high business value.
  • - Write clean, maintainable code following best practices and development frameworks, ensuring robust data engineering standards.
  • - Continuously improve and optimize data workflows, monitoring performance and implementing enhancements to drive innovation.

Requirements

  • **Requirements**
  • You will have experience with the following:
  • - Experience in designing, building, and testing solutions within a data lakehouse environment.
  • - Proficiency in Python and PySpark for data processing and analytics.
  • - Hands-on experience with Azure, preferably ADF, Databricks, and Function Apps.
  • - Familiarity with CI/CD pipelines using Azure DevOps or similar tools.
  • - Ability to work within established development frameworks and adhere to coding standards.
  • - Excellent communication skills, with an ability to articulate blockers and timelines to non-technical stakeholders.
  • While the above skills are important to this role, we believe that attitude and ability to learn new skills are the most important factors for success in this team. If you are missing some of the experience listed above but this sounds like you, we’d love to hear from you.
  • - Strong teamwork skills, with a collaborative mindset and desire to learn from others.
  • - Strong SQL skills for querying and managing data.
  • - A proactive attitude with a passion for continuous learning and growth.
  • - High attention to detail and commitment to delivering quality work.
  • - Comfortable working in a fast-paced environment, with the ability to estimate tasks and deliver incremental value effectively.
Benefits
  • **Professional Growth: **Work on a variety of projects, enhancing your testing skills across different applications and technologies.
  • **Impactful Work**: Play a key role in delivering high-quality solutions that shape the future of the sports and entertainment industries.
  • **Collaborative Environment**: Be part of a team that values ideas, fosters a supportive atmosphere, and encourages continuous learning and improvement.
  • **Innovative Culture:** Join a company committed to revolutionizing fan and stakeholder engagement through cutting-edge technology.
  • **Equal Opportunity Employer: **Two Circles is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
data engineeringdata processinganalyticsPythonPySparkSQLdata lakehousedata pipelinesCI/CDdata workflows
Soft Skills
communicationteamworkcollaborationattention to detailproactive attitudecontinuous learningability to articulate blockersability to estimate tasksdesire to learnfast-paced environment