
Lead Data Engineer
Two Circles
full-time
Posted on:
Location Type: Hybrid
Location: Vancouver • 🇨🇦 Canada
Visit company websiteSalary
💰 CA$115,000 - CA$130,000 per year
Job Level
Senior
Tech Stack
AirflowApacheAWSCloudDockerPythonSQL
About the role
- Work as part of a cross-functional product team to deliver a high-quality SaaS based data platform.
- Design and implement data pipelines with a clear focus on data quality and reliability.
- Partner with both Product Management and stakeholders, as well as both technical and non-technical team members to deliver our vision, roadmap, and data strategy in addition to innovative client solutions.
- Act as an advocate for development best practices including technical design reviews, implementing test plans, test driven development, monitoring/alerting, peer code reviews, and documentation.
- Contribute to our DevOps culture and participate in ownership of our designs through production operations.
- Support the ongoing maintenance and operations of the data platform.
Requirements
- 8+ years of experience in software engineering with a data focus, working in a fast-paced, agile environment
- 5+ years of experience writing, debugging and refining database queries
- 5+ years of experience with object oriented languages (preferably Python and C# .Net)
- 5+ years of experience building or maintaining cloud infrastructure and services (preferably AWS)
- 3+ years experience automating repetitive tasks (like setups, developer onboarding, support, moving data, etc.)
- Experience with various orchestration and batch processing technologies like Apache Airflow
- Proficiency in Snowflake and MS SQL.
- Proficiency in Python and C#. Both are required to be successful in this role
- Strong experience with containerization such as Docker
- Familiarity with monitoring tools for data pipeline performance such as New Relic
- Experience developing against APIs and building scalable systems.
- Experience with writing unit tests using frameworks such as PyTest for quality assurance.
- Understanding architectural differences between streaming and batch-oriented integrations
- Strong desire to support the team through improving internal tooling and processes
- Proactive and self-motivated with a willingness to learn and adapt.
- Strong attention to detail and problem-solving abilities.
- Strong written and verbal English skills, and an ability to articulate technical information efficiently.
- Excellent organizational and time management skills.
- Able to work cooperatively and effectively in a hybrid agile team environment.
- Familiarity with Continuous Delivery systems and Lean-Agile methodologies (Scrum / Kanban)
Benefits
- Professional Growth: Work on a variety of projects, enhancing your testing skills across different applications and technologies.
- Impactful Work: Play a key role in delivering high-quality solutions that shape the future of the sports and entertainment industries.
- Collaborative Environment: Be part of a team that values ideas, fosters a supportive atmosphere, and encourages continuous learning and improvement.
- Innovative Culture: Join a company committed to revolutionizing fan and stakeholder engagement through cutting-edge technology.
- Equal Opportunity Employer: Two Circles is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data pipelinesdatabase queriesobject oriented programmingPythonC# .Netcloud infrastructureAWSApache AirflowSnowflakeMS SQL
Soft skills
problem-solvingattention to detailwritten communicationverbal communicationorganizational skillstime managementteam collaborationproactiveself-motivatedadaptability