Staff Data Engineer
Correlation One
full-time
Posted on:
Location Type: Remote
Location: Canada
Visit company websiteExplore more
Job Level
Tech Stack
About the role
- Own and develop the long-term technical vision & blueprint for the team
- Design technical strategy to develop well-architected data lakehouse
- Collaborate with internal architects to design and build out the ELT process from data ingestion to analytics marts.
- Create reliable, reusable frameworks and abstractions to standardize software development
- Provide support to development teams while mentoring engineering team members on modern database architecture principles and best practices.
- Monitor and analyze database performance and follow best practices of data engineering such as code reviews, scrum, and SDLC.
- Develop schema design for reports and analytics.
- Hands-on development from microservices and sub-systems to the entire technical stack
- Deal with ambiguity and figure things out with minimal guidance
- Mentor junior engineers on the team
- Create standards for engineering and operational excellence
- Identify and educate on industry relevant technical trends
Requirements
- 7+ years in a Data Engineering role with experience in data warehouses, fetching data from APIs, developing and maintaining ETL/ELT to service data marts, software applications or cloud microservices used to support data science applications
- Experience with creating data products and internal platforms which accelerate the development of data pipelines
- Advanced SQL experience and database design
- Experience building and maintaining pipeline monitoring for latency, traffic, saturation, and errors
- Able to demonstrate advanced computer and analytical skills with particular knowledge and understanding of the following storage, computing, and tools:
- GCP or equivalent cloud-based data lake/OLAP/OLTP environments
- APIs, Airflow, Cron, dbt, Git
- Experience creating microservices for passing data
- Experience working and implementing CDC (PostGres), with technologies like Kafka
- Working experience with Software Engineering development and deployment practices
- Experience with agile methodologies such as Scrum or Kanban with comfort level to work in iterative product driven cycles
- Experience with object-oriented/object function scripting languages: Python, Scala, etc.
- Working with CI/CD processes and source control tools such as Github
- Additional preferred experience:
- Handling unstructured text and data
- Infrastructure as code, ideally Terraform
- Non-tabular database management systems, e.g. MongoDB, NeptuneDB
- BI dashboards such as Tableau or PowerBI
- Implementing machine learning systems
- Utilizing logging/observability software such as data dog
- Utilizing data cataloging tool to document data pipelines and datasets
Benefits
- Insurance or subsidies based on country
- Unlimited Time Off, with a minimum time off recommendation
- Company-paid holidays
- Official company-wide holiday for the last week of the calendar year
- Access to free data skills training through our programs
- A company culture that empowers individuals and embraces diversity through its core mission
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data engineeringETLELTSQLdatabase designmicroservicesCDCobject-oriented programmingPythonScala
Soft skills
mentoringcollaborationproblem-solvingcommunicationleadershiporganizational skillsadaptabilityanalytical skillsstandardizationoperational excellence