Create new CDC pipelines to support the launch of new products.
Collaborate with the infra team on improving the monitoring and scalability of the CDC pipelines.
Triage and investigate Debezium or Kafka issues in collaboration with the infra team.
Maintain key data pipelines
Ingest external data sets for use by the team
Improve data usability and data quality in our data warehouse
Launch new ETL (extract, transform, load) processes in production.
Set up roles & access permissions for Databricks, following best practices.
Set up ETL pipelines or orchestration workflows within AWS & Databricks ecosystems.
Collect and organize knowledge through various sources, maintaining and updating data to ensure accuracy.
Transform, integrate, aggregate, annotate, and enrich data to enhance its value.
Derive and continuously update student attributes for personalization use cases.

Requirements

Hands-on experience with AWS services and Kubernetes.
Experience with Databricks / Spark ecosystem.
Knowledge of CDC, Debezium, and Kafka.
Experience in Software Engineering or Data Engineering
Expertise in writing efficient and optimized SQL
Experience with dimensional data modeling and schema design in a database or data warehouse
Expertise with scripting languages such as Python
Experience with ETL tooling such as Airflow
Experience with large-scale cloud data warehouses such as Snowflake
Passion for education and bringing technology to improve education
Experience working with large data sets
Love for collaborating and working with people in understanding data needs, as well as scoping and executing on projects.

Benefits

Provides a generous employer match on employee 401(k) contributions to support planning for the future.
Paid time off to volunteer at an organization of your choice.
Funding for select family-forming benefits.
Relocation support for employees who need assistance moving

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

CDCDebeziumKafkaETLSQLPythondimensional data modelingschema designdata warehousingdata integration

Soft Skills

collaborationcommunicationproblem-solvingproject executiondata usability improvementdata quality enhancementknowledge organizationpersonalization use casesteamworkpassion for education