Compass

Senior Data Engineer, Databricks

Compass

full-time

Posted on:

Location Type: Remote

Location: Brazil

Visit company website

Explore more

AI Apply
Apply

Job Level

About the role

  • Ensure monitoring of Data Quality: Implement processes to monitor data accuracy, consistency, and integrity;
  • Data Security: Protect data from unauthorized access through security measures such as encryption and access control;
  • Collaboration with Teams: Work closely with data teams and business stakeholders to understand their needs;
  • Monitoring and Optimization: Monitor the performance of the data platform and implement improvements to optimize efficiency and scalability;
  • Documentation: Document data engineering processes and procedures to ensure practices are reproducible and understandable for other team members;

Requirements

  • Advanced experience and knowledge in Databricks;
  • Flat dimensional data modeling;
  • Proficiency in programming languages such as Python, Java, and Scala;
  • Experience with relational databases (e.g., MySQL, Oracle) and non-relational databases such as MongoDB;
  • Experience in ETL (Extract, Transform, Load): The ETL process is fundamental to extracting data from different sources, transforming it according to business needs, and loading it into target systems;
  • Proficiency in distributed storage and processing: Knowledge of Big Data tools to handle increasing data volumes;

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
Databricksflat dimensional data modelingPythonJavaScalaMySQLOracleMongoDBETLBig Data
Soft skills
collaborationcommunicationdocumentation