
Senior Data Engineer, Databricks
Compass
full-time
Posted on:
Location Type: Remote
Location: Brazil
Visit company websiteExplore more
Job Level
About the role
- Ensure monitoring of Data Quality: Implement processes to monitor data accuracy, consistency, and integrity;
- Data Security: Protect data from unauthorized access through security measures such as encryption and access control;
- Collaboration with Teams: Work closely with data teams and business stakeholders to understand their needs;
- Monitoring and Optimization: Monitor the performance of the data platform and implement improvements to optimize efficiency and scalability;
- Documentation: Document data engineering processes and procedures to ensure practices are reproducible and understandable for other team members;
Requirements
- Advanced experience and knowledge in Databricks;
- Flat dimensional data modeling;
- Proficiency in programming languages such as Python, Java, and Scala;
- Experience with relational databases (e.g., MySQL, Oracle) and non-relational databases such as MongoDB;
- Experience in ETL (Extract, Transform, Load): The ETL process is fundamental to extracting data from different sources, transforming it according to business needs, and loading it into target systems;
- Proficiency in distributed storage and processing: Knowledge of Big Data tools to handle increasing data volumes;
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
Databricksflat dimensional data modelingPythonJavaScalaMySQLOracleMongoDBETLBig Data
Soft skills
collaborationcommunicationdocumentation