Senior Data Engineer, Cloudera
CI&T
full-time
Posted on:
Location Type: Hybrid
Location: 🇧🇷 Brazil
Visit company websiteJob Level
Senior
Tech Stack
AzureCloudETLHDFSPySparkPythonSparkSQL
About the role
- Design, develop, and maintain scalable, reliable data pipelines.
- Build data ingestion, transformation, and modeling solutions using Databricks, Spark/PySpark, Cloudera, and Azure Data Factory (ADF).
- Ensure data quality, integrity, and usability across the entire pipeline.
- Design and maintain Data Lake and Data Warehouse solutions, applying data governance best practices.
- Work with concepts and architectures such as Bronze, Silver, and Gold layers, star schema, Delta Tables, Delta Sharing, and analytical tables.
- Collaborate with technical and business teams to orchestrate solutions aligned with company objectives.
Requirements
- Solid experience as a Data Engineer or in a similar role.
- Advanced knowledge of:
- Cloudera (Hive, Impala, HDFS, etc.)
- SQL
- Python / PySpark
- Azure Databricks (workflows, jobs, Delta Tables, queries, etc.)
- Azure Data Factory (ADF)
- ETL/ELT and data pipelines
- Dimensional data modeling
- Data Lake / Data Warehouse
- Data governance and data quality
- Experience with CI/CD practices applied to data environments.
- Strong communication and collaboration skills with multidisciplinary teams.
- Ability to work in dynamic environments and handle loosely defined technical scopes.
- Knowledge of code optimization in cloud environments.
- Advantage: Experience with Teradata.
- Experience with SAS.
Benefits
- Health and dental insurance;
- Meal and grocery vouchers;
- Childcare assistance;
- Extended parental leave;
- Partnerships with gyms and health & wellness professionals via Wellhub (Gympass) and TotalPass;
- Profit-sharing (PLR);
- Life insurance;
- Continuous learning platform (CI&T University);
- Employee discount club;
- Free online platform dedicated to promoting physical and mental health and well-being;
- Prenatal and responsible parenthood course;
- Partnerships with online course platforms;
- Language learning platform;
- And many more
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data pipelinesdata ingestiondata transformationdata modelingSQLPythonPySparkETLdata governancedimensional data modeling
Soft skills
communicationcollaborationadaptabilityproblem-solving