
Mid Data Developer – Cloudera
CI&T
full-time
Posted on:
Location Type: Hybrid
Location: Brazil
Visit company websiteExplore more
About the role
- Design, develop, and maintain scalable, robust data pipelines.
- Build data ingestion, transformation, and modeling solutions using Databricks, Spark/PySpark, Cloudera, and Azure Data Factory (ADF).
- Ensure data quality, integrity, and usability across the entire pipeline.
- Design and maintain Data Lake and Data Warehouse solutions, applying data governance best practices.
- Work with concepts and frameworks such as Bronze, Silver, and Gold layers, Star Schema, Delta Tables, Delta Sharing, and analytical tables.
- Collaborate with technical and business teams to orchestrate solutions aligned with company objectives.
Requirements
- Strong experience as a Data Engineer or in a similar role.
- Advanced knowledge of:
- - SQL
- - Python / PySpark
- - Azure Databricks (workflows, jobs, Delta Tables, queries, etc.)
- - Azure Data Factory (ADF)
- - Cloudera (Hive, Impala, HDFS, etc.)
- - ETL/ELT and data pipelines
- - Dimensional data modeling
- - Data Lake / Data Warehouse
- - Data governance and data quality
- - Experience with CI/CD practices applied to data environments
- - Strong communication and collaboration skills with multidisciplinary teams
- - Ability to operate in dynamic environments and handle loosely defined technical scope
- - Knowledge of code optimization in cloud environments
- Nice to have:
- - Experience with Teradata
- - Experience with SAS
Benefits
- Health and dental insurance
- Meal and food allowances
- Childcare assistance
- Extended parental leave
- Partnerships with gyms and health & wellness professionals via Wellhub (Gympass) and TotalPass
- Profit-sharing (PLR)
- Life insurance
- Continuous learning platform (CI&T University)
- Discount club
- Free online platform dedicated to physical and mental health and well-being
- Pregnancy and responsible parenting course
- Partnerships with online course platforms
- Language learning platform
- And many more
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
SQLPythonPySparkAzure DatabricksAzure Data FactoryClouderaETLELTDimensional data modelingData governance
Soft Skills
communicationcollaborationability to operate in dynamic environmentshandling loosely defined technical scope