
Mid-Level Data Engineer
CI&T
full-time
Posted on:
Location Type: Hybrid
Location: Brazil
Visit company websiteExplore more
About the role
- Build stored procedures, views, and functions in SQL Server (on-premises and in the cloud with Azure SQL).
- Create and manage ETL processes using SSIS.
- Design and manage data pipelines using Azure Data Factory.
- Develop and maintain notebooks, workflows, and Delta Tables in Databricks.
- Implement data processing solutions using Python and PySpark.
- Work with relational and non-relational databases, ensuring efficient and reliable data storage and retrieval.
- Model data using industry-standard approaches and tools, primarily transactional models as well as dimensional models such as star and snowflake schemas.
- Ensure the quality, scalability, and security of implemented data solutions.
- Collaborate with cross-functional teams (product, development, and analytics) to meet organizational needs.
- Develop and maintain CI/CD processes for continuous integration and delivery in data pipelines.
Requirements
- Experience with SQL Server (on-premises and cloud), including developing stored procedures, views, and functions.
- Knowledge of relational databases (e.g., SQL Server and Oracle) and non-relational databases (e.g., Cosmos DB and MongoDB).
- Proficiency in data modeling using market-standard tools and approaches such as dimensional modeling, star and snowflake schemas.
- Experience with modeling tools such as ERwin, DrawSQL, and Lucidchart.
- Experience optimizing and transferring large volumes of data between on-premises systems and cloud transactional systems.
- Advanced knowledge of technologies such as Azure Data Factory, Azure SQL, and Databricks.
- Proficiency in Python and PySpark for processing and manipulating large data volumes.
- Experience with source control systems such as GitHub or Bitbucket.
Benefits
- Health and dental insurance
- Meal and grocery allowances
- Childcare assistance
- Extended parental leave
- Partnerships with gyms and health & wellness professionals via Wellhub (Gympass) / TotalPass
- Profit Sharing (PLR)
- Life insurance
- Continuous learning platform (CI&T University)
- Employee discount club
- Free online platform dedicated to physical and mental health and wellbeing
- Pregnancy and responsible parenthood course
- Partnerships with online course platforms
- Language learning platform
- And many more
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
SQL ServerETLSSISAzure Data FactoryDatabricksPythonPySparkdata modelingdimensional modelingdata processing
Soft Skills
collaborationcross-functional teamworkproblem-solvingcommunicationorganizational skills