CI&T

AI Data Engineer, Mid-level

CI&T

full-time

Posted on:

Location Type: Remote

Location: Brazil

Visit company website

Explore more

✨ AI Apply
Apply

Tech Stack

AzureOpen SourcePySparkPythonSQLUnity

About the role

  • Design and implement GenAI-based solutions that optimize critical stages of the DDLC (Data Development Life Cycle).
  • Develop agents that act as assistants in creating Databricks notebooks, pipelines in ADF, and structures in Microsoft Fabric.
  • Create workflows that integrate LLMs into our ecosystem (SQL Server and Power BI), automating tasks such as data documentation and creation of DAX measures.
  • Apply advanced prompt engineering techniques to ensure the AI generates optimized, secure, and high-performance PySpark and T-SQL code.
  • Define quality metrics to validate AI-generated artifacts (e.g., ensure efficiency of generated queries).
  • Ensure solutions align with Data Governance, security, and privacy practices.
  • Stay up to date on AI capabilities within Microsoft Fabric and Databricks to maximize the use of native tools versus custom developments.

Requirements

  • Degree in Computer Science, Data Engineering, Statistics, or a related field.
  • Strong experience in Data Engineering and deep understanding of CI/CD pipelines applied to data.
  • Hands-on experience building GenAI solutions (OpenAI API, Azure OpenAI, or open-source models) with a strong focus on prompt engineering is essential.
  • Experience with AI agent orchestration frameworks (e.g., LangChain, Semantic Kernel, or AutoGen) is required.
  • Technical mastery of the Azure Data ecosystem (Databricks, Data Factory, and Fabric) and proficiency in SQL and Python/PySpark.
  • Ability to translate business challenges into agents that assist in data modeling and dashboard development.
  • DataOps mindset: understanding that data requires testing, versioning, and monitoring.
  • Deep knowledge of Microsoft Fabric and its AI integration capabilities.
  • Experience with Unity Catalog and data governance.
  • Knowledge of RAG (Retrieval-Augmented Generation) to build assistants that use internal technical documentation.
  • Azure Data Engineer or AI Engineer certifications.
Benefits
  • Health and dental insurance
  • Meal and grocery allowances
  • Childcare assistance
  • Extended parental leave
  • Partnerships with gyms and health & wellness professionals via Wellhub (Gympass/TotalPass)
  • Profit-sharing (PLR)
  • Life insurance
  • Continuous learning platform (CI&T University)
  • Discount club
  • Free online platform for physical and mental health and well-being
  • Prenatal and responsible parenting course
  • Partnerships with online course platforms
  • Language learning platform
  • And many more
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
GenAI solutionsprompt engineeringPySparkT-SQLSQLPythonData EngineeringCI/CD pipelinesdata modelingDAX measures
Soft Skills
translating business challengesDataOps mindset
Certifications
Azure Data EngineerAI Engineer