CI&T

AI Data Engineer

CI&T

full-time

Posted on:

Location Type: Hybrid

Location: Campinas • 🇧🇷 Brazil

Visit company website
✨ AI Apply
Apply

Job Level

Mid-LevelSenior

Tech Stack

AzureOpen SourcePySparkPythonSQL

About the role

  • Design and implement GenAI-based solutions that optimize critical stages of the DDLC (Data Development Life Cycle).
  • Develop agents that act as assistants in creating Databricks notebooks, pipelines in ADF (Azure Data Factory), and structures in Microsoft Fabric.
  • Build workflows that integrate LLMs into our ecosystem (SQL Server and Power BI), automating tasks such as data documentation and creation of DAX measures.
  • Apply advanced prompt engineering techniques to ensure the AI generates optimized, secure, and high-performance PySpark and T-SQL code.
  • Define quality metrics to validate AI-generated artifacts (e.g., ensuring the efficiency of generated queries).
  • Ensure solutions align with Data Governance practices, security, and privacy.
  • Stay up to date on AI capabilities within Microsoft Fabric and Databricks to maximize the use of native tools versus custom developments.

Requirements

  • Degree in Computer Science, Data Engineering, Statistics, or a related field.
  • Strong experience in Data Engineering and a deep understanding of CI/CD pipelines applied to data.
  • Required experience with AI agent orchestration frameworks (e.g., LangChain, Semantic Kernel, or AutoGen).
  • Technical expertise in the Azure Data ecosystem (Databricks, Data Factory, and Fabric) and in SQL and Python/PySpark.
  • Hands-on experience building GenAI solutions (OpenAI API, Azure OpenAI, or open-source models) with a strong focus on prompt engineering is essential.
  • Ability to translate business challenges into agents that can assist in data modeling and dashboard creation.
  • DataOps mindset: understanding that data requires testing, versioning, and monitoring.
Benefits
  • Health and dental insurance;
  • Meal and food allowance;
  • Childcare assistance;
  • Extended parental leave;
  • Partnerships with gyms and health & wellness professionals via Wellhub (Gympass) / TotalPass;
  • Profit Sharing (PLR);
  • Life insurance;
  • Continuous learning platform (CI&T University);
  • Discount club;
  • Free online platform dedicated to physical and mental health and wellbeing;
  • Pregnancy and responsible parenthood course;
  • Partnerships with online course platforms;
  • Language learning platform;
  • And many others

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
Data EngineeringCI/CD pipelinesAI agent orchestration frameworksLangChainSemantic KernelAutoGenSQLPythonPySparkDAX
Soft skills
problem-solvingcommunicationdata modelingdashboard creationtranslating business challenges