FREE ACCESS
5,000–10,000 jobs/day

See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Tech Stack
Tools & technologiesPySparkPythonSparkSQL
About the role
Key responsibilities & impact- Define and implement Artificial Intelligence solutions applied to data modernization and legacy systems.
- Develop mechanisms for analyzing, interpreting, and extracting technical information from legacy artifacts.
- Build Generative AI–based solutions to accelerate documentation, transformation, and migration processes.
- Create intermediate metadata models to represent flows, business rules, dependencies, entities, and transformations.
- Develop accelerators and reusable components aligned with the enterprise data architecture.
- Support the definition of templates, technical standards, and declarative structures for modern pipelines.
- Develop and evolve pipelines using Databricks, PySpark, Lakeflow Jobs, and Declarative Pipelines.
- Work with batch loads, incremental ingestions, CDC (Change Data Capture), and enterprise integrations.
- Support the advancement of data governance, traceability, and data quality during migration.
- Collaborate with architects, data engineers, and platform specialists to define scalable and secure solutions.
Requirements
What you’ll need- Experience with Artificial Intelligence applied to Data Engineering, Software Engineering, or Technical Automation.
- Hands-on knowledge of Generative AI and Large Language Models (LLMs).
- Experience with:
- AI agents
- RAG (Retrieval-Augmented Generation)
- Prompt engineering
- Function calling
- Tool use
- Automated workflows
- Experience with AI orchestration frameworks:
- LangChain
- LangGraph
- Semantic Kernel
- CrewAI
- Or equivalent frameworks
- Experience with Python.
- Experience with PySpark and Spark SQL.
- Development of data pipelines in distributed environments.
- Advanced SQL knowledge.
- Knowledge of XML, JSON, and YAML.
- Experience with data modeling and Data Warehousing.
- Experience working with Databricks environments.
Benefits
Comp & perks- Position open to candidates with disabilities (PcD)
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
Artificial IntelligenceGenerative AILarge Language ModelsPythonPySparkSpark SQLSQLXMLJSONYAML
Soft Skills
collaborationcommunicationproblem-solvinganalytical thinking
