Artificial Intelligence

• Design, develop, and optimize ETL processes using Databricks to support large-scale data processing and analytics.
• Build and maintain batch and stream ETL/ELT workflows for structured and semi-structured data using data bricks and Azure Services.
• Establish integration between prem platform and azure storage to establish the incremental copy
• Develop efficient, reusable, and version-controlled Databricks notebooks and workflows.
• Implement data transformation, cleansing, and validation logic to ensure data accuracy.
• Design and manage curated data layers supporting reporting and advanced analytics.
• Establish data quality, lineage, and governance practices across the Databricks platform.
• Collaborate with data analysts, BI developers, and data scientists to deliver analytical datasets.
• Leverage SQL/Spark for data extraction, transformation, and analysis.
• Apply strong problem-solving and debugging skills to identify and resolve issues in data pipelines and workflows.
• Migrate the reports from Traditional database to Databricks environment with optimized schema and schema structures and validate the data
• Collaborate with cross-functional teams to ensure data integrity, performance optimization, and alignment with business objectives.
• Implement DevOps practices such as CI/CD automation and version control to streamline deployment and management of Databricks workflows.

T&T Consultant – Artificial Intelligence, Data

T&T Consultant – Artificial Intelligence, Data