Deloitte

T&T Manager – Artificial Intelligence, Data

Deloitte

full-time

Posted on:

Location Type: Office

Location: Kuala LumpurMalaysia

Visit company website

Explore more

AI Apply
Apply

Job Level

About the role

  • Work with cross-functional teams to deliver analytical datasets
  • Collaborate with data analysts, BI developers, and data scientists
  • Design, develop, and optimize ETL processes using Databricks to support large-scale data processing and analytics
  • Implement data transformation, cleansing, and validation logic to ensure data accuracy
  • Migrate the reports from Traditional database to Databricks environment with optimized schema and schema structures and validate the data
  • Establish data quality, lineage, and governance practices across the Databricks platform
  • Build and maintain batch and stream ETL/ELT workflows for structured and semi-structured data using Data bricks and Azure Services
  • Establish integration between prem platform and azure storage to establish the incremental copy
  • Implement DevOps practices such as CI/CD automation and version control to streamline deployment and management of Databricks workflows
  • Apply strong problem-solving and debugging skills to identify and resolve issues in data pipelines and workflows

Requirements

  • Minimum 12 - 16 years of experience
  • Possess 5 years in solution, architecting, design and development experience in enterprise/ architecture projects
  • Experienced in managing full development lifecycle phases, designing enterprise software and defining solution architectures and technology
  • Applying design concepts – Service oriented architecture, layered architectures, components, interfaces, messaging and patterns
  • Application integration service support components
  • Designing and integrating applications and SaaS solutions using technology stacks and cloud service providers, such as Microsoft (e.g. Azure, power BI,Tableau), BI service support components (e.g. Data warehouse, extract-transform-load processes, databases)
  • Azure Data Factory, Azure Databricks, Hadoop Exposure
  • E2E integration experience (Hybrid cloud model)
  • Strong verbal and written communication, presentation and collaboration skills.
  • Good relationship building skills are necessary, including the ability to build a rapport and communicate effectively with all levels of the customer.
  • Good command over verbal and written English
  • work closely with application development and testing teams to support Data ETL build and supports project activities especially on Data and ETL platforms
  • Release Management (strong in GIT) and Azure Control M
Benefits
  • Professional development opportunities
  • Flexible working hours
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
ETL processesdata transformationdata cleansingdata validationDevOps practicesCI/CD automationdata pipelinessolution architectureapplication integrationdata governance
Soft Skills
problem-solvingdebuggingcommunicationpresentationcollaborationrelationship buildingrapport buildingeffective communicationverbal communicationwritten communication