Deloitte

T&T Manager – Artificial Intelligence, Data

Deloitte

full-time

Posted on:

Location Type: Office

Location: Singapore • Singapore

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

SeniorLead

Tech Stack

AzureCloudETLHadoopSparkSQLTableau

About the role

  • Design, develop, and optimize ETL processes using Databricks to support large-scale data processing and analytics
  • Build and maintain batch and stream ETL/ELT workflows for structured and semi-structured data using Data bricks and Azure Services
  • Establish integration between prem platform and Azure storage to establish the incremental copy
  • Develop efficient, reusable, and version-controlled Databricks notebooks and workflows
  • Implement data transformation, cleansing, and validation logic to ensure data accuracy
  • Design and manage curated data layers supporting reporting and advanced analytics
  • Establish data quality, lineage, and governance practices across the Databricks platform
  • Collaborate with data analysts, BI developers, and data scientists to deliver analytical datasets
  • Leverage SQL/Spark for data extraction, transformation, and analysis
  • Apply strong problem-solving and debugging skills to identify and resolve issues in data pipelines and workflows
  • Migrate the reports from Traditional database to Databricks environment with optimized schema and schema structures and validate the data
  • Collaborate with cross-functional teams to ensure data integrity, performance optimization, and alignment with business objectives
  • Implement DevOps practices such as CI/CD automation and version control to streamline deployment and management of Databricks workflows

Requirements

  • Minimum 12 - 16 years of experience
  • 5 years in solution architecture, design and development experience in enterprise architecture projects
  • Experienced in managing full development lifecycle phases, designing enterprise software and defining solution architectures and technology
  • Applying design concepts – Service oriented architecture, layered architectures, components, interfaces, messaging and patterns
  • Application integration service support components
  • Designing and integrating applications and SaaS solutions using technology stacks and cloud service providers, such as Microsoft (e.g. Azure, power BI, Tableau), BI service support components (e.g. Data warehouse, extract-transform-load processes, databases)
  • Azure Data Factory, Azure Databricks, Hadoop exposure
  • E2E integration experience (Hybrid cloud model)
  • Strong verbal and written communication, presentation and collaboration skills
  • Good relationship building skills are necessary, including the ability to build a rapport and communicate effectively with all levels of the customer.
  • Good command over verbal and written English
  • Work closely with application development and testing teams to support Data ETL build and supports project activities especially on Data and ETL platforms
  • Release Management (strong in GIT) and Azure Control M
Benefits
  • Positive work experiences that foster a culture of respect and inclusion
  • Opportunities for professional development
  • Empowerment to be leaders at all levels
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
ETL processesdata transformationdata cleansingdata validationSQLSparkDevOpsCI/CD automationdata qualitydata governance
Soft Skills
problem-solvingdebuggingcommunicationpresentationcollaborationrelationship buildingrapport buildingeffective communicationorganizational skillsteam collaboration