Consultant – Artificial Intelligence, Data
Deloitte
full-time
Posted on:
Location Type: Office
Location: Bangkok • Thailand
Visit company websiteExplore more
About the role
- Design, develop, and optimize ETL processes using Databricks to support large-scale data processing and analytics.
- Build and maintain batch and stream ETL/ELT workflows for structured and semi-structured data using data bricks and Azure Services.
- Establish integration between prem platform and azure storage to establish the incremental copy
- Develop efficient, reusable, and version-controlled Databricks notebooks and workflows.
- Implement data transformation, cleansing, and validation logic to ensure data accuracy.
- Design and manage curated data layers supporting reporting and advanced analytics.
- Establish data quality, lineage, and governance practices across the Databricks platform.
- Collaborate with data analysts, BI developers, and data scientists to deliver analytical datasets.
- Leverage SQL/Spark for data extraction, transformation, and analysis.
- Apply strong problem-solving and debugging skills to identify and resolve issues in data pipelines and workflows.
- Migrate the reports from Traditional database to Databricks environment with optimized schema and schema structures and validate the data
- Collaborate with cross-functional teams to ensure data integrity, performance optimization, and alignment with business objectives.
- Implement DevOps practices such as CI/CD automation and version control to streamline deployment and management of Databricks workflows.
Requirements
- Minimum 5 - 10 years of experience
- Possess 5 years in solution, architecting, design and development experience in enterprise/ architecture projects
- Experienced in managing full development lifecycle phases, designing enterprise software and defining solution architectures and technology
- Applying design concepts – Service oriented architecture, layered architectures, components, interfaces, messaging and patterns
- Application integration service support components
- Designing and integrating applications and SaaS solutions using technology stacks and cloud service providers, such as Microsoft (e.g. Azure, power BI,Tableau), BI service support components (e.g. Data warehouse, extract-transform-load processes, databases)
- Azure Data Factory, Azure Databricks, Hadoop
- Exposure E2E integration experience (Hybrid cloud model)
- Strong verbal and written communication, presentation and collaboration skills.
- Good relationship building skills are necessary, including the ability to build a rapport and communicate effectively with all levels of the customer.
- Good command over verbal and written English
- work closely with application development and testing teams to support Data ETL build and supports project activities especially on Data and ETL platforms
- Release Management (strong in GIT) and Azure Control M
- Good to Have: Continued learning certifications, at least one of the following: AWS Certified Solutions Architect, Google Cloud Certified Architect, Microsoft Azure Solutions Architect, Cloud [Software] Systems Engineer, Customer Solutions Engineer [Cloud / Data, Analytics/AI] or combination of experience as DevOps Engineer, Data Architect, Cloud/SaaS Software Developer
Benefits
- Professional development opportunities
- Flexible working hours
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
ETL processesdata transformationdata cleansingdata validationSQLSparkDevOps practicesCI/CD automationdata qualitydata governance
Soft skills
problem-solvingdebuggingcommunicationpresentationcollaborationrelationship buildingrapport buildingeffective communicationteamworkcustomer engagement
Certifications
AWS Certified Solutions ArchitectGoogle Cloud Certified ArchitectMicrosoft Azure Solutions ArchitectCloud Systems EngineerCustomer Solutions Engineer