Sumitomo Mitsui Banking Corporation – SMBC Group

Azure Cloud Data Engineer

Sumitomo Mitsui Banking Corporation – SMBC Group

full-time

Posted on:

Location Type: Hybrid

Location: Tralee • 🇮🇪 Ireland

Visit company website
✨ AI Apply
Apply

Job Level

SeniorLead

Tech Stack

AzurePythonSparkSQLVault

About the role

  • Monitor, troubleshoot and support ADF pipelines and Databricks notebooks/jobs in Production.
  • Analyze pipeline failures, spark job issues, data mismatches, cluster timeouts, resource unavailability and latency bottlenecks.
  • Root cause analysis for incidents and outages.
  • Understand the ADF Components and architecture.
  • Experience with connection to various data sources and destinations.
  • Ability to orchestrate complex data workflows and transformation.
  • Supporting CI/CD pipelines for deployment using Azure DevOps.
  • Integrating Databricks with Azure Services like ADLS Gen2, Azure SQLdb.

Requirements

  • 7 years of experience recommended
  • Strong hands-on experience with Azure Data Factory (ADF)- Pipeline orchestration, linked services, integration runtimes.
  • Experience in Azure Data Bricks – running and debugging notebooks, clusters, spark job logs.
  • Proficient in SQL – Writing/debugging queries, validating data.
  • Good understanding of Azure Services: ADLS, Key Vault, Azure Monitor, Log Analytics.
  • Familiarity with Azure DevOps pipelines and Git Integrations.
  • Scripting knowledge: Python, PowerShell, or Bash.
  • Understanding of Spark concepts and Delta Lake (Preferred).
  • Ability to work on weekends for maintenance, production implementations, recovery tests and system verifications / validations.
  • Ability to address production issues from home outside of normal business hours.
Benefits
  • SMBC provides reasonable accommodations during candidacy for applicants with disabilities consistent with applicable federal, state, and local law.
  • Opportunities to participate in providing support for Azure based data integration and analytics pipelines.

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
Azure Data FactoryDatabricksSQLPythonPowerShellBashSparkDelta LakeCI/CDPipeline orchestration
Soft skills
troubleshootingroot cause analysisanalytical skillsproblem-solvingcommunicationteam collaborationadaptabilitytime managementattention to detailability to work independently