Vice President

• Provide support for Azure based data integration and analytics pipelines built using Azure Data Factory and Azure Databricks ensuring the uptime and performance of critical pipelines and workflows
• Monitor, troubleshoot and support ADF pipelines and Databricks notebooks/jobs in Production
• Analyze pipeline failures, spark job issues, data mismatches, cluster timeouts, resource unavailability and latency bottlenecks
• Root cause analysis for incidents and outages
• Understand the ADF Components and architecture
• Knowledge of data integration techniques and best practices
• Experience with connection to various data sources and destinations
• Ability to orchestrate complex data workflows and transformation
• Monitoring and troubleshooting data pipeline executions
• Familiarity with ADF data flow activities for data transformations
• Version control and deployment management using Azure DevOps or similar tools
• Awareness of ADF Integration with Azure services like Azure Data Lake Storage, Azure Databricks, etc.
• Skills in implementing streaming and batch data ingestion using Delta Lake
• Skills in implementing data pipelines and workflows in Databricks
• Familiarity with Databricks notebooks for interactive data exploration and development
• Integrating Databricks with Azure Services like ADLS Gen2, Azure SQLdb
• Monitoring and optimizing Databricks jobs for cost efficiency
• Proficiency in Git for managing code repositories, including branching, merging and pull requests
• Support CI/CD pipelines for deployment using Azure DevOps
• Participate in on-call rotation and ensure business continuity via proper DR strategies
• Ensure High Availability (HA) of ADF pipelines and auto-scaling/failover readiness of Databricks clusters
• Manage alerts, incidents and escalations using ServiceNow, Azure Monitor, Log Analytics etc.
• Proficiency in Git for managing code repositories, including branching, merging and pull requests
• Experience with Confluence, ServiceNow & JIRA
• Review and provide feedback on core code changes and support production deployment

Cloud Data Specialist – Azure, Vice President

Vice President – Smart Cloud

Vice President – Emerging Technologies

AVP, Technical Manager

Vice President, Hospitality – Strategy

VP, Medical and Scientific Strategy, Critical Care/Intensivist