Western Alliance Bank

Principal Engineer I – Senior Azure Databricks Administrator

Western Alliance Bank

full-time

Posted on:

Location Type: Office

Location: Phoenix • Arizona, Ohio, Texas • 🇺🇸 United States

Visit company website
✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AzurePySparkPythonSQLUnityVault

About the role

  • responsible for delivery and operations of technologies and platforms required to model, transform, analyze, report, visualize data
  • provide SME expertise in designing, building, optimizing, streamlining and automating the Azure Databricks platform to enable analytical workloads like Machine Learning (ML), Model Development, Data Insights, Data Science etc
  • partner with ML engineers, data scientists, data analysts, and enterprise architects to provide frameworks, set standards, enforce best practices, train and enable users using the Azure Databricks platform
  • develop technical skills of one or more junior team-members
  • take assignments that can be worked on individually without supervision, and manage work effort from concept to completion
  • design, build, optimize, automate and maintain the Azure Databricks platform, ensuring scalability, security, governance and performance
  • design, implement and manage Azure Databricks workspaces, clusters, jobs, access management
  • design, implement and manage policies, monitoring and observability for the Azure Databricks platform
  • implement data analytics principles aimed at business enablement, reliability practices and sound recovery procedures
  • ensure compliance with IT policies, procedures, and industry standards, including reviewing and refining IT control enhancements
  • work closely with business and analytics teams to ensure reliable and governed data access for data needed for analytics
  • troubleshoot platform issues, optimize performance, and ensure uptime for critical Databricks services
  • stay current on emerging data analytics technologies, recommending enhancements to improve efficiency and governance
  • act as a thought leader on Azure Databricks implementation, usage, end user enablement and training

Requirements

  • 8+ years of related experience in data analytics administration and development
  • 4+ years of Databricks related experience
  • Bachelor's degree in related field required, Masters in related field preferred
  • Previous leadership experience preferred
  • Advanced proven experience in Azure Databricks (Workspace management, Clusters, Jobs, Unity Catalog, Delta Lake, User access management, Rest APIs and SDKs)
  • Knowledge of MLFlow & MLOps
  • Deep understanding of Azure infrastructure and data services, including Azure Data Lake, Azure Data Factory, Azure SQL, Azure Synapse Analytics, Azure Key Vault, Azure Monitor, networking
  • Experience with CI/CD pipelines (Azure DevOps preferred)
  • Strong programming skills in SQL, Python, and/or PySpark
  • Advanced to expert knowledge of general Financial Services or Banking preferred
  • Advanced proven experience in leading cross-functional teams and managing multiple projects simultaneously
  • Advanced communication skills, excellent teamwork experience, ability to mentor and develop more junior engineers
Benefits
  • competitive salaries
  • an ownership stake in the company
  • medical and dental insurance
  • time off
  • a great 401k matching program
  • tuition assistance program
  • an employee volunteer program
  • a wellness program

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
Azure DatabricksMachine LearningModel DevelopmentData InsightsData ScienceSQLPythonPySparkCI/CD pipelinesMLFlow
Soft skills
leadershipcommunicationteamworkmentoringproject managementproblem-solvingindependent worktrainingcollaborationthought leadership