Senior Platform Administrator
CLA (CliftonLarsonAllen)
full-time
Posted on:
Location Type: Remote
Location: Remote • Florida, Iowa, North Carolina, Wisconsin • 🇺🇸 United States
Visit company websiteJob Level
Senior
Tech Stack
AWSAzureCloudGoogle Cloud PlatformPythonSparkSQLUnity
About the role
- Lead the setup, configuration, and maintenance of Databricks clusters.
- Monitor and optimize system performance, ensuring high availability and reliability.
- Implement and enforce security best practices and compliance standards.
- Collaborate with cross-functional teams to design and implement data solutions.
- Provide advanced user support and training.
- Develop and maintain comprehensive documentation for platform administration.
- Manage and maintain role-based access to data and features in the Databricks Platform using Unity Catalog.
- Implement external access controls for outside teams using service principles, SQL warehouses, and Delta Sharing.
- Ensure unused assets are tracked for pruning.
- Implement service principles and access tokens for external users.
- Create queries and dashboards to monitor critical systems and processes.
- Automate common admin tasks using Databricks notebooks.
- Manage workflow tags, cluster tags, workflow naming convention enforcement.
- Perform clusters health check and best practices implementation.
- Perform regular backup and recovery.
- Perform privilege reviews on users and resources.
- Provide training to junior members of the team and act as a point of escalation for complex questions and issues.
Requirements
- 5 years of relevant experience required.
- Bachelor's degree or a combination of relevant experience and training may be considered in lieu of a degree.
- Understanding of data engineering needs
- Understanding of Azure infrastructure required by Databricks
- Experience with compliance audits/audit documentation
- Experience using Databricks APIs with tools like Postman
- Understanding of the Databricks workspace and development environment
- Experience using GitHub to manage source code
- Strong SQL skills for creating admin related queries and dashboards
- Strong debugging skills
- Ability to do risk analysis for 3rd party integrations with Azure resources.
- Familiarity with Dynatrace.
- Proficiency in Spark, Python, and SQL.
- Strong understanding of cloud platforms (AWS, Azure, or GCP).
Benefits
- Flexible PTO (designed to offer flexible time away for you!)
- Up to 12 weeks paid parental leave
- Paid Volunteer Time Off
- Mental health coverage
- Quarterly Wellness stipend
- Fertility benefits
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
DatabricksSQLPythonSparkAzureGitHubDatabricks APIsPostmanDynatracerisk analysis
Soft skills
collaborationuser supporttrainingdocumentationproblem-solvingescalation managementperformance optimizationsecurity best practicescompliance enforcementdebugging