Databricks Platform Engineer

Agility Technologies Inc

Databricks Platform Engineer building and optimizing secure cloud lakehouse infrastructure. Supporting federal and commercial clients through automation, governance, monitoring, and DevOps.

Posted 8/15/2026full-timeRemote • 🇺🇸 United StatesMid-LevelSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in managing and optimizing Databricks environments across cloud platforms, with a strong focus on automation, data security, and governance. Proficient in implementing Infrastructure-as-Code practices and collaborating with cross-functional teams to enhance platform performance and reliability.

Highest-signal resume keywords

Databricks AdministrationApache Spark ProficiencyInfrastructure-as-Code ToolsCloud Networking ConceptsDatabricks Certified Associate

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Databricks ManagementCluster SetupWorkspace ManagementJob OrchestrationPython ScriptingBash ScriptingPowerShell ScriptingCost OptimizationPerformance TuningETL/ELT

Tools & Technologies

TerraformCloudFormationDatadogAWS CloudWatchAzure Monitor

Certifications & Qualifications

Databricks Certified AssociatePlatform Administrator CertificationFederal Cloud Certifications

Industry Keywords

FedRAMPFISMANIST 800-53CMMCRBACData GovernancePublic Trust Clearance

Tech Stack

Tools & technologies

ApacheAWSAzureCloudETLGoogle Cloud PlatformPythonSparkTerraformUnity

About the role

Key responsibilities & impact

Build and maintain Databricks workspace infrastructure across development, staging, and production environments
Design, implement, and maintain Databricks platforms in Azure, AWS, or GCP cloud environments
Manage and optimize Databricks clusters, including autoscaling, resource allocation, monitoring, and troubleshooting
Oversee deployment and configuration of Databricks workspaces, user management, access controls, and workspace policies
Collaborate with infrastructure and DevOps teams to implement CI/CD pipelines for Databricks workflows and notebooks
Monitor and manage platform performance, logging, and system health
Implement data security and governance measures aligned with organizational policies and standards
Troubleshoot and resolve platform-related issues with cross-functional teams
Automate provisioning, upgrades, and scaling using Infrastructure-as-Code tools such as Terraform or CloudFormation
Support data engineers and data scientists integrating Databricks with data sources and tools
Stay current with Databricks features, updates, and best practices

Requirements

What you’ll need

5+ years of experience in platform engineering, cloud infrastructure, or IT operations
2+ years of hands-on experience managing Databricks environments
Strong knowledge of Databricks administration, including cluster setup, workspace management, and job orchestration
Proficiency in Apache Spark
Hands-on experience with Azure Government, AWS GovCloud, or GCP Public Sector
Proficiency in Python, Bash, or PowerShell scripting and automation
Experience with Infrastructure-as-Code tools such as Terraform, CloudFormation, or ARM templates
Understanding of cloud networking concepts including VPCs, subnets, security groups, and private endpoints
Familiarity with FedRAMP, FISMA, NIST 800-53, and CMMC
Experience with RBAC, encryption at rest and in transit, and audit logging
Ability to use monitoring and logging tools such as Datadog, AWS CloudWatch, or Azure Monitor
Proficiency diagnosing and resolving cluster performance issues, job failures, and other technical issues
Databricks Certified Associate or Platform Administrator certification preferred
Knowledge of Unity Catalog administration and data governance preferred
Experience with Databricks cost optimization, performance tuning, SSO, MFA, data retention, ETL/ELT, data warehousing, and real-time streaming technologies preferred
Federal cloud certifications preferred
Public Trust or higher clearance eligibility and prior federal client experience preferred

Benefits

Comp & perks

401(k) matching
Dental insurance
Health insurance
Paid time off
Parental leave
Vision insurance