FREE ACCESS
5,000–10,000 jobs/day

See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Tech Stack
Tools & technologiesCloudCyber SecurityPythonSparkSQLUnity
About the role
Key responsibilities & impact- Manage and ensure timely completion of discrete technical project scope.
- Manage technical requirements; define and oversee project deliverables, budgets, schedules, and risks.
- Support and in most cases lead the project team in planning, tracking, and executing scope from initiation through turnover.
- Advise on the Databricks reference architecture covering Lakeflow, Delta Lake, Unity Catalog Mosaic AI, Databricks SQL, and Databricks Apps.
- Provide hands-on guidance on Databricks full-stack solution design.
- Advise on design of both data movement (e.g. batch, real-time streaming) and zero-copy patterns.
- Guide platform migrations from legacy SQL and document stores onto Databricks and related cloud data platforms.
- Recommend security, governance, and compliance-as-code: Unity Catalog ABAC, governed tags, row filters/column masks, key management, networking security and compliance security profiles.
- Advise on design of segregated/tiered data pool architectures aligned to the organization's data classification policy and applicable regulatory requirements, including cross-tier data movement.
- Recommend FinOps and performance standards, workload and cost management.
- Mentor data engineers, analysts, and AI/ML teams participate in architecture reviews and contribute to standards.
- Work with information & cyber security, and other teams as needed for compliance to policies and standards.
- Evaluate emerging Databricks capabilities and recommend adoption strategies, including endpoint integrations with third parties as they evolve.
Requirements
What you’ll need- Master’s Degree in a relevant field of study. (required)
- At least 15 years of relevant experience or equivalent combination of education and experience. (required)
- 7+ years designing, building, and operating Databricks workloads with medallion layer architecture.
- Hands-on experience with Delta Lake, Unity Catalog, Spark Structured Streaming, Lakeflow (or DLT/Live Tables), Databricks SQL, MLflow, and Mosaic AI Model Serving
- Strong experience in cloud architecture supporting the platform (VPC/VNet, Security, S3/ADLS, KMS, etc.)
- Proven experience migrating enterprise data workloads from legacy/on prem data warehouse/lake to Databricks.
- Production streaming and CDC experience.
- Depth in security and governance: Unity Catalog policies (ABAC), classification, encryption, access auditing, compliance-to-control translation.
- Hands-on experience designing multi-tier Databricks architectures driven by data classification requirements.
- Strong Python and SQL, Spark, Notebooks.
- Excellent verbal and written communication skills.
- Must be U.S. Citizen to meet federal contract security requirements (required)
- Ability to successfully pass a federal background investigation to secure and maintain DOE Q security clearance (required)
Benefits
Comp & perks- Competitive pay and benefits
- Well-being programs to support you and your family
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
DatabricksDelta LakeUnity CatalogSpark Structured StreamingLakeflowDatabricks SQLMLflowMosaic AIPythonSQL
Soft Skills
communicationmentoringproject managementleadership
Certifications
Master’s DegreeDOE Q security clearance
