
Associate Technical Architect – Databricks
Quantiphi
full-time
Posted on:
Location Type: Remote
Location: New Jersey • Texas • United States
Visit company websiteExplore more
About the role
- As an associate Technical Architect at Quantiphi, you will solve big data problems and will develop solutions for migration, storage, and processing.
Requirements
- 8+ years of hands-on experience in delivering data solutions.
- Experience with Databricks implementations - developing data pipelines using PySpark.
- Experience in Databricks Workspaces, Notebooks, Delta Lake, APIs.
- Experience in Python, Scala.
- Experience in advanced SQL and Query optimization.
- Experience in implementing data integration projects using ETL.
- Experience building and deploying cloud-based solutions at scale by ingesting data from sources like DB2.
- Good to have skills: Experience with AWS services - S3, Redshift, Secrets Manager.
- Experience in implementing data integration projects using ETL (preferably Qlik Replicate & Qlik Compose).
- Experience in using Airflow or Step Functions for orchestration.
- Exposure to IaC tools like Terraform and to CI/CD tools.
- Prior experience in migrating (on-prem to cloud) and processing large amounts of data.
- Experience in implementing data lake and data warehouse on cloud.
- Experience in implementing the industry's best practices.
Benefits
- Make an impact at one of the world’s fastest-growing AI-first digital engineering companies.
- Upskill and discover your potential as you solve complex challenges in cutting-edge areas of technology alongside passionate, talented colleagues.
- Work where innovation happens - work with disruptive innovators in a research-focused organization with 60+ patents filed across various disciplines.
- Stay ahead of the curve—immerse yourself in breakthrough AI, ML, data, and cloud technologies and gain exposure working with Fortune 500 companies.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
big data solutionsdata pipelinesPySparkPythonScalaadvanced SQLETLcloud-based solutionsdata lakedata warehouse