Data Architect – Databricks
Allata
AirflowAWSAzureCloudETLGrafanaJenkinsMS SQL ServerOraclePostgresPrometheusPySpark+4 more
Data Warehouse Developer, Azure
Hudson IT and Manpower
full-time
Posted on:
Location: Pennsylvania • 🇺🇸 United States
Visit company websiteSalary
💰 $50 - $51 per hour
Job Level
Mid-LevelSenior
Tech Stack
ApacheAzureCloudETLPythonSparkSQLSSIS
About the role
- Manage assignments, track progress, and ensure delivery against timelines.
- Plan, organize, and prioritize work, coordinating with the EDW and other teams.
- Participate in status, process, deliverable, and quality assurance reviews.
- Gather business and technical requirements; perform research and make recommendations for solutions.
- Develop and implement efficient data warehousing solutions and technical documentation.
- Participate in solution testing, training, and knowledge transfer sessions.
- Ensure compliance with federal and commonwealth standards and policies.
- Serve as presentations lead for the EDW, DOH offices, and partner agencies.
- Maintain project and process documentation on SharePoint.
- Complete timely weekly reporting via People Fluent/VectorVMS, Daptiv, and SharePoint as required.
Requirements
- Expertise in designing, developing, and maintaining data warehouse and ELT application infrastructure in Azure.
- Significant hands-on experience with Azure, Azure Databricks, Delta Lake, Data Factory, Pipelines, Apache Spark, and Python.
- Strong track record with SQL Server, Azure Synapse, T-SQL, SSIS, and related BI/data warehousing tools.
- Proven experience producing ETL/ELT using SQL Server Integration Services and other tools.
- Experience as an Azure DevOps CI/CD Pipeline Release Manager (including design and maintenance of robust, automated CI/CD pipelines and troubleshooting monorepo environments).
- Proficiency with data formatting, search, retrieval, extraction, classification, quality control, cleansing, and filtering techniques.
- Experience with data mining, modeling standards, analytics/reporting methodologies, and data engineering/API development.
- Ability to analyze and translate business requirements into optimized data designs and solutions.
- Advanced knowledge of relational and dimensional databases; strong understanding of data warehousing, facts, dimensions, and star schema methodologies.
- Documentation skills for technical specifications, diagrams, flowcharts, manuals, and test plans.
- Excellent organizational skills; ability to independently manage multiple priorities.
- Outstanding written and verbal communication skills; able to present technical concepts to diverse audiences.
- Team player with capacity for independent work and minimal supervision.
- At least 5 years of directly relevant experience.
- Bachelor’s degree in Computer Science or related field (advanced study preferred).
