
Data Engineer
Verinext
contract
Posted on:
Location Type: Office
Location: Franklin Township • New Jersey • 🇺🇸 United States
Visit company websiteJob Level
Mid-LevelSenior
Tech Stack
AzureETLPySparkPythonSQL
About the role
- Design, develop, and maintain data pipelines using Azure Data Factory, Azure Synapse, and Microsoft Fabric Dataflows.
- Implement and maintain Medallion architecture in Fabric and Azure environments.
- Build ingestion and transformation flows that efficiently convert raw Parquet files into Delta tables to support curated, incremental, and governed datasets optimized for Power BI.
- Implement efficient data lakehouse patterns within Microsoft Fabric.
- Design and maintain star schemas, dimensional models, and semantic layers for Power BI.
- Collaborate with Power BI developers to ensure models are performant and aligned to needs.
- Tune queries, optimize partitioning, and manage performance across Fabric and Synapse environments.
- Ensure solutions follow Azure best practices for scalability, cost efficiency, and security.
- Implement data governance, lineage, and cataloging via Microsoft Purview and Fabric capabilities.
- Partner with IT security and compliance teams to enforce data access controls.
- Work on site and collaborate closely with cross-functional teams to drive data efficiency and innovation.
Requirements
- Minimum 5 years of relevant experience.
- Strong expertise in data languages (Python, SQL, DAX, M, R, etc.) and handling large data sets using PySpark.
- Strong expertise in Azure Data Factory, Azure Synapse Analytics, Databricks (nice-to-have), and Microsoft Fabric.
- Hands-on experience implementing Medallion architecture in a lakehouse environment.
- Expertise in transforming Parquet datasets into Delta tables for reliable, incremental processing.
- Experience building ETL/ELT pipelines and working with both structured and unstructured data.
- Familiarity with CI/CD for data pipelines a plus.
- Experience with Power BI integration and data modeling.
- Excellent analytical and problem-solving skills.
- Excellent record keeping and auditing skills.
- Excellent communication skills, both oral and written.
- Strong attention to detail and ability to self-check work.
- Excellent time management skills.
- Task oriented excellent organizational skills, ability to prioritize workload.
- Enthusiastic attitude, cooperative team player, adaptable to new or changing circumstances, professional demeanor, sensitive to client needs, self-motivated, creative and innovative.
- CANDIDATES MUST HAVE A GREEN CARD OR BE A US CITIZEN.
- PLEASE NO THIRD PARTIES, NO AGENCIES.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
PythonSQLDAXMRPySparkETLELTdata modelingdata governance
Soft skills
analytical skillsproblem-solving skillscommunication skillsattention to detailtime managementorganizational skillsteam playeradaptabilitycreativityself-motivation