
Data Engineer III
Arch Capital Group Ltd.
full-time
Posted on:
Location Type: Hybrid
Location: Jersey City • New Jersey • North Carolina • United States
Visit company websiteExplore more
Salary
💰 $120,000 - $175,000 per year
About the role
- The Data Engineer III will work closely with the rest of the product team and business peers to effectively execute Data project initiatives.
- This person should be able to deliver in a fast-paced and deadline-driven environment.
- Along with development, candidate will be responsible for maintenance of the data applications and would be expected to automate the processes with no or minimal human intervention.
- Work extensively with the Policy Decisions Engine (PDE) to interpret, analyze, and translate business rules into scalable, production‑ready data solutions.
- Apply strong functional knowledge of the Guidewire Policy Center and Clams Center to support complex data integrations, mappings, and transformations across platforms.
- Collaborate closely with product teams, business SMEs, and technical partners to ensure seamless end‑to‑end execution of data initiatives.
- Design, develop, enhance, and maintain robust data pipelines, applications, and automated processes.
- Drive automation efforts to reduce manual intervention, increase reliability, and improve operational efficiency.
- Troubleshoot data issues, perform detailed root‑cause analyses, and ensure timely resolution to meet business needs and SLAs.
- Design, develop, and maintain ELT processes and Snowflake data warehouse solutions.
- Produce detailed design specifications, technical documentation, and comprehensive unit test plans.
- Critically evaluate business requirements and translate them into scalable, high‑performing data solutions.
- Define, establish, and enforce standards and best practices for effective ETL/ELT development.
- Support production environments through monitoring, maintenance, and continuous improvement.
- Work with product managers to identify gaps and develop actionable plans to close them.
- Recommend and implement innovative solutions that enhance system performance and deliver competitive advantages.
- Communicate clearly and effectively with technical and non‑technical stakeholders.
- Mentor and guide junior offshore developers to ensure high‑quality deliverables and skill development.
- Continuously improve data engineering best practices, focusing on scalability, governance, automation, cloud‑native patterns and AI.
Requirements
- 8 years of Data engineering experience using ETL/ELT technologies
- 6+ years ETL/ELT experience working with IICS, Informatica, Astro (Airflow), Python, Snowflake, Streamlit, Snowflake AI and ADF or equivalent technologies
- 4+ years hands on experience with Snowflake
- Experience working with SSIS, SSRS, and Power BI
- 3+ years of hands-on experience working in an Azure environment, Azure functions, Azure logic apps.
- Experience with external file conversion and loads for multiple file types, JSON, XML, CSV, Parquet, Domino experience with unstructured, semi structured datasets
- Experience working in insurance or reinsurance industry is highly desirable
- 3+ years hands on experience with agile methodologies
- Experience with Data warehouse/ data lake/ data hub modeling
- Experience working with external data feed to enrich internal data- desired
- 3+ years hands on experience with data standardization/conformance/transformation process
- Solid understanding of MDM and reference data
- 3+ years hands on experience with CI/CD process, especially in data engineering
- Experience working in SOX and SOC-2 compliant, PWC, NAIC, Internal Audit environment
- Experience with automated monitoring of data loads
- Support of production environment
- Strong understanding of technologies utilized in the industry and the ability to see their impact as well as enhancement management and product lifecycle development
- Knowledge of source code version control systems such as Git including branching/merging, resolving code conflicts, and 3-way and baseless merges
- Knowledge and experience with ML are a plus
- Relevant experience working with 3rd party vendors to deliver results.
Benefits
- multiple medical plans plus dental, vision and prescription drug coverage
- a competitive 401k with generous matching
- PTO beginning at 20 days per year
- up to 12 paid company holidays per year plus 2 paid days of Volunteer Time Offer
- basic Life and AD&D Insurance as well as Short and Long-Term Disability
- Paid Parental Leave of up to 10 weeks
- Student Loan Assistance and Tuition Reimbursement
- Backup Child and Elder Care
- and more.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
ETLELTPythonSnowflakeIICSInformaticaAzureData warehouseData lakeData hub
Soft Skills
communicationcollaborationmentoringproblem-solvinganalytical thinkingtime managementadaptabilityattention to detailleadershipcritical evaluation