Senior Data Engineer, Azure

The SpyGlass Group, LLC

Senior Data / Azure Engineer developing cloud-native Azure platform for large-scale initiatives. Leading key responsibilities in data engineering, SQL optimization, and process modernization.

Posted 6/23/2026contractRemote • Rhode Island • 🇺🇸 United StatesSeniorWebsite

Tech Stack

Tools & technologies

AzureCloud.NETSQL

About the role

Key responsibilities & impact

Design, develop, and support Azure Durable Functions utilizing orchestrator and activity patterns.
Build and maintain solutions using .NET 8 (Isolated Worker) and distributed processing architectures.
Modernize existing automation processes by converting legacy PowerShell-based workloads into scalable, stateless Azure Functions.
Implement event-driven architectures leveraging Azure Event Hubs and related Azure services.
Develop high-performance data ingestion pipelines utilizing watermark-based change detection, parallel processing, and scalable ingestion patterns.
Support the migration of legacy data processing systems to Azure-based cloud infrastructure.
Contribute to the design and implementation of modern cloud-native data processing solutions.
Analyze and optimize existing workflows to improve scalability, reliability, and operational efficiency.
Collaborate with architects, engineers, and stakeholders to define future-state cloud data platform capabilities.
Design and implement data validation, reconciliation, and quality assurance frameworks.
Develop parallel-run validation strategies to ensure accuracy during modernization efforts.
Build comprehensive observability solutions including logging, monitoring, telemetry, and alerting.
Implement robust error handling, retry mechanisms, and operational support processes using Azure Application Insights and related monitoring tools.
Design, optimize, and maintain SQL Server solutions including stored procedures, queries, and database performance tuning.
Troubleshoot complex database performance issues and implement scalable solutions.
Ensure data integrity, consistency, and reliability across integrated systems.
Evaluate downstream dependencies including reports, integrations, data feeds, and business applications.
Partner with technical and business teams to ensure successful solution delivery.
Participate in architecture discussions, code reviews, and technical design sessions.
Document solutions, processes, and technical standards.
Provide technical leadership and mentorship to engineering resources, including offshore development teams when applicable.
Coordinate development activities across distributed teams and promote engineering best practices, code quality standards, and knowledge sharing.
Encourage the effective use of AI-assisted development tools such as GitHub Copilot (or similar) to accelerate code generation, documentation, testing, and engineering productivity.

Requirements

What you’ll need

7+ years of experience in software engineering, data engineering, or cloud engineering roles.
Strong experience developing Azure Durable Functions and Azure serverless solutions.
Expertise with .NET 8 and C# development.
Experience designing distributed processing and event-driven architectures.
Hands-on experience with Azure Event Hubs and Azure integration services.
Strong SQL Server development and performance tuning experience.
Experience building scalable data ingestion and transformation solutions.
Experience implementing monitoring, observability, and operational support frameworks.
Strong understanding of cloud architecture principles and modern software engineering practices.
Excellent communication, collaboration, and stakeholder management skills.

Benefits

Comp & perks

Health insurance
Professional development

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

Azure Durable Functions.NET 8C#distributed processing architecturesevent-driven architecturesAzure Event HubsSQL Serverdata ingestiondata transformationperformance tuning

Soft Skills

communicationcollaborationstakeholder managementtechnical leadershipmentorshipproblem-solvingdocumentationknowledge sharingteam coordinationengineering best practices