Senior Manager, Data Engineering
Upstart
AirflowCloudETLKafkaPythonSparkSQL
Azure Data Engineer
AttainX, Inc.
full-time
Posted on:
Location Type: Remote
Location: Remote • Virginia • 🇺🇸 United States
Visit company websiteSalary
💰 $100,000 - $140,000 per year
Job Level
Mid-LevelSenior
Tech Stack
AzureETLJavaJavaScriptPythonSQL
About the role
- Assess the current state of the enterprise data warehouse, identifying gaps and optimization opportunities.
- Build and maintain ETL/ELT pipelines, with emphasis on metadata models and automation scripts to improve performance and ensure smoother transitions.
- Deliver hands-on engineering solutions across Azure Data Factory, Synapse Analytics, Data Lake, and SQL/Managed Instances.
- Prepare designs for supporting database systems and implement measures to improve performance and scalability.
- Collaborate with cross-functional teams to align engineering delivery with strategic objectives and roadmap execution.
- Maintain awareness of industry trends in BI/reporting (Microsoft Fabric, Power BI) and apply them in support of engineering tasks.
- Support projection planning (must have at a minimum of 1-2 year execution roadmap; 3-5 year scalability alignment planning experience).
- Develop, enhance, and troubleshoot pipelines, datasets, SQL queries, stored procedures, and integrated runtimes in the Azure data environment Data engineer.
- Manage connections between the data factory, SQL managed instances, Power BI, Power Apps, and external/on-prem environments.
- Research, engineer, and implement new technologies to enhance data factory operations, migrations, and integrations Data engineer.
- Document all new and current configurations, implementations, and developments to ensure continuity and support.
Requirements
- Bachelor’s degree in Computer Science, Information Systems, Data Science, or related field (or equivalent experience).
- 5+ years of demonstrated experience engineering Azure data solutions (ETL/ELT, ADF, Synapse, Data Lake, SQL) to optimize performance, automate pipelines, and deliver scalable, future-ready data environments aligned to organizational strategy.
- Required Certifications : Microsoft Azure Data Engineer Associate certification.
- Preferred Certifications: Power BI Data Analyst Associate, MS Azure Solutions Architect Expert, ITIL v4 Foundation, SAFe Agile certifications (Agilist/Practitioner).
- 5+ years in Azure Data Engineering (ADF, Synapse, Data Lake, SQL).
- Background in SQL, data modeling, OLAP, and ETL/ELT processes.
- Experience building and optimizing metadata-driven ETL pipelines.
- Support projection planning, must have at a minimum of 1-2 years of execution roadmap and 3-5 years of scalability alignment planning experience.
- Understanding of programming concepts (Python, PowerShell, Java, JavaScript, PL/SQL) as relevant to the customer data environment.
- Familiarity with BI/reporting platforms (Microsoft Fabric, Power BI) to integrate engineering solutions.
- Ability to adapt quickly in large-scale enterprise implementation environments.
- Must be a U.S. Citizen with an Active US Secret Clearance.
Benefits
- paid vacation
- medical
- dental
- vision
- matching 401K plan
- tuition/training reimbursement
- Long & Short-Term Disability
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
ETLELTAzure Data FactorySynapse AnalyticsData LakeSQLdata modelingOLAPPythonPowerShell
Soft skills
collaborationadaptabilityproblem-solvingcommunicationproject planning
Certifications
Microsoft Azure Data Engineer AssociatePower BI Data Analyst AssociateMS Azure Solutions Architect ExpertITIL v4 FoundationSAFe Agile certifications
