
Senior Data Engineer
Burlington Helping Burlington
full-time
Posted on:
Location Type: Hybrid
Location: Edgewater Park • New Jersey • United States
Visit company websiteExplore more
Salary
💰 $80,000 - $105,000 per year
Job Level
About the role
- Design and Develop ETL to extract data from first and third-party data sources, stitch, and wrangle it for advanced analytics activities and AI/ML and GenAI uses
- Guide and lead development of data pipelines to enable real-time, high volume, data consumption
- Leverage data engineering best practices and tools in collaboration with analytics translators, data scientists, and cloud engineers
- Assist with researching first and third-party data sources to enable access and ensure availability of relevant data sources for those who need it
- Provide input to cloud engineers for the design and implementation of data management and/or architecture solutions
- Provide ongoing operational support for ETL/ELT environments including development, test, and production
- Design, implement, and deploy data loaders to load data into the cloud data platform
- Assist in pulling, filtering, tagging, joining, parsing, and normalizing data sets for use
- Mentoring junior members of the team
Requirements
- Bachelor’s or Master’s degree in Computer Science / Engineering, Informatics, or related areas
- 5+ years of experience in designing and implementing large scale data loading, manipulation, processing, analysis, and exploration solutions
- Extensive experience developing SQL based data processing
- 5+ years of experience with Data Architecture, Data Warehouse, Lake Houses, Data Lake, Data Marts and Data Stores with focus on AI/ML techniques and LLMs
- Experience with Snowflake and Oracle Databases as well as Azure and ADLS
- Experience in development & provisioning RESTful APIs to enable real-time data consumption
- Experience with source control tools such as GitHub and related CI/CD processes
- Technical expertise with pulling and massaging data
- Great understanding of first/third party data
- Agile Development methodology
- Database Normalization
- Advanced SQL skills
- Understanding of data management principles and processes
- Passion for data, analytics and pushing business innovation
- Strategic thinker who loves technology and innovation
- Excellent communication skills
- Experience with Informatica IDMC (preferred)
- Experience with GenAI and Natural Language Processing (NLP) frameworks (preferred)
- Experience with real-time and streaming technology (i.e. Azure Event Hubs, Azure Functions Kafka, Spark Streaming) (preferred)
- Unix / Linux Experience (preferred)
- Experience with CI/CD practices (preferred)
- Previous experience with DevOps (preferred)
- Experience with Python / Java programming languages (preferred)
- Experience with one or more enterprise scheduler (preferred)
- Experience with AI-based testing, experimentation and prototyping (preferred)
- Retail or CPG experience preferred
Benefits
- competitive wages
- flexible hours
- associate discount
- medical, dental and vision coverage
- life and disability insurance
- paid time off
- paid holidays
- 401(k) plan
- training and development opportunities
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
ETLSQLData ArchitectureData WarehouseData LakeData MartsRESTful APIsDatabase NormalizationPythonJava
Soft Skills
mentoringcommunicationstrategic thinkingpassion for datainnovation