Data Engineer – Snowflake, DataStage
VSP Vision Care
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇺🇸 United States
Visit company websiteSalary
💰 $63,000 - $108,675 per year
Job Level
Mid-LevelSenior
Tech Stack
Amazon RedshiftApacheAWSETLInformaticaKafkaOracleSQLSSIS
About the role
- Create and maintain data pipelines for key data and analytics capabilities in the enterprise
- Collaborate within an agile, multi-disciplinary team to develop optimal data integration and transformation solutions
- Document and analyze data requirements to develop scalable, automated, fault-tolerant data pipeline solutions
- Profile data to assess accuracy and completeness of data sources and work with business partners to mitigate issues
- Build and maintain data pipelines using appropriate tools and practices in different environments
- Design with modularity to leverage code reuse
- Create data mappings, programs, routines, and SQL to acquire data from various environments
- Use a mix of ELT, ETL, and other methods to optimize data movement
- Maintain metadata management processes and documentation
- Monitor data quality to detect emerging issues and create transformation rules
- Participate in code reviews and unit testing for performance optimization
Requirements
- Bachelor’s degree in computer science, data science, statistics, economics, or related functional area; or equivalent experience
- 4+ years of experience in a development team providing analytical capabilities
- 4+ years of hands-on experience in the data space, spanning data preparation, SQL, integration tools, ETL/ELT/data pipeline design
- SQL coding experience
- Familiarity with agile development environments (Scrum, Kanban) with a focus on Continuous Integration and Delivery
- Previous experience using a data integration platform (IBM InfoSphere DataStage, Oracle Data Integrator, Informatica PowerCenter, MS SSIS, AWS Glue, Denodo)
- Familiarity with data warehouse MPP platforms such Snowflake, Netezza, Teradata, Redshift, etc
- Familiarity with event store and stream processing (Apache Kafka and platforms like Confluent) and API development and management platforms (MuleSoft, Axway)
Benefits
- Eligible bonuses and commissions
- Comprehensive health insurance
- Paid time off
- Professional development opportunities
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data pipelinesdata integrationdata transformationSQLETLELTdata mappingdata profilingmetadata managementdata quality
Soft skills
collaborationagile methodologyproblem-solvingdocumentationanalytical skillscommunicationteamworkperformance optimization