
Data Engineer
Verisk
full-time
Posted on:
Location Type: Remote
Location: New Jersey • United States
Visit company websiteExplore more
Salary
💰 $100,000 - $110,000 per year
About the role
- Responsible for expanding and optimizing our data pipeline architecture.
- Leading creation of data architecture that produces data assets to enable our data platform.
- Working closely with business leaders, architects, engineers, data scientists and wide range of stakeholders throughout the organization.
Requirements
- 3-5 years of full-time software engineering experience with at least 2 years in an AWS environment focused on application development.
- Bachelor’s degree or foreign equivalent degree in Computer Science, Software Engineering, or related field
- Design and implement data ETL frameworks for secured Data Lake, creating and maintaining an optimal pipeline architecture.
- Examine complex data to optimize the efficiency and quality of the data being collected, resolve data quality problems, and collaborate with database developers to improve systems and database designs.
- Hands-on building data applications using AWS Glue, Lake Formation, Athena, AWS Batch, AWS Lambda, Python, Linux shell & Batch scripting.
- Hands on experience with AWS Database services (Redshift, RDS, DynamoDB, Aurora etc.).
- Experience in writing advanced SQL scripts involving self joins, windows function, correlated subqueries, CTE’s etc.
- An understanding of data management fundamentals, including concepts such as data dictionaries, data models, validation, and reporting.
Benefits
- Health Insurance
- Retirement Plan
- Disability benefits
- Paid Time Off program
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data pipeline architecturedata architectureETL frameworksdata LakeAWS GlueLake FormationAthenaAWS BatchAWS LambdaPython
Soft Skills
collaborationleadershipcommunication
Certifications
Bachelor’s degree in Computer ScienceBachelor’s degree in Software Engineering