Senior Data Engineer
Guidewire Software
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇺🇸 United States
Visit company websiteSalary
💰 $148,000 - $222,000 per year
Job Level
Senior
Tech Stack
AirflowAmazon RedshiftApacheAWSPythonRDBMSSparkSQL
About the role
- Participate in multiple simultaneous projects with a focus on data preparation and pipeline development for predictive modeling and machine learning
- Data interrogation, exploratory data analysis, profiling, and reconciliation
- Data pipeline creation, revision and monitoring based on product manager and data scientist/actuarial input
- Feature creation, initial testing, and ongoing management
- Work collaboratively with other staff including product managers, data scientists, other data analysts, architects to solve problems
- Create and manage data assets, datasets, features, and code with a focus on simplicity, scalability, reusability, and clear documentation
- Additional work assignments not related to specific project work such as new feature development, external data research
Requirements
- Bachelors or Masters degree or equivalent industry experience
- 7-10+ years of relevant experience
- Advanced, hands on experience building modeling datasets, pipelines and features for predictive modeling
- Extensive experience using DBT, Apache Iceberg, and AWS data capabilities like Airflow, Glue, Redshift, EMR
- Expert SQL skills, including advanced functions, table design, view creation, stored procedure and script design and coding
- Proficient in data processing and transformations using Apache Spark
- Working knowledge of Python
- Experience with version control systems (e.g., Git)
- Understanding of MLOps principles and practices related to data preparation and feature engineering
- Familiarity with common challenges in integrating RDBMS-sourced data into a data warehouse
- Experience within a regulated industry (finance, insurance, etc…)
- Self-motivated and detail-oriented
Benefits
- health, dental, and vision insurance
- paid time off
- company sponsored retirement plan
- annual company bonus plan
- commissions
- long term incentive awards
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data preparationpipeline developmentpredictive modelingdata interrogationexploratory data analysisfeature creationdata processingtransformationsSQLPython
Soft skills
collaborationproblem-solvingself-motivateddetail-oriented
Certifications
Bachelors degreeMasters degree