
Senior Data Engineer
Allstate
full-time
Posted on:
Location Type: Remote
Location: Illinois • United States
Visit company websiteExplore more
Salary
💰 $98,100 - $167,850 per year
Job Level
About the role
- Design, build, and support high-quality data solutions and pipelines using modern engineering practices and tools.
- Partner closely with product managers, software engineers, and data analysts to deliver scalable, reliable data capabilities that power digital products and business insights.
- Accountable for the end-to-end lifecycle of data products, from design and implementation through production support, data quality, and performance against key metrics.
- Integrate data from diverse sources including APIs, databases, event streams, and third-party systems.
- Apply modern engineering practices, including version control, testing, CI/CD, and automated deployments.
- Ensure data quality, integrity, and reliability through validation, monitoring, and observability tools.
- Optimize data workflows for performance, cost efficiency, and operational resilience.
- Document data flows, lineage, and technical components in support of transparency and maintainability.
Requirements
- Strong proficiency with data pipeline development in Python, Java, or Scala.
- Experience with modern data frameworks (Spark, Kafka, Flink, dbt, or equivalent).
- Solid understanding of SQL and NoSQL databases and data modeling principles.
- Ability to optimize SQL, pipelines, and storage for performance and cost.
- Experience building batch and/or streaming data solutions.
- Experience using Microsoft Fabric Notebooks to develop, debug, and operationalize data engineering workflows.
- Experience with containerization and orchestration tools (Docker, Kubernetes).
- Experience with observability and monitoring tools (Datadog preferred).
- Ability to work in collaborative, iterative, product-centric team environments.
- Strong communication and problem-solving skills.
- 4 year Bachelor's Degree.
- 3 or more years of experience (Preferred)
Benefits
- Health insurance
- 401(k) matching
- Flexible work arrangements
- Professional development programs
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data pipeline developmentPythonJavaScalaSQLNoSQLdata modelingbatch data solutionsstreaming data solutionsdata optimization
Soft Skills
collaborationcommunicationproblem-solving
Certifications
Bachelor's Degree