Senior Data Engineer

American Family Insurance

full-time

Posted on: 9/3/2025

Location: Massachusetts, Wisconsin • 🇺🇸 United States

✨ AI Apply

💰 $97,000 - $164,000 per year

Senior

AWSAzureCloudDockerETLGoogle Cloud PlatformHadoopJenkinsPythonRDBMSSparkSQLTerraform

About the role

Collects, stores, processes and builds business intelligence and analytics applications within the big data platform.
Integrates these applications with the architecture used across the organization.
Performs exploratory data analysis to determine which questions can be answered effectively with a given dataset and analyze new unstructured data sources.
Designs and develops highly scalable and extensible data pipelines from internal and external sources.
Works on cross-functional teams to design, develop, and deploy data-driven applications and products, particularly for data science.
Prototypes emerging technologies involving data ingestion, transformation, distributed file systems, databases and frameworks.
Designs, builds, and maintains tools to increase productivity of application development and client facing teams.
Partners with business analysts to define, develop, and automate data quality checks.
Designs and develops big data applications and data visualization tools.
Role is not approved for sponsorship now or in the future.

Demonstrated experience providing customer-driven solutions, support or service.
In-depth knowledge of SQL and experience using a variety of data stores (e.g. RDBMS, analytic database, scalable document stores).
Hands-on programming experience in Python with an emphasis towards building ETL workflows and data-driven solutions.
Experience with big data batch computing tools (e.g. Hadoop or Spark) and developing distributed data processing solutions.
Experience with cloud computing platforms (e.g. AWS, GCP, Azure).
Good data understanding and business acumen in data rich industries like insurance or financial.
Solid understanding of data modeling principles (e.g. dimensional modeling and star schemas).
Solid understanding of database internals, such as indexes, binary logging, and transactions.
Solid understanding of Infrastructure as Code (e.g. Docker, CloudFormation, Terraform, etc.).
Solid understanding of software engineering tools and workflows (i.e. Jenkins, CI/CD, git).
Travel up to 10% may be required.