American Family Insurance

Senior Data Engineer

American Family Insurance

full-time

Posted on:

Origin:  • 🇺🇸 United States • Massachusetts, Wisconsin

Visit company website
✨ AI Apply
Manual Apply

Salary

💰 $97,000 - $164,000 per year

Job Level

Senior

Tech Stack

AWSAzureCloudDockerETLGoogle Cloud PlatformHadoopJenkinsPythonRDBMSSparkSQLTerraform

About the role

  • Collects, stores, processes and builds business intelligence and analytics applications within the big data platform.
  • Integrates these applications with the architecture used across the organization.
  • Performs exploratory data analysis to determine which questions can be answered effectively with a given dataset and analyze new unstructured data sources.
  • Designs and develops highly scalable and extensible data pipelines from internal and external sources.
  • Works on cross-functional teams to design, develop, and deploy data-driven applications and products, particularly for data science.
  • Prototypes emerging technologies involving data ingestion, transformation, distributed file systems, databases and frameworks.
  • Designs, builds, and maintains tools to increase productivity of application development and client facing teams.
  • Partners with business analysts to define, develop, and automate data quality checks.
  • Designs and develops big data applications and data visualization tools.
  • Role is not approved for sponsorship now or in the future.

Requirements

  • Demonstrated experience providing customer-driven solutions, support or service.
  • In-depth knowledge of SQL and experience using a variety of data stores (e.g. RDBMS, analytic database, scalable document stores).
  • Hands-on programming experience in Python with an emphasis towards building ETL workflows and data-driven solutions.
  • Experience with big data batch computing tools (e.g. Hadoop or Spark) and developing distributed data processing solutions.
  • Experience with cloud computing platforms (e.g. AWS, GCP, Azure).
  • Good data understanding and business acumen in data rich industries like insurance or financial.
  • Solid understanding of data modeling principles (e.g. dimensional modeling and star schemas).
  • Solid understanding of database internals, such as indexes, binary logging, and transactions.
  • Solid understanding of Infrastructure as Code (e.g. Docker, CloudFormation, Terraform, etc.).
  • Solid understanding of software engineering tools and workflows (i.e. Jenkins, CI/CD, git).
  • Travel up to 10% may be required.