Arrive Logistics

Senior Data Engineer

Arrive Logistics

full-time

Posted on:

Location: 🇺🇸 United States

Visit company website
AI Apply
Apply

Job Level

Senior

Tech Stack

AirflowAmazon RedshiftAzureBigQueryCloudKafkaPythonSQL

About the role

  • Design, build, and optimize robust, scalable, and reliable data pipelines to ingest and process data from a wide variety of sources.
  • Develop and maintain our data warehousing solutions (e.g. Snowflake)
  • Ensure data quality and integrity by implementing data validation frameworks, monitoring systems, and anomaly detection protocols.
  • Architect and manage cloud-based data infrastructure.
  • Collaborate with stakeholders, including data scientists, analysts, and product managers to understand data requirements and deliver actionable solutions.
  • Be a leader, mentor, and subject matter expert for the team, stakeholders, and peers. Foster a collaborative environment that drives solutions forward at a larger scope.
  • Improve the performance and efficiency of existing data systems and processes.
  • Work alongside Data and Engineering leadership to weigh tradeoffs in build vs buy decisions and tradeoffs in product roadmap vs technical initiatives
  • Interact with vendors to craft the adoption of new technology and infrastructure for the team

Requirements

  • Bachelor’s degree in Computer Science, Engineering, or a related field or equivalent professional experience.
  • 5+ years experience in data engineering.
  • Expert proficiency in SQL and strong programming skills in Python.
  • Proven experience building and orchestrating data pipelines using dbt and Airflow
  • Hands-on experience developing data solutions in a major cloud environment, with a strong preference for Microsoft Azure.
  • Solid understanding of BI-tooling integrations with a cloud data warehouse, with a strong preference for PowerBI
  • Solid understanding of event-driven architecture and the use of messaging systems like Kafka to enable real-time data flow.
  • Experience with a modern cloud data warehouse like Snowflake, Databricks, BigQuery, or Redshift.
  • Familiarity with CI/CD, microservice architecture, domain driven design, data contracts
  • Solid understanding with best practices around data security/privacy, role-based access control
  • Experience with machine learning concepts, frameworks, and infrastructure
General Motors

Senior Data Engineer

General Motors
Seniorfull-timeMissouri · 🇺🇸 United States
Posted: 1 hour agoSource: generalmotors.wd5.myworkdayjobs.com
AzureCloudDistributed SystemsETLPythonSparkSQL
Abbott

Senior Data Engineer

Abbott
Seniorfull-time$97k–$195k / year🇺🇸 United States
Posted: 1 hour agoSource: abbott.wd5.myworkdayjobs.com
ApacheAWSAzureCloudETLGraphQLKafkaMapReducePySparkSparkSQLTableau
TASC

Principal Data Engineer

TASC
Leadfull-time$138k–$265k / yearMontana, New York · 🇺🇸 United States
Posted: 1 hour agoSource: mastercard.wd1.myworkdayjobs.com
AWSAzureCloudDistributed SystemsETLHadoopJenkinsPySparkPythonSQL
Woolpert

Cloud Data Engineer

Woolpert
Juniorfull-time$60k–$65k / year🇺🇸 United States
Posted: 3 hours agoSource: boards.greenhouse.io
AzureCloudJavaScriptPythonSQLTableau
General Dynamics Information Technology

Cloud/Data Engineer – TS/SCI with Polygraph

General Dynamics Information Technology
Senior · Leadfull-time$161k–$207k / yearVirginia · 🇺🇸 United States
Posted: 4 hours agoSource: gdit.wd5.myworkdayjobs.com
ApacheAWSCloudSpark