WM

Principal Engineer, Data Services

WM

full-time

Posted on:

Origin:  • 🇺🇸 United States

Visit company website
✨ AI Apply
Apply

Job Level

Lead

Tech Stack

Amazon RedshiftAWSBigQueryCloudEC2ETLInformaticaNoSQLOraclePythonShell ScriptingSparkSQL

About the role

  • Build data pipelines required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Cloud Integration ETL/ELT tools including but not limited to Informatica, AWS Glue, DBT, etc., Cloud Data Warehouse including but not limited to Snowflake, Oracle, IBM PureData, SQL, Shell Scripting, Python, AWS technologies, GitHub, various scripting languages, data quality tools, and metadata management tools.
  • Design, develop and document ETL/ELT, event-driven data integration architecture solutions; troubleshoot and tune complex SQL.
  • Present, communicate, and articulate technical processes effectively to all levels of the organization including Senior Leadership, VPs and C-level executives.
  • Contribute strategic vision and integrate a broad range of ideas regarding applications and software data development.
  • Work with Business Analysts, Data Analysts, Data Architects, BI Architects, Data Scientists, and Data Product Owners to establish an understanding of source data and determine data transformation and integration requirements to align engineering solutions with enterprise data strategies and technical standards.
  • Provide technical leadership in coding, testing, and code reviews; mentor and foster growth of peers and team members.
  • Support data quality, governance, data observability, and compliance through development of frameworks, metadata, and standards.
  • Apply engineering best practices to ensure performance, reliability, and scalability of enterprise data solutions.
  • Work with customers and technical staff to resolve problems with software and respond to suggestions for improvements and enhancements.
  • Participate in the creation of technical documentation, including data flows, integration specifications, and solution designs.
  • Stay current with emerging technologies in data management and AI; recommend improvements to existing solutions.

Requirements

  • Bachelor's Degree (accredited) in Computer Science, Data Science, MIS or similar area of study.
  • Ten (10) years of previous experience required (in addition to education requirement).
  • Expert level with data engineering expertise, including ETL, data warehouses, marts, and lake development
  • Expert level experience working with SQL relational and noSQL databases, query authoring (SQL) as well as working familiarity with a variety of databases
  • Expert level experience working with Cloud Datawarehouse like Snowflake, IBM PureData, Google BigQuery, Amazon Redshift
  • Expert level experience working with AWS cloud services: AWS Glue, EC2, S3, Lambda, SQS, SNS, etc.
  • Expert level experience working with GitHub, CI/CD and its integration with the ETL tools for version control
  • Expert level experience working with Informatica PowerCenter, various scripting languages, SQL, querying tools
  • Expert level experience working with modern data management tools and platforms including Spark, NoSQL, APIs, Streaming, and other analytic data platforms
  • Proficient level experience in data observability
  • Proficient level experience in Agile/Scrum project management and product ownership
  • Expert level in enterprise data management, integration patterns, and metadata practices
  • Expert level to apply architecture and analysis knowledge when working with cross-functional teams
  • Expert level strong problem-solving skills with attention to detail and quality
  • Excellent communication skills for both technical and non-technical audiences
  • Proficient ability to lead, mentor, and collaborate within a high-performing engineering teams
  • Expert level in systems development, implementation, upgrades and analyses
  • Proficient in QA testing, catalyst or unified business modeling, system design and analysis
  • Knowledge of enterprise coding standards
  • Expert level with hands on experience in writing highly complex code
  • Ability to perform code reviews
  • Expert knowledge of software methodologies
  • Ability to learn new and emerging technologies
  • Ability to multitask, meet deadlines, and work in a fast-paced environment
  • Ability to adapt to change
  • Demonstrate flexibility and a willingness to undertake a wide variety of challenging tasks
  • General business knowledge and concepts
NIR-YU

Senior Data Engineer

NIR-YU
Seniorfull-time💃 Anywhere in Latin America
Posted: 4 days agoSource: niryu.teamtailor.com
Amazon RedshiftAWSCloudETLInformaticaPythonSQLUnix
OneSix

Senior Consultant

OneSix
Seniorfull-time🇺🇸 United States
Posted: 1 hour agoSource: boards.greenhouse.io
Amazon RedshiftAWSAzureBigQueryCloudETLInformaticaMatillionSSISTableau
DXC Technology

Snowflake Data Engineer

DXC Technology
Junior · Midfull-time🇧🇬 Bulgaria
Posted: 18 days agoSource: dxctechnology.wd1.myworkdayjobs.com
Amazon RedshiftApacheAWSAzureCloudETLInformaticaPythonServiceNowSparkSQLSSIS+1 more
qode.world

Data Engineer, AWS Glue

qode.world
Senior · Leadfull-timeNew York, South Carolina · 🇺🇸 United States
Posted: 15 days agoSource: apply.workable.com
Amazon RedshiftAWSCloudETLJenkinsPySparkPythonScalaSQLTableau
ATPCO

Data Engineer

ATPCO
Mid · Seniorfull-time$90k–$115k / yearVirginia · 🇺🇸 United States
Posted: 30 days agoSource: jobs.smartrecruiters.com
Amazon RedshiftApacheAWSCloudETLJavaKafkaPythonScalaSQL