Senior Data Engineer
General Motors
AzureCloudDistributed SystemsETLPythonSparkSQL
Data Engineer Senior
USAA
full-time
Posted on:
Location: Arizona, North Carolina • 🇺🇸 United States
Visit company websiteSalary
💰 $127,310 - $243,340 per year
Job Level
Senior
Tech Stack
AWSCloudETLInformaticaLinuxNoSQLPythonSQL
About the role
- Leads and/or engineers the full cycle of data solutions from analysis, solution design, data pipeline engineering, testing, deployment, scheduling, and production support.\n
- Designs and implements highly complex technical solutions for data engineering and analytic systems using new methodologies and emerging technologies.\n
- Designs, builds, handles and optimizes data pipelines for data structures encompassing data transformation, data models, schemas, metadata, data quality, and workload management.\n
- Leads design reviews for the team and provides recommendations using innovative architectural concepts and principals.\n
- Breakdowns business features into technical stories and approaches.\n
- Presents to leadership and influences on technical solutions.\n
- Creates proof of concepts and prototypes on highly complex solutions and presents to leadership to deliver on vision for solution.\n
- Collaborates with multi-functional partners and collaborators to lead technical solutions.\n
- Implements efficient defect management, root cause analysis, and resolution processes.\n
- Helps develop, maintain, and implement the company’s data development tools and standards.\n
- Conduct code reviews on a regular basis to improve quality and ensure compliance\n
- Creates the development of data pipelines, extracting data from our various applications (internal & external sources) into the Data Platform.\n
- Assists in setting technical direction for the team and serves a mentor to team members.\n
- Ensures risks associated with business activities are effectively identified, measured, monitored, and controlled in accordance with risk and compliance policies and procedures.
Requirements
- Bachelor’s degree; OR 4 years of related experience (in addition to the minimum years of experience required) may be substituted in lieu of degree.\n
- 6 years of data engineering, data analysis or software development experience implementing data solutions with at least 2 years of data engineering or data management experience.\n
- Experience with end to end delivering of data solutions that includes building, handling, and optimizing data pipelines across cloud environments; curating and modeling the data for various types of consumers/products and their pattern of usage to include data marts, data lake, and operational analytic applications.\n
- Strong understanding of the agile principles and ability to apply them.\n
- Extensive knowledge and experience in SQL and Relational Databases.\n
- Proficient in working with Cloud technologies and tools.\n
- 6 or more years of experience utilizing Linux scripting (Python, Shell, etc.)\n
- 6 or more years of experience in SQL development and/or NoSQL databases\n
- 6 or more years of experience with ETL Tools (Informatica, DataStage, Data Build Tool, etc.)\n
- 4 or more years of developing data applications using Snowflake on AWS
Similar jobs on JobTailor
Senior Data Engineer
Abbott
ApacheAWSAzureCloudETLGraphQLKafkaMapReducePySparkSparkSQLTableau
Principal Data Engineer
TASC
AWSAzureCloudDistributed SystemsETLHadoopJenkinsPySparkPythonSQL
Cloud Data Engineer
Woolpert
AzureCloudJavaScriptPythonSQLTableau
Cloud/Data Engineer – TS/SCI with Polygraph
General Dynamics Information Technology
ApacheAWSCloudSpark