PNC

Senior Data Engineer, Python & PySpark

PNC

full-time

Posted on:

Location: Alabama, Ohio, Pennsylvania • 🇺🇸 United States

Visit company website
AI Apply
Apply

Salary

💰 $110,500 - $171,925 per year

Job Level

Senior

Tech Stack

ApacheAWSCloudDockerHadoopKafkaKubernetesLinuxOpenShiftPySparkPythonSDLCShell ScriptingSparkSQLUnix

About the role

  • Leads in developing, supporting and implementing data solutions for multiple applications to meet business objectives and user requirements.
  • Leverages technical knowledge and industry experience to design, build and maintain technology solutions.
  • Leads data requirement analysis and the data preparation process development for targeted data solutions.
  • Leads in designing and building data service infrastructure on multiple data platforms, according the workflow.
  • Oversees the development and implementation of data solutions for multiple applications to ensure its scalability, availability and maintainability.
  • Consults on data migration and transformation to ensure the accuracy and security of data solutions.

Requirements

  • 5+ years of industry-relevant experience
  • Extensive experience with big data technologies and distributed computing tools (Hadoop, Spark, Hive Kafka, etc.)
  • Strong proficiency in Python, PySpark, Spark, SQL
  • Proficient in Containerization (OpenShift, Kubernetes, Docker, etc.)
  • Experience with public cloud platforms – Apache Ice-burg and AWS
  • S3
  • Knowledge of Unix/Linux shell scripting
  • Education: Bachelor's degree or equivalent; in lieu of degree, comparable combination of education, certification(s), and experience may be considered
  • Preferred Skills: Analytical Thinking, Data Analytics, Data Mining, Data Science, Machine Learning
  • Competencies: Application Delivery Process, Big Data Management and Analytics, Business Intelligence, Consulting, Data Analysis - Software, Data Architecture, Database Structures, Problem Solving, Software Development Life Cycle
Rackner

Kubernetes Engineer – DoD Secret Eligible, Weekend Operations

Rackner
Mid · Seniorfull-time🇺🇸 United States
Posted: 2 hours agoSource: boards.greenhouse.io
AnsibleAWSAzureCloudGoogle Cloud PlatformKubernetesLinuxTerraform
Motional

Senior Backend Engineer, Data Mining

Motional
Seniorfull-time$159k–$207k / yearMassachusetts, Nevada, Pennsylvania · 🇺🇸 United States
Posted: 2 hours agoSource: boards.greenhouse.io
AWSCloudDistributed SystemsEC2PythonRaySparkSQL
Fanatics

Software Engineer III – Distributed, Kafka, Kotlin

Fanatics
Senior · Leadfull-time$120k–$215k / yearNew York · 🇺🇸 United States
Posted: 4 hours agoSource: fa-exki-saasfaprod1.fa.ocs.oraclecloud.com
JavaKafkaKotlinMicroservicesPostgresRedisSpringSpring BootSpringBoot
Dropbox

Senior Backend Product Software Engineer, Storage Management

Dropbox
Seniorfull-time$196k–$265k / year🇺🇸 United States
Posted: 13 hours agoSource: boards.greenhouse.io
Ro

Senior Software Engineer, Backend – Patient Experience

Ro
Seniorfull-time$182k–$220k / yearNew York · 🇺🇸 United States
Posted: 14 hours agoSource: jobs.lever.co
Distributed SystemsDjangoPython