PNC

Senior Data Engineer, Python & PySpark

PNC

full-time

Posted on:

Origin:  • 🇺🇸 United States • Alabama, Ohio, Pennsylvania

Visit company website
✨ AI Apply
Manual Apply

Salary

💰 $110,500 - $171,925 per year

Job Level

Senior

Tech Stack

ApacheAWSCloudDockerHadoopKafkaKubernetesLinuxOpenShiftPySparkPythonSDLCShell ScriptingSparkSQLUnix

About the role

  • Leads in developing, supporting and implementing data solutions for multiple applications to meet business objectives and user requirements.
  • Leverages technical knowledge and industry experience to design, build and maintain technology solutions.
  • Leads data requirement analysis and the data preparation process development for targeted data solutions.
  • Leads in designing and building data service infrastructure on multiple data platforms, according the workflow.
  • Oversees the development and implementation of data solutions for multiple applications to ensure its scalability, availability and maintainability.
  • Consults on data migration and transformation to ensure the accuracy and security of data solutions.

Requirements

  • 5+ years of industry-relevant experience
  • Extensive experience with big data technologies and distributed computing tools (Hadoop, Spark, Hive Kafka, etc.)
  • Strong proficiency in Python, PySpark, Spark, SQL
  • Proficient in Containerization (OpenShift, Kubernetes, Docker, etc.)
  • Experience with public cloud platforms – Apache Ice-burg and AWS
  • S3
  • Knowledge of Unix/Linux shell scripting
  • Education: Bachelor's degree or equivalent; in lieu of degree, comparable combination of education, certification(s), and experience may be considered
  • Preferred Skills: Analytical Thinking, Data Analytics, Data Mining, Data Science, Machine Learning
  • Competencies: Application Delivery Process, Big Data Management and Analytics, Business Intelligence, Consulting, Data Analysis - Software, Data Architecture, Database Structures, Problem Solving, Software Development Life Cycle