PNC

Principal Software Engineer – Data Solution Implementation, Hadoop, Kafka, PySpark, DevOps

PNC

full-time

Posted on:

Location Type: Hybrid

Location: Pittsburgh • Alabama, Ohio, Pennsylvania, Texas • 🇺🇸 United States

Visit company website
AI Apply
Apply

Salary

💰 $65,000 - $165,600 per year

Job Level

Lead

Tech Stack

AirflowApacheAWSAzureCloudDistributed SystemsETLHadoopJavaKafkaPySparkScalaSparkSQL

About the role

  • Design and implement data solutions using cutting-edge technologies
  • Collaborate with cross-functional teams and contribute to data governance and quality initiatives
  • Build and maintain scalable data pipelines on cloud platforms
  • Optimize data warehousing for high availability and performance
  • Implement data modeling techniques to support analytics and reporting needs
  • Ensure data quality and compliance across all processes
  • Leverage big data frameworks such as Hadoop, Spark, and Kafka
  • Utilize DevOps practices and CI/CD tools to automate workflows
  • Monitor and maintain data systems for reliability
  • Actively participate in Agile/SAFe ceremonies, including sprint planning and retrospectives

Requirements

  • Proven expertise in cloud platforms like AWS, Azure, or Google Cloud
  • Big data technologies such as Hadoop, Spark, Kafka, and Flink
  • Strong programming skills in PySpark, Scala, SQL, and Java
  • Experience in ETL processes, data modeling, and data warehousing
  • Familiarity with DevOps tools, CI/CD workflows, and monitoring systems
  • Excellent problem-solving and collaboration skills
  • Thrive in a fast-paced Agile environment
  • Preferred certifications: AWS Certified Data Engineer or Agile/SAFe Practitioner
  • Experience with orchestration tools like Apache Airflow
  • Background in large-scale distributed systems
  • 5+ years of industry-relevant experience
  • University/college degree or a comparable combination of education and experience
Benefits
  • medical/prescription drug coverage (with a Health Savings Account feature)
  • dental and vision options
  • employee and spouse/child life insurance
  • short and long-term disability protection
  • 401(k) with PNC match
  • pension and stock purchase plans
  • dependent care reimbursement account
  • back-up child/elder care
  • adoption, surrogacy, and doula reimbursement
  • educational assistance, including select programs fully paid
  • a robust wellness program with financial incentives
  • maternity and/or parental leave
  • up to 11 paid holidays each year
  • 8 occasional absence days each year, unless otherwise required by law
  • between 15 to 25 vacation days each year, depending on career level; and years of service

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
data solutionsdata pipelinesdata warehousingdata modelingETL processesPySparkScalaSQLJavabig data frameworks
Soft skills
problem-solvingcollaborationAgilecommunicationdata governancedata qualityreliabilityperformance optimizationcross-functional teamworkfast-paced environment
Certifications
AWS Certified Data EngineerAgile PractitionerSAFe Practitioner