
Principal Software Engineer – Data Solution Implementation, Hadoop, Kafka, PySpark, DevOps
PNC
full-time
Posted on:
Location Type: Hybrid
Location: Pittsburgh • Alabama, Ohio, Pennsylvania, Texas • 🇺🇸 United States
Visit company websiteSalary
💰 $65,000 - $165,600 per year
Job Level
Lead
Tech Stack
AirflowApacheAWSAzureCloudDistributed SystemsETLHadoopJavaKafkaPySparkScalaSparkSQL
About the role
- Design and implement data solutions using cutting-edge technologies
- Collaborate with cross-functional teams and contribute to data governance and quality initiatives
- Build and maintain scalable data pipelines on cloud platforms
- Optimize data warehousing for high availability and performance
- Implement data modeling techniques to support analytics and reporting needs
- Ensure data quality and compliance across all processes
- Leverage big data frameworks such as Hadoop, Spark, and Kafka
- Utilize DevOps practices and CI/CD tools to automate workflows
- Monitor and maintain data systems for reliability
- Actively participate in Agile/SAFe ceremonies, including sprint planning and retrospectives
Requirements
- Proven expertise in cloud platforms like AWS, Azure, or Google Cloud
- Big data technologies such as Hadoop, Spark, Kafka, and Flink
- Strong programming skills in PySpark, Scala, SQL, and Java
- Experience in ETL processes, data modeling, and data warehousing
- Familiarity with DevOps tools, CI/CD workflows, and monitoring systems
- Excellent problem-solving and collaboration skills
- Thrive in a fast-paced Agile environment
- Preferred certifications: AWS Certified Data Engineer or Agile/SAFe Practitioner
- Experience with orchestration tools like Apache Airflow
- Background in large-scale distributed systems
- 5+ years of industry-relevant experience
- University/college degree or a comparable combination of education and experience
Benefits
- medical/prescription drug coverage (with a Health Savings Account feature)
- dental and vision options
- employee and spouse/child life insurance
- short and long-term disability protection
- 401(k) with PNC match
- pension and stock purchase plans
- dependent care reimbursement account
- back-up child/elder care
- adoption, surrogacy, and doula reimbursement
- educational assistance, including select programs fully paid
- a robust wellness program with financial incentives
- maternity and/or parental leave
- up to 11 paid holidays each year
- 8 occasional absence days each year, unless otherwise required by law
- between 15 to 25 vacation days each year, depending on career level; and years of service
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data solutionsdata pipelinesdata warehousingdata modelingETL processesPySparkScalaSQLJavabig data frameworks
Soft skills
problem-solvingcollaborationAgilecommunicationdata governancedata qualityreliabilityperformance optimizationcross-functional teamworkfast-paced environment
Certifications
AWS Certified Data EngineerAgile PractitionerSAFe Practitioner