Designs, develops, modifies, configures, debugs and evaluates jobs for extracting data from various sources, implements transformation logic, and stores data in various formats fit for use by stakeholders.
Collects metadata about jobs including data lineage and transformation logic.
Works with teams, clients, data owners, and leadership throughout the development cycle practicing continuous improvement.
Leads a team on moderately complex to complex data and analytics-centric problems having broad impact that require in-depth analysis and judgment to obtain results or solutions.
Identifies, designs and implements internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
Resolves application programming analysis problems of broad scope within procedural guidelines.
Provides assistance to other programmers/analysts on unusual or especially complex problems that cross multiple functional/technology areas.
Conceptualizes and generates infrastructure that allows big data to be accessed and analyzed with verified data quality and metadata is appropriately captured and catalogued.
Collaborates with peers to develop departmental standards, norms, and new goals/objectives.
Plans work to meet assigned general objectives; reviews progress regularly and solutions may provide an opportunity for creative/non-standard approaches.
Assesses data pipeline performance and suggests/implements changes as required.
Communicates (oral and written) recommendations.
Mentors/provides guidance to less experienced colleagues.

Requirements

BA/BS in Computer Science, Management Information Systems or related field of study, or equivalent experience
7 years of experience with data engineering/ETL ecosystems such as Palantir Foundry, Spark, Informatica, SAP BODS, OBIEE
Experience with multiple data engineering/ETL ecosystems
Experience with machine learning algorithm deployment
Master’s degree in Computer Science, Management Information Systems or related field, or equivalent experience (desired)
Experience leading development teams
Business Intelligence and data access tool expertise, including advanced SQL, data modeling, and performance optimization.
Strong software engineering fundamentals (Git, CI/CD, unit and integration testing) with production data pipelines experience
Proficiency in Python and SQL within Palantir Foundry, including PySpark-based transformations and data workflows

Benefits

This job is also eligible to participate in PG&E’s discretionary incentive compensation programs.

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

data engineeringETLmachine learningadvanced SQLdata modelingperformance optimizationPythonPySparkGitCI/CD

Soft Skills

leadershipcommunicationmentoringcollaborationproblem-solvingcontinuous improvementanalytical thinkingcreativityguidanceorganizational skills