Create Python, Spark, Perl, Shell Scripting programs to process data sets
Maintain existing Python, Spark, Perl, Shell Scripts and C programs
Collaborate with cross-functional teams to understand data requirements and deliver high-quality solutions.
Learn and work extensively with in-house data tools and frameworks, contributing to their enhancement and integration.
Ensure data quality, governance, and security across all data assets.
Mentor junior engineers and promote best practices in data engineering.
Drive performance tuning, cost optimization, and automation of data workflows.
Participate in Agile ceremonies, code reviews, and technical design discussions.
Create required documentation and Provide interface documentation to other team members on interfaces
Follow established SOPs and practices
Validate data generated to confirm that desired values are created

Requirements

Bachelor’s degree or equivalent in computer science.
Minimum 5 years of experience in Python, Perl, C programming languages
Good understanding of Spark and pySpark
Good understanding of databases such as Hive, Postgres or Oracle
Should be familiar with scheduling tools such as Airflow or Control-M
A passion for technology and insatiable appetite to learn, learn-it-all attitude.
Strong communication skills, ability to write technical docs and present ideas

Benefits

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

PythonSparkPerlShell ScriptingC programmingpySparkdatabasesHivePostgresOracle

Soft Skills

communication skillsmentoringcollaborationbest practiceslearning attitudedocumentationpresentation skills

Certifications

Bachelor’s degree in computer science