Circana

Big Data Engineer

Circana

full-time

Posted on:

Location Type: Remote

Location: Remote • 🇺🇸 United States

Visit company website
✨ AI Apply
Apply

Salary

💰 $90,000 - $115,000 per year

Job Level

Mid-LevelSenior

Tech Stack

AirflowOraclePerlPostgresPySparkPythonShell ScriptingSpark

About the role

  • Create Python, Spark, Perl, Shell Scripting programs to process data sets
  • Maintain existing Python, Spark, Perl, Shell Scripts and C programs
  • Collaborate with cross-functional teams to understand data requirements and deliver high-quality solutions.
  • Learn and work extensively with in-house data tools and frameworks, contributing to their enhancement and integration.
  • Ensure data quality, governance, and security across all data assets.
  • Mentor junior engineers and promote best practices in data engineering.
  • Drive performance tuning, cost optimization, and automation of data workflows.
  • Participate in Agile ceremonies, code reviews, and technical design discussions.
  • Create required documentation and Provide interface documentation to other team members on interfaces
  • Follow established SOPs and practices
  • Validate data generated to confirm that desired values are created

Requirements

  • Bachelor’s degree or equivalent in computer science.
  • Minimum 5 years of experience in Python, Perl, C programming languages
  • Good understanding of Spark and pySpark
  • Good understanding of databases such as Hive, Postgres or Oracle
  • Should be familiar with scheduling tools such as Airflow or Control-M
  • A passion for technology and insatiable appetite to learn, learn-it-all attitude.
  • Strong communication skills, ability to write technical docs and present ideas
Benefits
  • paid time off
  • medical/dental/vision insurance
  • 401(k)

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
PythonSparkPerlShell ScriptingC programmingpySparkdatabasesHivePostgresOracle
Soft skills
communication skillsmentoringcollaborationbest practiceslearning attitudedocumentationpresentation skills
Certifications
Bachelor’s degree in computer science