Kunai

Senior Data Engineer

Kunai

full-time

Posted on:

Location Type: Remote

Location: United States

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AWSDistributed SystemsETLPySparkPythonShell ScriptingSQL

About the role

  • Prepare and manage pre-stage files for backbook conversion activities
  • Support and execute data ingestion tasks in alignment with scheduled project events, including key mock events
  • Monitor and ensure data ingestion completion within defined SLA windows
  • Troubleshoot and resolve ingestion issues promptly to maintain data integrity and project timelines
  • Maintain detailed documentation of ingestion processes, schedules, and completion statuses
  • Proactive problem-solving approach

Requirements

  • 3+ years of experience with data engineering principles and working experience with data-driven decision-making platforms
  • Experience in Python Development and PySpark
  • 2+ years of experience working in large data environments
  • Experience with data ingestion processes and ETL workflows
  • Experience with Snowflake or DataBricks
  • Expertise with high availability & distributed systems
  • Experience working with a variety of AWS services
  • Experience with serverless architectures and Lambdas
  • Experience with scripting languages (e.g., Python, Shell scripting) to automate data ingestion tasks is a plus
  • Familiarity with relational databases and querying languages such as SQL
  • Strong attention to detail and ability to meet strict SLAs
  • Effective communication skills, with ability to coordinate across teams
Benefits
  • Competitive compensation
  • Professional development opportunities
  • Flexible work arrangements
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
PythonPySparkETLdata ingestionAWSSnowflakeDataBricksSQLserverless architectureLambdas
Soft Skills
problem-solvingattention to detaileffective communication