
Data Engineer
Sun King
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇮🇳 India
Visit company websiteJob Level
JuniorMid-Level
Tech Stack
AirflowAmazon RedshiftAWSCloudEC2ETLNoSQLPySparkPythonSparkSQL
About the role
- Design and implement modern ETL/ELT architectures using cloud-based technologies.
- Develop and maintain data pipelines to pre-process and load data into databases for BI and application needs.
- Administer and manage databases to ensure high performance and availability.
- Work with the BI team to optimize the user experience in BI tools by aligning data preprocessing, database schema design, and data modeling.
- Monitor and optimize data storage, processing, and serving costs, and proactively suggest cost-effective improvements.
- Build data pipelines by integrating with REST APIs.
- Design and implement real-time data pipeline architectures for critical workflows.
- Develop a robust alerting system to detect and resolve data discrepancies efficiently.
Requirements
- Bachelor’s degree in Computer Science or a related quantitative field; relevant professional experience may be considered in lieu of formal education.
- Minimum 2 years of experience working as a Data Engineer.
- Strong proficiency in Python, SQL, Spark, and EC2, with hands-on experience in the AWS ecosystem.
- Practical experience with PySpark Glue jobs, Lambda functions, NoSQL databases, job orchestration using Airflow, and/or managing Redshift databases is a strong plus.
- Detail-oriented with a keen interest in examining data transformations and their impact on business outcomes.
- Excellent problem-solving and time management skills.
- Flexible and able to work effectively in a fast-paced, dynamic environment.
- Prior experience in project or team management is preferred; aptitude for mentoring and assisting others is a plus.
Benefits
- - Professional growth in a dynamic, rapidly expanding, high-social-impact industry
- - An open-minded, collaborative culture made up of enthusiastic colleagues who are driven by the challenge of innovation towards profound impact on people and the planet.
- - A truly multicultural experience: you will have the chance to work with and learn from people from different geographies, nationalities, and backgrounds.
- - Structured, tailored learning and development programs that help you become a better leader, manager, and professional through the Sun King Center for Leadership.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
ETLELTdata pipelinesPythonSQLSparkAWSPySparkNoSQLAirflow
Soft skills
problem-solvingtime managementdetail-orientedflexibilityteam managementmentoring