ShyftLabs

Senior Data Engineer

ShyftLabs

full-time

Posted on:

Origin:  • 🇮🇳 India

Visit company website
✨ AI Apply
Manual Apply

Job Level

Senior

Tech Stack

AWSETLPythonRDBMSSQL

About the role

  • Act as the first point of contact for data issues in the Master Data Management (MDM) system.
  • Investigate and resolve data-related issues, such as duplicate data or missing records, ensuring timely and accurate updates.
  • Coordinate with the Product Manager, QA Lead, and Technology Lead to prioritize and address tickets effectively.
  • Work on Data related issues, ensuring compliance with regulations.
  • Build and optimize data models to ensure efficient storage and query performance, including work with Snowflake tables.
  • Write complex SQL queries for data manipulation and retrieval.
  • Collaborate with other teams to diagnose and fix more complex issues that may require code changes or system updates.
  • Utilize AWS resources like CloudWatch, Lambda, SQS, and Kinesis Streams for data storage, transformation, and analysis.
  • Update and maintain the knowledge base to document common issues and their solutions.
  • Monitor system logs and alerts to proactively identify potential issues before they affect customers.
  • Participate in team meetings to provide updates on ongoing issues and contribute to process improvements.
  • Maintain documentation of data engineering processes, data models, and system configurations.

Requirements

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Minimum of 6+ years of experience in data engineering, preferably related to MDM systems.
  • Strong expertise in SQL and other database query languages.
  • Hands-on experience with data warehousing solutions and relational database management systems (RDBMS).
  • Proficiency in ETL tools and data pipeline construction.
  • Familiarity with AWS services.
  • Excellent programming skills, preferably in Python.
  • Strong understanding of data privacy regulations like DSAR and CCPA.
  • Good communication skills, both written and verbal, with the ability to articulate complex data concepts to non-technical stakeholders.
  • Strong problem-solving skills and attention to detail.