ShyftLabs

Senior Data Engineer

ShyftLabs

full-time

Posted on:

Location: 🇮🇳 India

Visit company website
AI Apply
Apply

Job Level

Senior

Tech Stack

AWSETLPythonRDBMSSQL

About the role

  • Act as the first point of contact for data issues in the Master Data Management (MDM) system.
  • Investigate and resolve data-related issues, such as duplicate data or missing records, ensuring timely and accurate updates.
  • Coordinate with the Product Manager, QA Lead, and Technology Lead to prioritize and address tickets effectively.
  • Work on Data related issues, ensuring compliance with regulations.
  • Build and optimize data models to ensure efficient storage and query performance, including work with Snowflake tables.
  • Write complex SQL queries for data manipulation and retrieval.
  • Collaborate with other teams to diagnose and fix more complex issues that may require code changes or system updates.
  • Utilize AWS resources like CloudWatch, Lambda, SQS, and Kinesis Streams for data storage, transformation, and analysis.
  • Update and maintain the knowledge base to document common issues and their solutions.
  • Monitor system logs and alerts to proactively identify potential issues before they affect customers.
  • Participate in team meetings to provide updates on ongoing issues and contribute to process improvements.
  • Maintain documentation of data engineering processes, data models, and system configurations.

Requirements

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Minimum of 6+ years of experience in data engineering, preferably related to MDM systems.
  • Strong expertise in SQL and other database query languages.
  • Hands-on experience with data warehousing solutions and relational database management systems (RDBMS).
  • Proficiency in ETL tools and data pipeline construction.
  • Familiarity with AWS services.
  • Excellent programming skills, preferably in Python.
  • Strong understanding of data privacy regulations like DSAR and CCPA.
  • Good communication skills, both written and verbal, with the ability to articulate complex data concepts to non-technical stakeholders.
  • Strong problem-solving skills and attention to detail.
Poppulo

SDE 2, Data Engineer

Poppulo
Mid · Seniorfull-time🇮🇳 India
Posted: 4 hours agoSource: boards.greenhouse.io
AirflowAmazon RedshiftAWSBigQueryCloudPySparkPythonSparkSQLTypeScript
EXL

Lead Assistant Manager – Data Engineering, Cloud Data Engineering

EXL
Seniorfull-time🇮🇳 India
Posted: 6 hours agoSource: fa-ewjt-saasfaprod1.fa.ocs.oraclecloud.com
AirflowAWSAzureCloudETLGoogle Cloud PlatformHadoopHDFSInformaticaPySparkPythonSpark+1 more
Western Digital

Principal Engineer – Enterprise Data Platform, Data Warehouse, Data Modeling, GCP, Azure, AWS

Western Digital
Leadfull-time🇮🇳 India
Posted: 16 hours agoSource: jobs.smartrecruiters.com
Amazon RedshiftAWSAzureBigQueryCloudERPETLInformaticaOraclePythonScalaSpark+1 more
Novartis

Business Data Migration Expert – Order to Cash

Novartis
Mid · Seniorfull-time🇮🇳 India
Posted: 17 hours agoSource: novartis.wd3.myworkdayjobs.com
ERP
Caterpillar Inc.

Senior Manager, Software Engineering – Data Engineering

Caterpillar Inc.
Seniorfull-time🇮🇳 India
Posted: 2 days agoSource: cat.wd5.myworkdayjobs.com
ApacheAWSAzureCloudETLJenkinsKafkaNoSQLSparkSQL