SDE 2, Data Engineer
Poppulo
AirflowAmazon RedshiftAWSBigQueryCloudPySparkPythonSparkSQLTypeScript
Job Level
Senior
Tech Stack
AWSETLPythonRDBMSSQL
About the role
- Act as the first point of contact for data issues in the Master Data Management (MDM) system.
- Investigate and resolve data-related issues, such as duplicate data or missing records, ensuring timely and accurate updates.
- Coordinate with the Product Manager, QA Lead, and Technology Lead to prioritize and address tickets effectively.
- Work on Data related issues, ensuring compliance with regulations.
- Build and optimize data models to ensure efficient storage and query performance, including work with Snowflake tables.
- Write complex SQL queries for data manipulation and retrieval.
- Collaborate with other teams to diagnose and fix more complex issues that may require code changes or system updates.
- Utilize AWS resources like CloudWatch, Lambda, SQS, and Kinesis Streams for data storage, transformation, and analysis.
- Update and maintain the knowledge base to document common issues and their solutions.
- Monitor system logs and alerts to proactively identify potential issues before they affect customers.
- Participate in team meetings to provide updates on ongoing issues and contribute to process improvements.
- Maintain documentation of data engineering processes, data models, and system configurations.
Requirements
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Minimum of 6+ years of experience in data engineering, preferably related to MDM systems.
- Strong expertise in SQL and other database query languages.
- Hands-on experience with data warehousing solutions and relational database management systems (RDBMS).
- Proficiency in ETL tools and data pipeline construction.
- Familiarity with AWS services.
- Excellent programming skills, preferably in Python.
- Strong understanding of data privacy regulations like DSAR and CCPA.
- Good communication skills, both written and verbal, with the ability to articulate complex data concepts to non-technical stakeholders.
- Strong problem-solving skills and attention to detail.
Similar jobs on JobTailor
Lead Assistant Manager – Data Engineering, Cloud Data Engineering
EXL
AirflowAWSAzureCloudETLGoogle Cloud PlatformHadoopHDFSInformaticaPySparkPythonSpark+1 more
Principal Engineer – Enterprise Data Platform, Data Warehouse, Data Modeling, GCP, Azure, AWS
Western Digital
Amazon RedshiftAWSAzureBigQueryCloudERPETLInformaticaOraclePythonScalaSpark+1 more
Business Data Migration Expert – Order to Cash
Novartis
ERP
Senior Manager, Software Engineering – Data Engineering
Caterpillar Inc.
ApacheAWSAzureCloudETLJenkinsKafkaNoSQLSparkSQL