SDE 2, Data Engineer
Poppulo
AirflowAmazon RedshiftAWSBigQueryCloudPySparkPythonSparkSQLTypeScript
Job Level
Lead
Tech Stack
HadoopJavaKafkaMapReduceNoSQLScalaSpark
About the role
- Staff Data Engineer for Bazaarvoice focusing on enrichment pipeline teams
- Maintain data enrichment platform responsible for data enrichment pipelines and bulk exports to clients and search partners
- Generate large-scale datasets for internal and external consumers
- Collaborate within a distributed, highly skilled team to design, develop and manage data pipelines
- Participate in coding and system design; support reliable Hadoop and streaming platform operations
Requirements
- Design, develop, and manage data pipelines
- 8+ years of Java development experience with Big Data Platform / Hadoop (MapReduce) ecosystem
- 5+ years of experience with streaming platforms (Spark / Scala / Kafka)
- Develop MapReduce code that works seamlessly on Hadoop clusters
- Exposure to any NoSQL database
- Hands-on engineer willing to dig into tough problems, learn quickly and explore new areas
Similar jobs on JobTailor
Lead Assistant Manager – Data Engineering, Cloud Data Engineering
EXL
AirflowAWSAzureCloudETLGoogle Cloud PlatformHadoopHDFSInformaticaPySparkPythonSpark+1 more
Principal Engineer – Enterprise Data Platform, Data Warehouse, Data Modeling, GCP, Azure, AWS
Western Digital
Amazon RedshiftAWSAzureBigQueryCloudERPETLInformaticaOraclePythonScalaSpark+1 more
Business Data Migration Expert – Order to Cash
Novartis
ERP
Senior Manager, Software Engineering – Data Engineering
Caterpillar Inc.
ApacheAWSAzureCloudETLJenkinsKafkaNoSQLSparkSQL