Senior GCP Data Engineer

Dun & Bradstreet

Senior Data Engineer working at Dun & Bradstreet, designing and optimizing large-scale data systems for complex datasets to enhance identity graph.

Posted 7/21/2026full-timeHyderabad • 🇮🇳 IndiaSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and optimizing scalable data pipelines and ETL/ELT workflows, with strong proficiency in Python and SQL for large-scale data processing. Capable of contributing to data architecture and delivering production-grade solutions in cloud environments like Google Cloud Platform and AWS.

Highest-signal resume keywords

Data Pipeline DevelopmentPython ProgrammingSQL and Relational DatabasesGoogle Cloud PlatformData Modeling and Optimization

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data EngineeringETL/ELT WorkflowsData ArchitectureData ProcessingData ValidationDebugging and TroubleshootingDistributed SystemsData IngestionData NormalizationData Deduplication

Soft Skills

Analytical SkillsAttention to DetailIndependent DeliveryCollaborationAdaptability

Tools & Technologies

PostgresBigQueryRedshiftGoogle Cloud DataflowAWS S3DockerKubernetesGitJiraConfluence

Industry Keywords

Large-Scale Data ProcessingData QualityData InsightsCloud StorageCI/CD

Tech Stack

Tools & technologies

Amazon RedshiftAWSBigQueryCloudDistributed SystemsDockerETLGoogle Cloud PlatformKubernetesPostgresPythonSQL

About the role

Key responsibilities & impact

Design, build, and optimize scalable data pipelines and ETL/ELT workflows for large, complex datasets.
Design and implement foundational data architecture supporting identity resolution and ID graph systems.
Develop and enhance systems supporting identity resolution and ID graph construction (data ingestion, normalization, matching, and deduplication).
Process and unify multi-source datasets (cookies, device IDs, behavioral data, third-party and proprietary data).
Write efficient, testable, and maintainable code using Python and SQL for large-scale data processing.
Optimize data models, queries, and storage strategies for performance, scalability, and cost efficiency.
Build and maintain data validation, monitoring, and alerting systems to ensure data quality and reliability.
Troubleshoot, debug, and improve existing data pipelines and infrastructure.
Take ownership of complex data problems end-to-end, from initial design through production deployment.
Contribute to key technical decisions related to data architecture, scalability, and system design.
Collaborate with data, platform, DevOps, and product teams to deliver scalable, production-ready solutions.
Translate business and product requirements into practical, performant data solutions.
Document data pipelines, systems, and workflows clearly.
Continuously improve system performance, data quality, and pipeline resilience.
Contribute to building new capabilities that improve how customers understand and leverage data insights.

Requirements

What you’ll need

5–8+ years of hands-on experience in data engineering or large-scale data processing.
Proven experience building and maintaining production-grade data pipelines and distributed systems.
Experience contributing to the architecture and delivery of large-scale data platforms or mission-critical data systems.
Strong expertise in:
SQL and relational databases (Postgres, BigQuery, Redshift, etc.)
Python for data processing and analysis
Experience with Google Cloud Platform (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Cloud Functions) and/or AWS (S3, Redshift, EMR, RDS).
Experience working with large-scale datasets (hundreds of millions to billions of records).
Strong understanding of data modeling, partitioning, indexing, and query optimization.
Experience with distributed data processing and parallelization techniques.
Experience moving large volumes of data across systems and architectures.
Familiarity with CI/CD, containerization, and orchestration tools (Docker, Kubernetes, GitHub Actions, etc.).
Strong debugging and troubleshooting skills in complex data environments.
Experience with version control (Git) and Agile tools (Jira, Confluence, etc.).
Highly analytical with strong attention to detail and a data-driven mindset.
Ability to hit the ground running, quickly understand systems, and deliver independently.
Comfortable working in a remote, fast-paced, and collaborative environment.
Strong ability to contribute to system design and deliver implementations independently.

Benefits

Comp & perks

🌐 Worldwide ❌ Jobs You've Hidden ⭐️ Saved Jobs ✅ Applied Jobs ✉️ Email Alerts 👤 Account Dun & Bradstreet Website LinkedIn All Job Openings 5001 - 10000 employees Founded 1841 🤝 B2B 🏢 Enterprise 💸 Finance B2B
Enterprise
Finance Dun & Bradstreet is a global provider of business decisioning data and analytics. They offer comprehensive information on businesses, providing insights and intelligence to facilitate commercial credit decisions, B2B marketing, and supply chain management. Their services are designed to help companies make informed decisions by offering a vast database of commercial data from around the world. Dun & Bradstreet is widely recognized for its Data Universal Numbering System (DUNS number), which is used to identify businesses globally. Senior GCP Data Engineer 🔥 1 hour ago 🏢🏡 Hyderabad – Hybrid ⏰ Full Time 🟠 Senior 🚰 Data Engineer Amazon Redshift AWS BigQuery Cloud Distributed Systems Docker ETL Google Cloud Platform Kubernetes Postgres Python SQL Apply Now Find Hiring Managers Customize resume + cover letter Report problem ☆ Save ☑️ Mark as applied ❌ Hide 📋 Description
Design, build, and optimize scalable data pipelines and ETL/ELT workflows for large, complex datasets.
Design and implement foundational data architecture supporting identity resolution and ID graph systems.
Develop and enhance systems supporting identity resolution and ID graph construction (data ingestion, normalization, matching, and deduplication).
Process and unify multi-source datasets (cookies, device IDs, behavioral data, third-party and proprietary data).
Write efficient, testable, and maintainable code using Python and SQL for large-scale data processing.
Optimize data models, queries, and storage strategies for performance, scalability, and cost efficiency.
Build and maintain data validation, monitoring, and alerting systems to ensure data quality and reliability.
Troubleshoot, debug, and improve existing data pipelines and infrastructure.
Take ownership of complex data problems end-to-end, from initial design through production deployment.
Contribute to key technical decisions related to data architecture, scalability, and system design.
Collaborate with data, platform, DevOps, and product teams to deliver scalable, production-ready solutions.
Translate business and product requirements into practical, performant data solutions.
Document data pipelines, systems, and workflows clearly.
Continuously improve system performance, data quality, and pipeline resilience.
Contribute to building new capabilities that improve how customers understand and leverage data insights. 🎯 Requirements
5–8+ years of hands-on experience in data engineering or large-scale data processing.
Proven experience building and maintaining production-grade data pipelines and distributed systems.
Experience contributing to the architecture and delivery of large-scale data platforms or mission-critical data systems.
Strong expertise in:
SQL and relational databases (Postgres, BigQuery, Redshift, etc.)
Python for data processing and analysis
Experience with Google Cloud Platform (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Cloud Functions) and/or AWS (S3, Redshift, EMR, RDS).
Experience working with large-scale datasets (hundreds of millions to billions of records).
Strong understanding of data modeling, partitioning, indexing, and query optimization.
Experience with distributed data processing and parallelization techniques.
Experience moving large volumes of data across systems and architectures.
Familiarity with CI/CD, containerization, and orchestration tools (Docker, Kubernetes, GitHub Actions, etc.).
Strong debugging and troubleshooting skills in complex data environments.
Experience with version control (Git) and Agile tools (Jira, Confluence, etc.).
Highly analytical with strong attention to detail and a data-driven mindset.
Ability to hit the ground running, quickly understand systems, and deliver independently.
Comfortable working in a remote, fast-paced, and collaborative environment.
Strong ability to contribute to system design and deliver implementations independently. Apply Now 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score Similar Jobs Lead, Data Engineering 🕒 3 days ago S&P Global 10,000+ employees 💸 Finance 🏢 Enterprise 🤖 Artificial Intelligence Website LinkedIn All Job Openings Senior Data Engineer supporting offshore team in India by executing data pipeline onboarding and migration. Collaborating with Databricks team for operational excellence in the data platform. 🏢🏡 Hyderabad – Hybrid ⏰ Full Time 🟠 Senior 🚰 Data Engineer Apache AWS Cloud ETL Python Spark SQL Unity Senior Software Engineer – Data, License Team 🕒 4 days ago Sonatype 501 - 1000 🔒 Cybersecurity ☁️ SaaS Website LinkedIn All Job Openings Data Engineer designing and maintaining data pipelines and microservices at Sonatype. Empowering organizations with robust software supply chain security solutions. 🏢🏡 Hyderabad – Hybrid 💰 $80M Private Equity Round on 2018-09 ⏰ Full Time 🟠 Senior 🚰 Data Engineer Airflow AWS ETL HBase Java Jenkins Kafka Kubernetes Microservices MySQL NoSQL Postgres PySpark Python React Scala Scikit-Learn Spark Spring SQL Terraform Data Engineer 🕒 4 days ago Cisco 10,000+ employees 🔧 Hardware 🔐 Security 🏢 Enterprise Website LinkedIn All Job Openings Data Engineering technical leader designing and maintaining scalable data platforms at Cisco. Collaborating with diverse teams and leveraging advanced technologies for impactful business solutions. 🏢🏡 Hyderabad – Hybrid ⏰ Full Time 🟡 Mid-level 🟠 Senior 🚰 Data Engineer Cloud ETL Informatica Kafka Python SQL Unix Data Engineer 🕒 4 days ago Cisco 10,000+ employees 🔧 Hardware 🔐 Security 🏢 Enterprise Website LinkedIn All Job Openings Data Analytics Engineer responsible for designing and building data engineering solutions. Collaborating with the Growth Metrics Data Domain team at Cisco to ensure high-quality data processing. 🏢🏡 Hyderabad – Hybrid ⏰ Full Time 🟡 Mid-level 🟠 Senior 🚰 Data Engineer Cloud ETL Numpy Pandas Python SQL Senior Software Engineer – Data Engineering, Commerce Team 🕒 4 days ago Warner Bros. Discovery 10,000+ employees 📱 Media 📡 Telecommunications Website LinkedIn All Job Openings Senior Software Engineer developing data engineering solutions for Warner Bros. Discovery's Commerce Team. Designing scalable data pipelines and ensuring data integrity in production environments. 🏢🏡 Hyderabad – Hybrid ⏰ Full Time 🟠 Senior 🚰 Data Engineer ETL PySpark Python Spark View More Data Engineer Jobs 🌐 Worldwide Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com Search Search Jobs by country Search jobs by city Search jobs by job title Search entry-level jobs Search junior-level jobs Search senior-level jobs Search jobs by tech stack Search jobs by contract type Search remote internships Search remote part-time jobs Remote jobs Anywhere in the World Companies Hiring Anywhere in the World Companies Hiring Sales People Anywhere in the World Companies Hiring Software Engineers Anywhere in the World Resources Advice Tips for finding remote jobs Interview questions and answers Resume examples Cover letter examples Post a job Affiliates Privacy policy Terms of service Job board SEO course AI Apply Copilot OpenClaw job finder Find jobs using your resume Jobs by Country Remote jobs anywhere in the world (Worldwide remote jobs) Remote jobs United States Remote jobs Australia Remote jobs Brazil Remote jobs Canada Remote jobs France Remote jobs Ireland Remote jobs Germany Remote jobs Netherlands Remote jobs Spain Remote jobs UK Popular Jobs Remote data analyst jobs Remote customer support jobs Remote executive assistant jobs Remote marketing jobs Remote product designer jobs Remote product manager jobs Remote project manager jobs Remote recruiter jobs Remote sales jobs Remote software engineer jobs Jobs by Type Remote full-time jobs Remote part-time jobs Remote contract jobs Remote internship jobs Remote entry-level jobs Remote jobs with no experience required Remote junior jobs (1-3 years of experience) Digital nomad jobs Remote jobs with no degree required Freelance remote jobs Temporary remote jobs Remote jobs hiring now Stay at home mom jobs