KANINI

Data Engineer

• Design, develop, and maintain scalable batch and real-time data pipelines on GCP
• Implement and manage Medallion Architecture (Bronze, Silver, Gold layers) for data processing
• Build high-performance data transformations using Python and PySpark
• Develop and optimize complex SQL queries for analytical workloads
• Work extensively with BigQuery for large-scale data processing and performance tuning
• Develop and deploy pipelines using Cloud Dataflow
• Orchestrate workflows using Cloud Composer (Apache Airflow)
• Manage data storage and lifecycle using Google Cloud Storage (GCS)
• Implement version control and CI/CD pipelines using Git-based tools
• Ensure data security, governance, and access control using GCP IAM
• Optimize data solutions for performance, scalability, reliability, and cost-efficiency

Senior GCP Data Engineer