
Senior Data Engineer, GCP
Cadmus Soluções em TI
full-time
Posted on:
Location Type: Hybrid
Location: São Paulo • 🇧🇷 Brazil
Visit company websiteJob Level
Senior
Tech Stack
AirflowBigQueryCloudGoogle Cloud PlatformKafkaMongoDBNoSQLPythonSQL
About the role
- Lead technical definitions and the architectural evolution of the data ecosystem on the GCP platform.
- Ensure scalability, security, and governance in data ingestion and data provisioning processes.
- Develop robust pipelines to integrate multiple sources, ensuring data quality and reliability.
- Propose continuous improvements in performance, monitoring, and process automation.
- Act as a technical reference, supporting strategic decisions and guiding teams on best practices.
- Contribute to innovation initiatives, including the use of AI and the creation of new data products aligned with business needs.
Requirements
- Strong experience as a Data Engineer with a proven track record in complex projects.
- Extensive experience in large-scale data ingestion, transformation, and integration projects.
- Advanced proficiency in Python for developing pipelines and automations.
- Expertise in Google Cloud Platform (GCP), including BigQuery, Cloud Storage, Dataflow, and Pub/Sub.
- Proficiency in SQL for optimized queries and data modeling.
- Advanced experience with orchestration and distributed processing tools such as Airflow, Kafka, and Cloud Functions.
- Knowledge of Vertex AI and applications of Artificial Intelligence in data pipelines.
- Familiarity with NoSQL databases (e.g., Firestore, MongoDB).
- Experience with SAP ECC or S/4HANA data models.
- Experience with visualization tools (preferably Power BI) to support analyses.
- Previous involvement in defining scalable architectures and performance-oriented solutions.
- Experience with Agile methodologies (Scrum, Lean, Kanban).
- Bachelor's degree in Statistics, Mathematics, Data Science, Engineering, or related fields.
Benefits
- Hybrid work 📊 Resume Score Upload your resume to see if it passes auto-rejection tools used by recruiters Check Resume Score
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
PythonSQLdata ingestiondata transformationdata integrationdata modelingorchestration toolsdistributed processingNoSQL databasesdata visualization
Soft skills
leadershipcommunicationstrategic decision-makinginnovationprocess automationbest practices guidanceperformance improvementteam supportscalabilitygovernance