
Data Engineer III
GOL Linhas Aéreas
full-time
Posted on:
Location Type: Hybrid
Location: São Paulo • Brazil
Visit company websiteExplore more
About the role
- Data Architecture and Orchestration: Design and implement complex data architectures (Medallion Architecture, Data Mesh, or Hub-and-Spoke), ensuring versioning and integrity of critical pipelines with LakeFlow, Delta Lake, and PySpark.
- Operational Excellence and FinOps: Lead cost and performance optimization at global scale on Azure. Analyze complex execution plans, manage cluster lifecycle, and define efficiency standards for the team.
- Governance and Security as Code: Establish and maintain governance models via Unity Catalog. Implement data quality frameworks (Great Expectations, checksums) and advanced monitoring that anticipate business-impacting failures.
- Technical Leadership and Mentorship: Define development standards (Clean Code, Design Patterns), conduct critical code reviews, and raise the technical bar for mid-level and junior engineers.
- Integration and Stakeholder Management: Collaborate with system architects and product owners to align data availability with the product roadmap. Integrate complex sources (SAP, mainframe, third-party APIs) securely and with high performance.
Requirements
- Education: Bachelor's degree in Computer Science, Engineering, Data Science, or a related field;
- Experience: Proven experience in data engineering with delivery of large-scale projects;
- SQL: Expert-level skills in tuning complex queries and data modeling;
- Spark ecosystem: Deep knowledge of Spark architecture (shuffle, partitioning, broadcast) for job optimization;
- Azure Cloud: Advanced experience with Data Lake Gen2, Azure Data Factory (ADF), and integration with Key Vault and VNETs;
- Advanced Python: Experience developing internal frameworks, libraries, and automation;
- Soft skills: Ownership mindset, ability to translate technical concepts for the business, and resilience in high-criticality environments.
Benefits
- Health insurance
- Dental insurance
- Group life insurance
- Meal allowance
- Food allowance
- Transportation allowance
- Gympass or Totalpass
- Partnership program with hundreds of affiliated companies
- Birthday day off
- Profit-sharing (PLR)
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data architecturedata orchestrationSQLPySparkdata modelingSpark architecturePythondata quality frameworkscost optimizationperformance optimization
Soft Skills
ownership mindsettechnical leadershipmentorshipstakeholder managementresiliencecommunicationcollaborationcritical thinkingproblem-solvingadaptability