Senior Data Engineer
Tec2Cloud
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇧🇷 Brazil
Visit company websiteJob Level
Senior
Tech Stack
AzurePySparkPythonSparkSQL
About the role
- Design, develop, and maintain end-to-end data pipelines, ensuring scalability, performance, and reliability.
- Collaborate with data science teams and business stakeholders to understand requirements and translate analytical needs into efficient technical solutions.
- Implement and optimize processes for ingestion, transformation, and integration of data from multiple sources.
- Develop and maintain solutions in cloud environments (preferably Azure), using modern processing frameworks and tools.
- Contribute to data governance and quality, promoting best practices for version control, documentation, and pipeline automation.
- Participate in defining data architecture, including modeling, data lakes, and data warehouses.
- Support the continuous evolution of data engineering practices, fostering innovation and process improvements.
Requirements
- Advanced experience with data processing tools such as Spark, Databricks, and PySpark.
- Proficiency in the programming languages Python and SQL.
- Experience with cloud architectures (preferably Azure) and data orchestration using Azure Data Factory.
- Solid knowledge of data modeling, data lakes, and data warehouses.
- Experience with CI/CD and code versioning applied to data pipelines.
- Ability to work collaboratively in multidisciplinary teams.
- Advanced English.
Benefits
- 5 scheduled days off per year.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data pipelinesdata processingSparkDatabricksPySparkPythonSQLdata orchestrationAzure Data FactoryCI/CD
Soft skills
collaborationcommunicationinnovationprocess improvement