Senior Data Engineer
CI&T
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇵🇹 Portugal
Visit company websiteJob Level
Senior
Tech Stack
AirflowAmazon RedshiftAWSAzureBigQueryCloudETLKafkaNoSQLPythonSparkSQLTableauTerraform
About the role
- Design, build, and maintain scalable, high-quality data pipelines for structured and unstructured data.
- Implement robust data ingestion, transformation, and storage using cloud-based technologies.
- Collaborate with stakeholders to understand business goals and translate them into data engineering solutions.
- Monitor, troubleshoot, and optimize data pipelines for reliability and performance.
- Support data validation, testing, and documentation processes.
- Contribute to the design and deployment of modern data architectures (e.g., data lakes, lakehouses, data warehouses).
- Apply Infrastructure-as-Code (IaC) practices for provisioning and managing cloud resources.
- Integrate emerging tools and frameworks to modernize existing data environments.
- Ensure security, governance, and compliance in all stages of data handling.
- Work in agile teams, contributing to continuous improvement and mentoring junior team members.
Requirements
- Proven experience in data pipeline development using Python and SQL.
- Hands-on experience with cloud platforms such as AWS (Glue, Redshift, EMR) or Azure (ADF, Synapse)
- Proficiency with ETL/ELT tools and frameworks (e.g., Talend, Azure Data Factory, Airflow, DBT).
- Familiarity with modern data warehouses and lakehouses (e.g., Snowflake, BigQuery, Databricks).
- Experience with Infrastructure-as-Code tools (Terraform, CloudFormation, ARM templates).
- Strong understanding of data modeling, database design (SQL and NoSQL), and performance optimization.
- Knowledge of version control (Git) and task management tools (JIRA, Confluence).
- Fluent English communication skills (written and spoken) to operate in global teams.
- Awareness of data security, compliance (e.g., GDPR), and privacy best practices.
- Nice to Have:
- Experience with real-time/streaming data architectures (Kafka, EventHub, Spark Streaming).
- Familiarity with BI and visualization tools (Power BI, Tableau, Looker).
- Knowledge of DevOps practices and CI/CD integration for data workloads.
- Exposure to data quality frameworks and observability tools.
- Cloud certification (e.g., AWS Data Analytics, Azure Data Engineer Associate).
- Familiarity with machine learning pipelines or MLOps frameworks.
- Experience with data migration or modernization from legacy systems to cloud-native architectures.
Benefits
- Competitive Salary
- Generous paid vacation days
- Generous sick time
- 100% paid health & dental benefits starting day one
- Annual profit-sharing distribution
- Paid parental leave
- Dedicated career advisor
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data pipeline developmentPythonSQLETL toolsELT toolsdata modelingdatabase designperformance optimizationInfrastructure-as-Codereal-time data architectures
Soft skills
collaborationcommunicationmentoringtroubleshootingcontinuous improvement
Certifications
AWS Data AnalyticsAzure Data Engineer Associate