KMM

Senior Data Engineer

KMM

full-time

Posted on:

Location Type: Remote

Location: Remote • 🇧🇷 Brazil

Visit company website
AI Apply
Apply

Job Level

Senior

Tech Stack

AirflowApacheAWSAzureCloudDockerGrafanaOraclePostgresPrometheusPythonSparkSQL

About the role

  • Design, develop, and maintain robust, scalable, and secure data pipelines and architectures.
  • Collaborate with the data team and business stakeholders to ensure data availability and reliability.
  • Develop, orchestrate, and monitor data pipelines using Apache Airflow.
  • Implement monitoring and alerting routines (structured logs, metrics, and notifications).
  • Model and implement bronze, silver, and gold layers in a Databricks-based data lake.
  • Build and maintain data integrations from REST APIs, relational databases, CSV/Excel/Parquet files, and message queues.
  • Ensure pipeline observability and quality with unit and integration tests and up-to-date technical documentation.

Requirements

  • Proficiency in Python for developing pipelines and automations.
  • Advanced SQL knowledge (complex queries, tuning, indexes, CTEs, partitioning, materialized views).
  • Strong experience with Apache Airflow (orchestration, version control, monitoring).
  • Experience with PostgreSQL and data modeling for data lakes.
  • Familiarity with object storage (S3 or equivalent) and optimized file formats (Parquet, ORC, GZIP).
  • Experience with Git and good code versioning practices.
  • Knowledge of Oracle/PLSQL is a plus.
  • Experience with Databricks or similar environments (Spark, Delta Lake) is desirable.
  • Familiarity with Docker, DBT, and monitoring with Prometheus/Grafana is desirable.
  • Bachelor's degree in Computer Science, Software Engineering, Information Systems, or related fields.
  • Cloud or data engineering certifications (AWS, Azure, Databricks, etc.) are a plus.
Benefits
  • Health insurance with low co-payment.
  • Company-paid dental plan.
  • Company-paid life insurance for protection and peace of mind.
  • Flexible benefit for meals or groceries.
  • Gympass and Zenklub included in our benefits.
  • Day off on your birthday.

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
PythonSQLApache AirflowPostgreSQLDatabricksDockerDBTPrometheusGrafanadata modeling
Certifications
AWSAzureDatabricks
Extractta

Senior Oracle PL/SQL Engineer

Extractta
Seniorfull-time🇧🇷 Brazil
Posted: 2 hours agoSource: extractta.gupy.io
JavaOracleSQL
CI&T

Data Visualisation Engineer

CI&T
Juniorfull-time🇧🇷 Brazil
Posted: 2 days agoSource: jobs.lever.co
ETLSQL
FCamara Consulting & Training

Engenheiro IA

FCamara Consulting & Training
Mid · Seniorfull-time🇧🇷 Brazil
Posted: 5 days agoSource: fcamara.gupy.io
AirflowAWSAzureCloudDockerGoogle Cloud PlatformGraphQLJenkinsKubernetesNoSQLPandasPython+4 more
Reply

Engenheiro de Dados – Pleno

Reply
Mid · Seniorfull-time🇧🇷 Brazil
Posted: 7 days agoSource: jobs.quickin.io
Amazon RedshiftAWSCloudElasticSearchETLHadoopHBaseHDFSJavaMapReducePythonScala+2 more