Pmweb

Senior Data Engineer

Pmweb

full-time

Posted on:

Location Type: Remote

Location: Brasil

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AirflowApacheAWSAzureBigQueryCloudETLGoogle Cloud PlatformKafkaPySparkPythonSparkSQLTerraform

About the role

  • Develop ETL/ELT pipelines using Python and managed cloud services
  • Orchestrate data ingestion from multiple sources into a Data Lake/Warehouse
  • Provision and manage resources on AWS and GCP using Terraform
  • Monitor and optimize query performance
  • Implement automated data quality checks
  • Ensure pipeline observability

Requirements

  • Strong command of a diverse ecosystem of tools to support the end-to-end data lifecycle
  • Proficiency with robust orchestrators such as Apache Airflow or Prefect
  • Fluency in Apache Spark (PySpark)
  • Experience with dbt (data build tool)
  • Experience with cloud-native services such as AWS Glue, Azure Data Factory, or Google Cloud Dataflow
  • Experience with ingestion and streaming solutions such as Kafka or Fivetran
  • Advanced proficiency in Python
  • Solid experience with PySpark
  • Knowledge of AWS and GCP services (S3, Glue, BigQuery)
  • Advanced SQL for data warehousing
  • Familiarity with Databricks and Snowflake
Benefits
  • Health and Dental Insurance
  • Life Insurance
  • Childcare Assistance
  • Birthday Day Off
  • Wellhub
  • Transportation Allowance
  • Meal and/or Food Allowance
  • Language learning support
  • Education assistance
  • Certification support
  • 7 different work schedule options
  • Home Office Allowance
  • Structured performance review cycle and continuous feedback
  • Company profit sharing

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
PythonETLELTApache AirflowPrefectApache SparkPySparkdbtSQLTerraform