Hand Talk

Mid-level Data Engineer

Hand Talk

full-time

Posted on:

Location Type: Remote

Location: Brazil

Visit company website

Explore more

✨ AI Apply
Apply

Tech Stack

AirflowApacheAWSCassandraDockerKubernetesMongoDBMySQLPostgresPythonSQLTerraform

About the role

  • Work closely with Full Stack developers, other data engineers, and data scientists to deliver production-ready data via APIs or ML models.
  • Implement the architecture of a data platform (Data Lakehouse) and maintain the data lifecycle, ensuring integrity at every stage of the pipeline.
  • Configure and optimize Apache Iceberg tables to support ACID transactions, schema evolution, and hidden partitioning, ensuring consistency and concurrent reads.
  • Build automated Airflow workflows with preprocessing and metadata extraction using a factory pattern.
  • Implement data contracts and automated pipeline quality tests, ensuring the Lakehouse is a reliable source of truth for the company's products.
  • Apply DevOps best practices to ensure the platform infrastructure is provisioned with Terraform.

Requirements

  • Strong knowledge of the AWS ecosystem: S3, Glue, Athena, DataZone, Lambda applied in a data platform context;
  • Proven experience in data engineering, with a track record of implementing and maintaining data platforms (Data Warehouses, Data Lakes, or Data Lakehouses) and orchestrating pipelines (Airflow);
  • Proven experience with Apache Iceberg and Parquet/Avro formats, as well as unstructured and semi-structured data;
  • Proficiency in programming languages such as Python and SQL;
  • Experience with IaC (Terraform) for provisioning data resources;
  • Knowledge of relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra);
  • Familiarity with infrastructure tools such as Docker and Kubernetes;
  • Effective and open communication;
  • Ability to take initiative;
  • Willingness to learn;
  • Comfort with uncertainty and ambiguity;
  • Comfortable working in a dynamic environment in the era of AI and transformation.
Benefits
  • CLT employment contract: Your security and full labor rights guaranteed from day one.
  • Caju Benefits Card (R$ 1,160.00): Flexible balance to spend as you choose — meal, groceries, home office, culture, and mobility.
  • Remote work — from anywhere in Brazil! Enjoy flexibility and comfort.
  • SulAmérica Health Plan
  • SulAmérica Dental Plan
  • SulAmérica Life Insurance
  • Online medical consultations via Conexa Saúde — telemedicine.
  • Wellhub: Support to help you perform at your best.
  • Extended year-end break: Celebrate the holidays with more peace of mind — enjoy an extended period to recharge with family and friends.
  • Birthday day off: Take a special day off in your birthday month.
  • Extended parental leave: Support and quality time for those building or expanding their families.
  • Continuous professional development: Access leading platforms such as LinkedIn Learning, plus an annual allowance for courses and training in your area. Invest in yourself!
  • University partnerships: Support to go further through discounts and giveaways.
  • Brazilian Sign Language (Libras) training: Learn this important language for our community.
  • English language support: Through partnerships, we encourage learning a new language.
  • Work equipment provided as part of your onboarding kit.
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
data engineeringdata platformsApache IcebergAirflowPythonSQLTerraformrelational databasesNoSQL databasesdata contracts
Soft Skills
effective communicationinitiativewillingness to learncomfort with uncertaintyadaptability