Tarmac.IO

Data Engineer

Tarmac.IO

full-time

Posted on:

Location Type: Hybrid

Location: Curitiba • 🇧🇷 Brazil

Visit company website
✨ AI Apply
Apply

Job Level

Mid-LevelSenior

Tech Stack

AirflowAmazon RedshiftApacheAWSAzureBigQueryCloudDjangoDockerDynamoDBFlaskGoogle Cloud PlatformJenkinsKafkaMongoDBMySQLNoSQLNumpyPandasPostgresPythonSparkSQLTerraform

About the role

  • Collaborating with Data Scientists, Analysts, and DevOps
  • Building and maintaining data ingestion and transformation scripts
  • Developing and consuming RESTful APIs for data exchange
  • Implementing testing for data workflows
  • Managing cloud infrastructure and databases

Requirements

  • Proficiency with libraries like pandas, numpy, and pyarrow.
  • Writing reusable, modular scripts for data ingestion and transformation.
  • Consuming and building RESTful APIs for data exchange.
  • Unit testing with pytest or unittest.
  • Familiarity with AWS / Azure / GCP services like S3, Lambda, Glue, Redshift, EMR, Data Factory, Blob Storage, Synapse, BigQuery, Cloud Functions, Dataflow.
  • Tools like Terraform or CloudFormation for Infrastructure as Code (IaC).
  • Managing access and permissions for Security & IAM.
  • SQL (PostgreSQL, MySQL), NoSQL (MongoDB, DynamoDB).
  • Building data services using frameworks like Flask, FastAPI, or Django.
  • Familiarity with Git, Docker, Jenkins, or GitHub Actions.
  • Pipeline orchestration tools like Apache Airflow, Prefect, or Luigi.
  • Data transformation using SQL, dbt, or Python scripts.
  • Understanding of Kafka, Spark Streaming, or Flink.
  • Ensuring data quality and pipeline reliability.
Benefits
  • Fresh fruit sometimes, spoiled fruit all the time.
  • You can work from anywhere, including your home.
  • Flexible hours.
  • Team lunches, Bday celebrations, happy hours.
  • Wellness program and company retreats.
  • English lessons.
  • Courses and training.

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
pandasnumpypyarrowRESTful APIsunit testingpytestunittestSQLNoSQLdata transformation
Soft skills
collaborationcommunicationproblem-solvingattention to detailadaptability