Grupo JCA

Senior Data Engineer

Grupo JCA

full-time

Posted on:

Location Type: Hybrid

Location: São Paulo • 🇧🇷 Brazil

Visit company website
✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AirflowAWSAzureCloudGoogle Cloud PlatformPandasPySparkPythonSparkSQLVault

About the role

  • Design, develop and maintain robust, scalable data pipelines (batch and streaming);
  • Structure, optimize and monitor data lakes and data warehouses in cloud environments;
  • Define and implement data engineering best practices, including versioning, CI/CD, observability, governance and security;
  • Ensure data quality through automated tests, validations and continuous monitoring;
  • Model data (dimensional, Data Vault) for consumption by analysts, data scientists and data products;
  • Support BI, Analytics and Product teams in providing reliable and well-documented datasets;
  • Evaluate and implement new technologies, tools and architectural patterns;
  • Collaborate with IT, Engineering, Product and Business teams, promoting a data-driven culture and best practices.

Requirements

  • Degree in Computer Engineering, Computer Science, Information Systems or related fields;
  • Strong experience with Spark, Databricks or an equivalent distributed engine;
  • Knowledge of:
  • - Advanced SQL;
  • - Advanced Python (pandas, pyspark);
  • - Cloud platforms (GCP, Azure or AWS);
  • - Orchestration: Airflow, Databricks Jobs, Workflows, n8n;
  • - Complex batch and streaming pipelines;
  • - Git, CI/CD and version control.
Benefits
  • Meal or Food Allowance / Voucher: no employee contribution
  • Grocery allowance (paid via benefit card)
  • Home Office allowance
  • Totalpass
  • Transportation Voucher: 6% employee contribution
  • Health plan: with co-payment
  • Dental plan: with co-payment
  • Life insurance
  • Birthday day off

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
data pipelinesdata lakesdata warehousesdata engineering best practicesautomated testsdata modelingSQLPythonSparkCI/CD
Soft skills
collaborationcommunicationdata-driven culture