CI&T

Senior Data Developer, Python, AWS

CI&T

full-time

Posted on:

Location Type: Hybrid

Location: Brazil

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AWSDynamoDBEC2ETLNumpyPandasPySparkPythonSQLTerraform

About the role

  • Understand technical requirements, refine tasks, and estimate timelines for deliverables.
  • Develop and enhance data ingestion applications in the AWS environment.
  • Build automated tests to ensure the quality of deliverables.
  • Apply software development best practices: design, naming conventions, test coverage, meeting requirements, and optimization.
  • Participate in incident management.
  • Participate in agile ceremonies such as daily stand-ups, planning, demos, and retrospectives.

Requirements

  • Experience and best practices with source control/versioning (Git, GitHub).
  • Experience in SQL for building, manipulating, and optimizing queries.
  • Experience with Python for ETL/ELT using libraries such as NumPy and Pandas.
  • Experience with PySpark for ETL/ELT.
  • Desirable knowledge of partitioning, lazy evaluation, caching, and UDFs using PySpark.
  • Experience with CI/CD tools.
  • Experience with relational and non-relational (NoSQL) databases.
  • Knowledge of dimensional data modeling.
  • Knowledge of data governance and data quality.
  • Knowledge of and best practices for unit testing using Python frameworks Unittest and Pytest.
  • Knowledge of Infrastructure as Code (IaC) using Terraform.
  • Experience with AWS and the following services:
  • Required:
  • - Access management: IAM.
  • - Storage: S3.
  • - Compute and processing: Glue.
  • Desirable:
  • - Storage: RDS and DynamoDB.
  • - Data governance: Lake Formation.
  • - Compute and processing: Lambda and EC2.
  • - Orchestration and scheduling: Step Functions and EventBridge.
  • - Querying and analytics: AWS Athena.
Benefits
  • Health and dental insurance;
  • Meal and food allowances;
  • Childcare assistance;
  • Extended parental leave;
  • Partnerships with gyms and health/wellness professionals via Wellhub (Gympass) and TotalPass;
  • Profit-sharing (PLR);
  • Life insurance;
  • Continuous learning platform (CI&T University);
  • Discount club;
  • Free online platform dedicated to physical and mental health and well-being;
  • Pregnancy and responsible parenthood course;
  • Partnerships with online course platforms;
  • Language learning platform;
  • And many more
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
SQLPythonETLELTPySparkGitGitHubCI/CDTerraformdimensional data modeling
Soft Skills
incident managementagile methodologiescommunicationcollaborationproblem-solving