Truelogic Software

Senior Data Engineer – Technology

Truelogic Software

full-time

Posted on:

Location Type: Remote

Location: Brazil

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

ApacheAWSETLPySparkPythonSparkSQL

About the role

  • Design, build, and optimize scalable data pipelines using PySpark and Apache Spark for distributed data processing.
  • Develop and maintain data models, ensuring proper integration of multiple data sources into a centralized data lake and data warehouse.
  • Implement efficient data transformations and optimize pipelines for performance, scalability, and reliability in large-scale environments.
  • Create and manage data solutions for analytics, including SQL-based transformations, AWS Athena views, Iceberg tables, and BI dashboards (QuickSight).
  • Collaborate with cross-functional teams and ensure data quality through monitoring, troubleshooting, and continuous improvement of data workflows.

Requirements

  • Strong hands-on experience with Apache Spark, PySpark, and AWS Glue, building scalable data pipelines in distributed environments.
  • Proven experience designing and maintaining AWS-based data architectures, including S3, Athena, and data warehouse solutions.
  • Advanced proficiency in Python and SQL, with experience processing and transforming large datasets in relational databases.
  • Experience with ETL/ELT pipelines, data lakes, and event-driven architectures, ensuring scalable and reliable data workflows.
  • Strong collaboration, analytical, and problem-solving skills, with experience working in Agile environments and building BI/reporting solutions (e.g., QuickSight).
Benefits
  • 100% Remote Work: Enjoy the freedom to work from the location that helps you thrive. All it takes is a laptop and a reliable internet connection.
  • Highly Competitive USD Pay: Earn an excellent, market-leading compensation in USD, that goes beyond typical market offerings.
  • Paid Time Off: We value your well-being. Our paid time off policies ensure you have the chance to unwind and recharge when needed.
  • Work with Autonomy: Enjoy the freedom to manage your time as long as the work gets done. Focus on results, not the clock.
  • Work with Top American Companies: Grow your expertise working on innovative, high-impact projects with Industry-Leading U.S. Companies.
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
PySparkApache SparkAWS GluePythonSQLETLELTdata modelingdata transformationdata architecture
Soft Skills
collaborationanalytical skillsproblem-solvingcontinuous improvement