Truelogic Software

Senior Data Engineer – Databricks

Truelogic Software

full-time

Posted on:

Location Type: Remote

Location: Colombia

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

ETLPySparkPython

About the role

  • Design, build, and maintain scalable ETL pipelines for large-scale data processing.
  • Implement data transformations and workflows using PySpark at an intermediate to advanced level.
  • Work extensively with Databricks to develop, manage, and optimize data pipelines.
  • Optimize pipelines for performance, scalability, and cost efficiency across environments.
  • Troubleshoot, debug, and resolve data processing and pipeline issues.
  • Collaborate with cross-functional teams to gather requirements and deliver high-quality data solutions.
  • Apply best practices for data quality, governance, and performance tuning.
  • Document data workflows, design decisions, and operational processes to ensure maintainability.

Requirements

  • 5–7 years of professional experience in data engineering.
  • Strong hands-on proficiency with PySpark (intermediate to advanced level).
  • Solid experience working with Databricks, including Autoloader, Python-based workflows, and platform best practices.
  • Proven experience optimizing data pipelines for performance and cost efficiency.
  • Strong understanding of ETL processes and large-scale data transformations.
  • Excellent problem-solving skills with the ability to diagnose and resolve complex data issues.
  • Strong communication skills and the ability to collaborate effectively with both technical and non-technical stakeholders.
Benefits
  • 100% Remote Work: Enjoy the freedom to work from the location that helps you thrive. All it takes is a laptop and a reliable internet connection.
  • Highly Competitive USD Pay: Earn an excellent, market-leading compensation in USD, that goes beyond typical market offerings.
  • Paid Time Off: We value your well-being. Our paid time off policies ensure you have the chance to unwind and recharge when needed.
  • Work with Autonomy: Enjoy the freedom to manage your time as long as the work gets done. Focus on results, not the clock.
  • Work with Top American Companies: Grow your expertise working on innovative, high-impact projects with Industry-Leading U.S. Companies.
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
ETLPySparkdata transformationsdata workflowsperformance tuningdata qualitydata governancetroubleshootingdebuggingdata processing
Soft Skills
problem-solvingcommunicationcollaboration