Explorium

Data Engineer

• Design, implement, test, deploy, and maintain production-grade data products—mainly focused on data pipelines, transformation layers, and real-time data systems.
• Own the full lifecycle of data product development—from concept and design to deployment and maintenance.
• Develop and maintain production ETL/ELT pipelines using DBT (on Spark) and orchestrated workflows in Databricks.
• Apply best practices in Python and SQL to create scalable, maintainable, and efficient data transformations.
• Build monitoring, alerting, and testing pipelines to ensure reliability and performance in production.
• Utilize LLMs and Generative AI technologies to enhance data workflows and feature engineering.
• Collaborated with leading industry data providers to assess and integrate third-party data assets, enhancing the quality and performance of Explorium’s data products.