Data Engineer

• Play a critical role in architecting and developing pipelines that transform raw IoT data into actionable intelligence
• Build robust data models that ensure data quality and consistency, enabling downstream analytics and AI/ML applications that optimize operations, enhance user experiences, and unlock new business opportunities
• Design and implement scalable data engineering pipelines for ingesting, transforming, and storing IoT telemetry data using Apache Flink, Apache Spark, and Databricks
• Build and maintain time-series data solutions using PostgreSQL and TimescaleDB to support high-resolution telemetry analytics
• Integrate data governance frameworks for metadata management, lineage tracking, and compliance within a data lake ecosystem
• Apply performance tuning techniques in Databricks to optimize batch processing speed and resource utilization
• Design and implement Infrastructure as Code (IaC) solutions using Terraform and Azure Bicep to provision and manage cloud resources across multi-cloud environments
• Optimize and monitor pipeline performance and resource utilization across distributed environments such as Kubernetes and Databricks clusters
• Leverage telemetry and diverse data sources to design, test, and deploy AI/ML solutions, collaborating with data scientists and engineers to build deep learning capabilities within the platform for prediction, early alerting, and prescriptive recommendations
• Define appropriate business metrics to measure the impact of AI/ML solutions within the platform
• Write scalable, distributed, and highly efficient code, in languages such as Python, Java, PySpark, Scala, and R

Senior Data Engineer

Lead Data Engineer

Junior Data Engineer

Data Engineer II, AWS, Databricks

ETL Data Engineer, Databricks