KlearNow

Data Engineer

• Consume and extract data from relational databases (like MySQL) and NoSQL databases (like MongoDB).
• Build and maintain data ingestion pipelines using integration platforms (like Hevo) to move data from source systems.
• Transform and process data using Python and distributed processing frameworks (like PySpark) for warehouse optimization.
• Design and implement efficient data loading strategies into cloud data warehouses (like Amazon Redshift).
• Develop data transformation models and workflows using modern ETL frameworks (like dbt).
• Optimize warehouse schemas and queries for Business Intelligence consumption.
• Collaborate with database administrators and analysts to ensure seamless data flow.
• Monitor and troubleshoot data pipelines from source databases through to the data warehouse Ensure data quality, consistency, and governance throughout the ingestion process.
• Support BI teams with data warehouse preparation and access patterns