Data Engineer

• Build and optimize ETL pipelines for large-scale AI applications, integrating APIs, web scraping, and real-time data processing.
• Develop and maintain scalable AI data infrastructure using PySpark, Pandas, SQL, and cloud services (Azure, AWS, GCP).
• Implement retrieval-augmented generation (RAG) pipelines using FAISS, ChromaDB, and Pinecone for AI-driven insights.
• Deploy and monitor AI applications using FastAPI, Streamlit, Docker, for real-time performance.
• Work with cross-functional teams to ensure data security, compliance, and AI model reliability in production environments.

AI Data Engineer optimizing ETL pipelines and scalable data infrastructure for AI applications

AI Data Engineer – Generative AI, Scalable Data Pipelines

AI Data Engineer focusing on building ETL pipelines and maintaining data infrastructure for large-scale AI applications. Collaborating with cross-functional teams for AI model deployment and monitoring.

• Own the deployment, scaling, and orchestration of core data stack using AWS Managed Workflows for Apache Airflow (MWAA).
• Design and evolve the overall data platform architecture, making thoughtful tradeoffs around scalability, reliability, cost, and maintainability.
• Configure and optimize raw data storage in S3, managing Redshift external schemas (Spectrum) and AWS Glue Data Catalog.
• Define efficient partitioning strategies, leverage columnar file formats (Parquet), and optimize storage layouts for query performance, scalability, and cost.
• Design scalable analytical data models using dimensional modeling and lakehouse best practices to support reporting, analytics, and downstream consumers.
• Manage and optimize dbt to ensure efficient transformation, testing, and materialization of raw data within Amazon Redshift.
• Build observability into the data platform through monitoring, logging, alerting, and operational dashboards.
• Help design and implement the transition toward event-based ingestion into S3.
• Implement and maintain CI/CD deployment pipelines for dbt projects, Airflow DAGs, and infrastructure.
• Ensure high performance, access control, and uptime for BI tools connecting to Redshift.

Senior Data Engineer managing data platform architecture and scalability

Senior Data Engineer

Senior Data Engineer managing and modernizing the data platform at the company. Focusing on deployment, scaling, and data transformation with AWS services.

• The Enterprise Data Platform stream delivers outcomes to help different parts of the bank gain meaningful insights from their Data Assets.
• Our core function spans multiple Data Warehouses, Hadoop, Business Intelligence and Analytics Cluster within Information Management.
• The work involves providing delivery and support of platforms spanning over Hadoop, DWH, ETL, Reporting & Analytics application landscape.
• You will be handling critical applications that influence bank’s management decision making process, regulatory reporting (which can influence financial/non-financial penalties) and operational reporting.

Assistant Vice President managing data platforms and analytics for the bank

Assistant Vice President – Technology, Data Warehouse

Assistant Vice President managing data platforms across Data Warehouses and Hadoop. Delivering insights and supporting decision-making processes impacting the bank’s operations.

• Execute migrations using SAP Migration Cockpit (LTMC / LTMOM)
• Map B1 objects (materials, BOMs, vendors, customers, GL, open items) to S/4HANA structures
• Lead data quality assessment, cleansing, and deduplication of legacy B1 data
• Build extract-transform-load routines and staging/validation processes
• Define and execute validation and reconciliation against source and target
• Support mock loads, dress rehearsals, and production cutover loads

SAP Data Migration Specialist leading data migration efforts for SAP S/4HANA

SAP S/4HANA Data Migration Specialist

SAP Data Migration Specialist leading data migration from SAP Business One to S/4HANA. Collaborating to ensure quality data migration for manufacturing clients in a remote-first environment.

• Administer and manage the organization's Power BI environment, including Power BI Service and Power BI Report Server.
• Configure and optimize server settings, data gateways, and data source connections for efficient data processing and distribution.
• Create and manage user accounts, groups, and roles within the Power BI environment.
• Enforce security policies to control access to reports, datasets, and dashboards.
• Collaborate with the IT security team to ensure compliance with data protection regulations and company policies.
• Implement and enforce data governance best practices to maintain data quality, accuracy, and consistency across reports and dashboards.
• Assist report developers in optimizing report performance, data modeling, and visualization design.
• Publish reports and dashboards to appropriate workspaces, taking into consideration user access and usage requirements.
• Monitor system health, performance, and usage patterns to identify potential issues and bottlenecks.
• Troubleshoot technical problems, performance degradation, and data refresh failures.
• Develop and maintain backup and disaster recovery strategies for Power BI reports, datasets, and configurations.
• Collaborate with business users, report authors, and stakeholders to understand their requirements and provide technical support.
• Conduct training sessions for users to promote self-service reporting and data exploration.
• Keep up-to-date with Power BI updates, new features, and enhancements. Plan and execute platform upgrades when necessary.
• Document Power BI environment configurations, processes, and best practices

BI Administrator managing Power BI environment for data-driven decision-making

Manager, BI Admin – Digital Data Platforms

BI Administrator optimizing Power BI services and ensuring data security for a Bank. Collaborating with stakeholders and providing technical support in a data analytics driven organization.

Data Engineer jobs in Pakistan

See all jobs on JobTailor

AI Data Engineer – Generative AI, Scalable Data Pipelines

Senior Data Engineer

Assistant Vice President – Technology, Data Warehouse

SAP S/4HANA Data Migration Specialist

Manager, BI Admin – Digital Data Platforms