PeerIslands

Data Engineer

• Develop and maintain scalable ETL/data pipelines using Databricks and AWS Glue.
• Build data ingestion and transformation workflows for structured and semi-structured data.
• Write efficient PySpark, Python, and SQL code for large-scale data processing.
• Integrate data from multiple sources, including MongoDB and relational databases.
• Implement data quality, validation, and reconciliation checks.
• Optimize pipeline performance, reliability, and scalability.
• Collaborate with architects, analysts, and application teams to deliver data solutions.
• Support production deployments, monitoring, and troubleshooting.

Software Engineer

• Design and oversee software architectures that leverage multiple programming languages such as Python, Java, Node, C#, Go, or Ruby.
• Build and manage real-time data processing pipelines using Apache Flink and integrate with streaming systems such as Kafka or Kinesis.
• Develop, optimize, and manage data storage and retrieval using MongoDB or other NoSQL databases.
• Provide technical leadership in building scalable, secure, and resilient software systems.
• Collaborate with software engineers, DevOps, and UX designers to ensure cohesive software architecture and seamless integrations.
• Optimize software performance, troubleshoot architectural issues, and implement best coding and security practices.
• Stay updated with emerging programming languages, frameworks, and industry trends to drive innovation.
• Ensure adherence to software development methodologies, CI/CD pipelines, and DevOps best practices.
• Mentor and guide development teams in adopting best practices for multi-language software development.
• Work with cloud platforms (AWS, Azure, GCP) to design and deploy robust infrastructure solutions.
• Define and enforce coding standards, system design principles, and architectural patterns.

Polyglot Developer, 5-10 years

Full-stack Engineer

• Design, develop, and maintain scalable backend systems, data platforms, and cloud-native applications, using Java, Spring, Spring Boot, and RESTful web services.
• Build and operate event-driven systems by consuming, processing, and publishing real-time events using Apache Kafka and Azure Event Hub.
• Design and implement batch and real-time data processing pipelines using Apache Spark and Spark Structured Streaming.
• Develop and maintain enterprise data platforms that ingest, validate, transform, and enrich data from multiple sources including relational databases, NoSQL databases, event streams, and flat files.
• Design, optimize, and manage MongoDB collections, indexes, aggregations, triggers, and queries to ensure performance, scalability, and reliability.
• Implement data storage and analytics solutions using Delta Lake, Azure Data Lake Storage, Azure SQL, Azure Synapse Analytics, and MongoDB.
• Deploy and maintain applications and data pipelines in cloud environments, primarily Microsoft Azure, using services such as Azure Databricks, Azure App Service, Azure Key Vault, and Azure Event Hub.
• Automate infrastructure provisioning and cloud resource management using Terraform (Infrastructure as Code).
• Optimize application performance, database queries, and data processing jobs to meet latency, throughput, and reliability requirements.
• Implement CI/CD pipelines using GitHub Actions and Jenkins to automate build, test, and deployment workflows.
• Write and maintain unit and integration tests using JUnit, ScalaTest, and Mockito.
• Collaborate with product owners, architects, and engineering teams to analyze requirements, design technical solutions, and deliver enhancements following Agile and Scrum methodologies.
• Maintain technical documentation and support production systems through ongoing enhancements and operational support.

Data Engineer

Polyglot Developer, 5-10 years

Principal Software Engineer