Textlayer

Data Engineer

• Architect and maintain Python-based services using Flask and modern data frameworks for pipeline and workflow implementations
• Build and scale secure, well-structured API endpoints that interface with data stores, processing engines, and downstream applications
• Implement advanced data orchestration logic, ETL/ELT strategies, and tool chaining for complex data workflows
• Design and optimize data pipelines, including data loaders, transformation strategies, and integration with search systems like OpenSearch
• Develop and maintain ML data processing pipelines for ingesting, transforming, and serving data across various storage systems
• Containerize data services using Docker and implement scalable deployment strategies with Kubernetes
• Collaborate with engineering teams to productionize data models and processing workflows
• Optimize data processing techniques for improved performance, reliability, and cost efficiency
• Set up robust test coverage, monitoring, and CI/CD pipelines for data-powered backend services
• Stay current with emerging trends in data engineering, pipeline architectures, Agent architecture and data systems

Senior Data Engineer