Tech Stack
AirflowApacheAWSElasticSearchKubernetesMySQLPostgresPython
About the role
- Enhance and optimize enterprise-scale metadata management environment built on OpenMetadata
- Design, build, and maintain custom OpenMetadata connectors for metadata ingestion
- Extend and automate data lineage capture from multiple systems and repositories
- Debug, patch, and enhance backend features to improve stability and scalability
- Manage containerized deployments (Kubernetes/ECS) and implement monitoring solutions
- Optimize storage and retrieval using RDS (PostgreSQL/MySQL) and OpenSearch/Elasticsearch
- Orchestrate metadata workflows with Apache Airflow and integrate with existing pipelines
- Implement and maintain RBAC with Okta and oversee upgrade, backup, and high-availability strategies
- Collaborate closely with platform engineers and take ownership of feature development and operational stability
Requirements
- 5+ years in data engineering or platform engineering roles, with hands-on OpenMetadata experience
- Proficiency in ECS (AWS), Airflow, RDS, and OpenSearch/Elasticsearch
- Strong Python development skills for API integrations and connector development
- Proven experience implementing RBAC and identity management integrations (e.g., Okta)
- Skilled in container orchestration, infrastructure automation, and performance optimization
- Ability to merge and manage open-source updates into customized codebases
- Strong problem-solving skills and a track record of delivering production-grade, scalable solutions
- 100% Remote Work
- Highly Competitive USD Pay
- Paid Time Off
- Work with Autonomy and flexible time management
- Work with Top American Companies on high-impact projects
- Engagement activities and a culture that values well-being
- Diverse, global network (600+ professionals in 25+ countries)
- Collaboration with experienced senior professionals
ATS Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
OpenMetadataPythonECSAirflowRDSPostgreSQLMySQLOpenSearchElasticsearchRBAC
Soft skills
problem-solvingcollaborationownership