FREE ACCESS
5,000–10,000 jobs/day
See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Tech Stack
Tools & technologiesAirflowAzureCloudETLGoJavaNumpyPandasPySparkPythonScalaSparkSQLTerraform
About the role
Key responsibilities & impact- Spearhead the design, construction, and upkeep of AI-enabled data pipeline
- Collaborate closely with project managers, engineers, and analysts
- Develop and maintain scalable data pipelines for ingesting, transforming, and distributing large datasets
- Design and implement secure data storage solutions
- Optimize data processing performance and cost efficiency through monitoring and tuning
- Integrate cloud services effectively for data engineering tasks while ensuring security and compliance
- Implement data governance measures and ensure compliance with regulations
- Utilize automation tools to streamline data operations
- Enhance real-time data insights for big data processing and analytics
- Support BI initiatives through integration with visualization tools
Requirements
What you’ll need- Bachelor's degree in Computer and Information Science or a related field
- 6 years of experience building and maintaining big data, advanced data pipelines and scalable data infrastructure
- Experience with Cloud-based technologies (Azure and Data Lakes)
- Lakehouse Storage Technologies and formats such as Azure Data Lake 2 (ADSL2), Delta Lake
- AI, machine learning, and modern data processing tools (Pandas, NumPy, and Matplotlib)
- Automation tools (Terraform and GitHub Actions)
- Database Skills (SQL, ETL processes)
- Big data technologies (Hive, Spark, PySpark, Airflow and Databricks)
- Visualization tools (Power BI, Looker)
- Programming languages (Python, Go, Scala, and Java)
Benefits
Comp & perks- Local telecommuting permitted.
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
Big DataData PipelinesData Storage SolutionsData ProcessingSQLETL ProcessesAIMachine LearningData VisualizationDatabase Skills
Soft Skills
CollaborationCommunication