FREE ACCESS
5,000–10,000 jobs/day
See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building and maintaining scalable data pipelines and infrastructure, with a strong focus on cloud technologies and data governance. Proficient in utilizing automation tools and big data technologies to enhance data processing and analytics capabilities.
Highest-signal resume keywords
Big Data TechnologiesCloud-Based TechnologiesData GovernanceAutomation ToolsProgramming Languages
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Big DataData PipelinesData Storage SolutionsData ProcessingSQLETL ProcessesAIMachine LearningData VisualizationDatabase Skills
Soft Skills
CollaborationCommunication
Tools & Technologies
AzureAzure Data Lake 2Delta LakePandasNumPyMatplotlibTerraformGitHub ActionsHiveSpark
Industry Keywords
Data GovernanceComplianceReal-Time Data InsightsBI InitiativesData Engineering
Tech Stack
Tools & technologiesAirflowAzureCloudETLGoJavaNumpyPandasPySparkPythonScalaSparkSQLTerraform
About the role
Key responsibilities & impact- Spearhead the design, construction, and upkeep of AI-enabled data pipeline
- Collaborate closely with project managers, engineers, and analysts
- Develop and maintain scalable data pipelines for ingesting, transforming, and distributing large datasets
- Design and implement secure data storage solutions
- Optimize data processing performance and cost efficiency through monitoring and tuning
- Integrate cloud services effectively for data engineering tasks while ensuring security and compliance
- Implement data governance measures and ensure compliance with regulations
- Utilize automation tools to streamline data operations
- Enhance real-time data insights for big data processing and analytics
- Support BI initiatives through integration with visualization tools
Requirements
What you’ll need- Bachelor's degree in Computer and Information Science or a related field
- 6 years of experience building and maintaining big data, advanced data pipelines and scalable data infrastructure
- Experience with Cloud-based technologies (Azure and Data Lakes)
- Lakehouse Storage Technologies and formats such as Azure Data Lake 2 (ADSL2), Delta Lake
- AI, machine learning, and modern data processing tools (Pandas, NumPy, and Matplotlib)
- Automation tools (Terraform and GitHub Actions)
- Database Skills (SQL, ETL processes)
- Big data technologies (Hive, Spark, PySpark, Airflow and Databricks)
- Visualization tools (Power BI, Looker)
- Programming languages (Python, Go, Scala, and Java)
Benefits
Comp & perks- Local telecommuting permitted.
