FREE ACCESS
5,000–10,000 jobs/day
See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Data Engineer, Enterprise Data Product
GlobalPeopleTransitionsData Engineer optimizing global datalake for a constantly growing organization and ensuring high data quality and performance. Responsibilities include designing and implementing data processing pipelines.
Tech Stack
Tools & technologiesAzureCloudNumpyPandasPythonShell ScriptingSparkSQLUnix
About the role
Key responsibilities & impact- Maintain, develop, and optimize the global datalake environment, ensuring high data quality, reliability, and overall performance
- Design and implement high-performance data processing pipelines and workflows utilizing Python, Spark , and Databricks
- Manage scalable and efficient data integration and processing solutions using Azure Data Factory, Databricks, and Event Hub
- Establish robust data management processes and execute advanced data querying and quality control with SQL and big data technologies
- Automate operational tasks and support infrastructure maintenance by leveraging shell scripting and foundational UNIX knowledge
- Support data modeling initiatives for coherent structure design and document all technical processes to ensure operational continuity
Requirements
What you’ll need- Strong background and understanding of database data management (general SQL knowledge, data querying, data quality control)
- Strong programming knowledge in Python (pandas, numpy)
- Advanced level Big Data / data lake framework (Spark, Databricks)
- Strong cloud knowledge and handling of Azure Data Factory, Databricks, Event Hub
- Basic familiarity with UNIX operating system, especially shell scripting
- Basic understanding of network level problems and connectivity requirements
- Basic Understanding data modelling principles
- Can work in a multi-shift operation (Monday to Friday, 07:00 AM - 22:00 PM) + on-call (weeknights, weekends and public holidays)
Benefits
Comp & perks- A constantly growing organization and increasing opportunities
- Secure, long-term job opportunity
- Varied and engaging job responsibilities
- Outstanding salary
- Flexible work arrangements
- Home office possibility
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
PythonSparkDatabricksSQLbig data technologiesdata integrationdata processingshell scriptingdata modelingdata quality control