Zealogics Inc

Senior Data Engineer

Zealogics Inc

full-time

Posted on:

Location Type: Remote

Location: Remote • 🇺🇸 United States

Visit company website
✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AzurePySparkPythonSDLCSQL

About the role

  • Participate in business discussions and assist an Architect with gathering data requirements.
  • Build and maintain data pipelines for analytics projects.
  • Collaborate with team members to deliver data solutions on time and within budget.
  • Utilize Azure services effectively to meet project objectives.
  • Document processes and workflows and present findings to the team.

Requirements

  • Demonstrated experience in successfully delivering multiple end-to-end data analytics projects on Azure, following the complete software development life cycle (SDLC).
  • Proven track record of building data pipelines for streaming, near-real time, and batch data processing, utilizing the various technologies available in Azure.
  • Hands-on experience in developing comprehensive end-to-end solutions, with the ability to understand the big picture and contribute to and guide the team in delivering projects within specified timeframes and budgets.
  • Good analytical and problem-solving skills to help address data challenges.
  • Advanced SQL Skills.
  • Proficiency in writing complex SQL queries for data extraction, transformation, and analysis.
  • Knowledge of SQL functions, joins, subqueries, and performance tuning.
  • Experience in creating and managing data pipelines using Azure Data Factory.
  • Understanding of data integration, transformation, and workflow orchestration in Azure environments.
  • Knowledge of data engineering workflows and best practices in Databricks.
  • Able to code Databricks Notebook and understand existing templates and patterns for development.
  • Understanding of Dimensional and relational data models and experience in write efficient code (in SQL and PySpark) to populate data models.
  • Programming skills in Python, particularly for data manipulation and analysis.
  • Experience developing solutions to automate data validations tasks using SQL/Python scripts.
  • Proficiency in using Git for version control and collaboration in data projects.
  • Ability to work effectively in a team environment, especially in agile or collaborative settings.
  • Clear and effective communication skills to articulate findings and recommendations for other team members.
  • Ability to document processes, workflows, and data analysis results effectively.
  • Willingness to learn new tools, technologies, and techniques as the field of data analytics evolves. Being adaptable to changing project requirements and priorities.

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
data pipelinesdata analyticsAzureSQLPySparkdata integrationdata transformationworkflow orchestrationdata engineering workflowsdata validation automation
Soft skills
analytical skillsproblem-solving skillsteam collaborationcommunication skillsdocumentation skillsadaptabilitytime managementbudget managementbig picture understandingagile methodology