Minor Hotels Europe and Americas

Lead Data Engineer

Minor Hotels Europe and Americas

full-time

Posted on:

Location Type: Office

Location: Tokyo • 🇯🇵 Japan

Visit company website
✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AzureCloudDistributed SystemsETLHadoopJavaLinuxNoSQLOraclePythonScalaShell ScriptingSparkSQL

About the role

  • Collaborate with users and project team on requirements and expectations
  • Analyze business requirements, create proper data solutions that meets functional and non-functional requirements
  • Design and implement highly scalable and robust data pipelines in Scala/Spark/Java for processing of extreme large amount of data
  • Create and maintain reusable frameworks for data ingestion, validation, normalization, and transformation
  • Create scripts for test automation, CI/CD, data migrations, data validations
  • Provide technical support for incident recovery

Requirements

  • Minimum 3~6 years of working experience as developer or data engineer
  • Strong programming skills and has software development experience in Scala, Java or Python
  • Deep understanding of distributed systems (Hadoop, Spark, etc.) and its optimization
  • Experience in public cloud technologies, preferably Azure
  • Good knowledge of Oracle database, MS-SQL Server, Linux, networking
  • Proficient in SQL, shell scripting, git, unit testing, CI/CD tools
  • Understanding of design principles, coding standards and best practices
  • Strong learning ability and problem-solving skills
  • Excellent communication, presentation, and interpersonal skills
  • Preferable: Understanding of REST API, NoSQL, micro-services, ETL
  • Hand-on experience with Cloud services is preferred
  • Understanding of streaming data processing and change data capture is preferred
  • Experience with BI tools is preferred
  • Language: Japanese: Business Level (Optional)
  • English: Business Level
Benefits
  • Health insurance
  • Retirement plans
  • Paid time off
  • Flexible work arrangements
  • Professional development
  • Remote work options

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
ScalaJavaPythonHadoopSparkSQLshell scriptingCI/CDdata pipelinesdata ingestion
Soft skills
problem-solvinglearning abilitycommunicationpresentationinterpersonal