Informa

Senior Data Engineer

Informa

full-time

Posted on:

Location Type: Remote

Location: Remote • New York City • New York • 🇺🇸 United States

Visit company website
✨ AI Apply
Apply

Salary

💰 $110,000 - $140,000 per year

Job Level

Senior

Tech Stack

AirflowETLPythonSDLCSparkSQLUnity

About the role

  • Design, build, and maintain scalable and reliable data pipelines, including ingestion, storage, validation, governance, monitoring, and ELT patterns
  • Proactively identify opportunities and implement solutions to optimize pipeline operations and reduce manual work
  • Develop and maintain ETL data pipelines for large volumes of data, writing clean, maintainable, and efficient code
  • Maintain and evangelize high standards in software and data engineering best practices (SDLC, testing, scaling, performance)
  • Work closely with product managers, data scientists, and software engineers to create and prepare datasets from disparate sources to support the development and delivery of cutting-edge ML models and interactive applications
  • Proactively identify and implement new technologies and improve our reusable tools
  • Conduct code reviews and provide feedback
  • Participate in agile ceremonies
  • Stay current with emerging technologies and industry best practices

Requirements

  • Advanced proficiency in Python and SQL
  • Required experience with Spark, including distributed computing and optimization
  • Preferred experience with Databricks (Unity Catalog, Feature Store, Delta Live Tables)
  • Extensive experience with data pipeline and workflow management tools (e.g., Airflow, Databricks, Glue)
  • Strong understanding of data engineering best practices (ETL/ELT, monitoring, observability, validations)
  • Experience with big data, scaling data processing, and distributed computing
  • Strong analytical skills—ability to explore, interpret, and transform raw data into structured, high-quality datasets that support business decisions and advanced analytics
  • Production support experience
  • Minimum 3+ years of professional experience
  • Self-discipline and eagerness to learn new skills, tools, and technologies
  • Solid verbal and written communication skills.
Benefits
  • Competitive benefits, including a range of Financial, Health and Lifestyle benefits to choose from
  • Flexible working options, including home working, flexible hours and part time options, depending on the role requirements – please ask!
  • Competitive annual leave, floating holidays, volunteering days and a day off for your birthday!
  • Learning and development tools to assist with your career development
  • Work with industry leading Subject Matter Experts and specialist products
  • Regular social events and networking opportunities
  • Collaborative, supportive culture, including an active DE&I program
  • Employee Assistance Program which provides expert third-party advice on wellbeing, relationships, legal and financial matters, as well as access to counselling services

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
PythonSQLSparkDatabricksAirflowGlueETLELTdata pipeline managementdistributed computing
Soft skills
analytical skillsself-disciplineeagerness to learnverbal communicationwritten communication