LexisNexis

Data Engineer III

LexisNexis

full-time

Posted on:

Location Type: Office

Location: Farringdon • 🇿🇦 South Africa

Visit company website
✨ AI Apply
Apply

Job Level

Mid-LevelSenior

Tech Stack

Amazon RedshiftAWSAzureCloudElasticSearchHadoopKafkaPandasPostgresPySparkSparkSQL

About the role

  • Be a hands-on Data Engineer working across our ecosystem of products and Data Platforms.
  • Interface with other technical personnel or team members to finalize requirements.
  • Developing and maintaining data infrastructure supporting real-time data processing in streaming architectures.
  • Implementing scalable data ingestion and ML pipelines, incorporating Data Lakehouse concepts for unified data management.
  • Successfully implement development processes, coding best practices, and code reviews.
  • Designing APIs for diverse business units, ensuring efficient data lineage tracking.
  • Utilizing DataOps principles to enhance system performance and reliability.
  • Automating system lifecycle management, ensuring robustness and scalability.
  • Integrating advanced data engineering techniques and tools to streamline processes.
  • Resolve technical issues as necessary.
  • Keep abreast of new technology developments.

Requirements

  • Experience in SQL Server, Data Lake (Azure/AWS).
  • Possess extensive modern Data Engineering experience.
  • Demonstrate in-depth knowledge of large-scale data platforms (Databricks, Snowflake) and cloud-native tools (Azure Synapse, RedShift).
  • Knowledge of software development methodologies including Scrum, Kanban, and Agile more broadly.
  • Experience of analytics technologies (Spark, Hadoop, Kafka).
  • Experience with test-driven development.
  • Understanding of Elasticsearch, Solr, PostgreSQL, Databricks, Delta Share & Delta Lake.
  • Ability to work with complex Patent and Litigation data models.
  • Ability to work well with internal and external technology data resources, including DocDB, ESpacenet & USPTO.
  • Experience with Pandas & PySpark.
Benefits
  • Generous holiday allowance with the option to buy additional days.
  • Health screening, eye care vouchers and private medical benefits.
  • Wellbeing programs.
  • Life assurance.
  • Access to a competitive contributory pension scheme.
  • Save As You Earn share option scheme.
  • Travel Season ticket loan.
  • Electric Vehicle Scheme.
  • Optional Dental Insurance.
  • Maternity, paternity and shared parental leave.
  • Employee Assistance Programme.
  • Access to emergency care for both the elderly and children.
  • RECARES days, giving you time to support the charities and causes that matter to you.
  • Access to employee resource groups with dedicated time to volunteer.
  • Access to extensive learning and development resources.
  • Access to employee discounts scheme via Perks at Work.

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
SQL ServerData LakeDatabricksSnowflakeAzure SynapseRedShiftSparkHadoopKafkaPandas
Soft skills
collaborationproblem-solvingcommunicationadaptabilityattention to detail