British-based stock exchange and financial information company, a dynamic organization of 25,000 people across 70 countries
Responsibilities
As Technical Lead Data Engineer you will be the key operational and hands-on technical lead to shape and drive a data platform strategy execution across all areas of the Post Trade business as part of LCH Shared Services
You will be responsible for contributing to future architectural decisions, including a Cloud data strategy, data warehouse modernization and data delivery platform
Acts as technical lead for a team of engineers supporting the full software development life cycle
Mentors more junior team members and acts as a go-to person for technical and non-technical issues
Makes technical design decisions and is able to manages high-workloads
Maintains and designs infrastructure services, designs/implements microservices and serverless components
Develops scripts which automate routine tasks related to infrastructure and server management.
Creates and maintains Jenkins/GitLab data pipelines, AWS/Azure services, Snowflake data ingestion and transformation pipelines
Writes microservices using OO programming languages like Java/Python
Creates data pipelines using Kafka and Spark
Develops detailed technical and operational documentation.
Support Monitoring and Alerting infrastructure using on CloudWatch and Datadog
Requirements
Proven Experience as Dev Lead in complex projects
Min 8 years’ experience in implementing software services using major architectural patterns: microservices, event-driven architecture
Proven Data Modelling experience
Good knowledge of ETL processes, ingestion, transformation and Data loading pipelines
Proven knowledge of Java/Python, SQL, BASH
Bachelor’s degree or equivalent in an IT related discipline
Nice to have
Good knowledge of Java frameworks and Python libraries, SpringBoot, JPA
Exposure to a DataWarehousing platforms like Snowflake, Databricks, RedShift, BigQuery
Experience in either AWS/Azure environments
Experience with Spark, Kafka, Kafka Connect
Our client offers
25 days’ holiday per year
1 additional day off for your Birthday
Annual wellness allowance
Share Purchase Plan
Medical Health Insurance
Medical Subscription (preventive medical services)
