Leeds, West Yorkshire
£45000 - £65000 per annum
3 months ago
My award winning client are looking for permanent Data Engineer Consultants to help their clients deploy data pipelines and processes in a production-safe manner, using the latest technologies.
Their clients vary as do their data demands.
They're looking for an experienced data specialist with strong experience in Data Development, ETL, Data Warehousing and dealing with large sets of structured, semi-structured and unstructured data.
You will have experience of and the ability to, ingest Real Time data from various data sources and design new data platforms.
Experience with data science frameworks and ML frameworks would certainly be seen as advantageous.
This is a new role within the company and will run in tandem with their established Big Data, Data Science and Cloud teams.
This role will offer the right candidate a chance to shape what the Data Engineering proposition for the company looks like and, over time, it will build out more capability to deal with their demand.
You will need to be a self-starter, hungry for knowledge and be comfortable working in various environments.
Adaptability and agility are key for this role, alongside excellent communication skills.
And some of the following skills:
Hands-on Spark experience (both batch and stream processing)
Hadoop ecosystem exposure (YARN, HDFS, HBase, custom MapReduce jobs, Hive/Impala)
Hands-on experience with at least one distributed NoSQL storage (HBase, Cassandra)
Understanding of cluster resource management tools (YARN, Mesos)
Stream processing tools like Kafka, Storm
Cloud architecture (ie AWS Kinesis, Data Pipeline, EMR, Glue, Redshift, Athena) General SQL skills
Experience with ELK stack (desirable)
Their success in the data space speaks for itself and they have been fortunate enough to work with some of the UK's largest brands to help shape their data solutions.
Please apply immediately to be considered.