W1siziisimnvbxbpbgvkx3rozw1lx2fzc2v0cy9uagugqnjpzgdlieluic9wbmcvymfubmvylwrlzmf1bhqucg5nil1d

Job

Data Engineer

  • Location

    Leeds, West Yorkshire

  • Sector:

    Data Engineer

  • Job type:

    Permanent

  • Salary:

    £45000 - £65000 per annum

  • Contact:

    Mohammed Imran

  • Contact email:

    Mohammed@thebridgeit.com

  • Job ref:

    972MI_1572454977

  • Published:

    15 days ago

  • Expiry date:

    2019-11-29

  • Startdate:

    ASAP

  • Consultant:

    Mohammed Imran

My award winning client are looking for permanent Data Engineer Consultants to help their clients deploy data pipelines and processes in a production-safe manner, using the latest technologies.

Their clients vary as do their data demands.

They're looking for an experienced data specialist with strong experience in Data Development, ETL, Data Warehousing and dealing with large sets of structured, semi-structured and unstructured data.

You will have experience of and the ability to, ingest Real Time data from various data sources and design new data platforms.

Experience with data science frameworks and ML frameworks would certainly be seen as advantageous.

This is a new role within the company and will run in tandem with their established Big Data, Data Science and Cloud teams.

This role will offer the right candidate a chance to shape what the Data Engineering proposition for the company looks like and, over time, it will build out more capability to deal with their demand.

You will need to be a self-starter, hungry for knowledge and be comfortable working in various environments.

Adaptability and agility are key for this role, alongside excellent communication skills.


Essential: Python

And some of the following skills:

Scala/Java

Hands-on Spark experience (both batch and stream processing)

Hadoop ecosystem exposure (YARN, HDFS, HBase, custom MapReduce jobs, Hive/Impala)

Hands-on experience with at least one distributed NoSQL storage (HBase, Cassandra)

Understanding of cluster resource management tools (YARN, Mesos)

Stream processing tools like Kafka, Storm

Cloud architecture (ie AWS Kinesis, Data Pipeline, EMR, Glue, Redshift, Athena) General SQL skills

Experience with ELK stack (desirable)

Their success in the data space speaks for itself and they have been fortunate enough to work with some of the UK's largest brands to help shape their data solutions.

Please apply immediately to be considered.