This site uses cookies

Some of these cookies are essential, while others help us to improve your experience by providing insights into how the site is being used.

For more detailed information please check our Cookie notice


Necessary cookies

Necessary cookies enable core functionality. This website cannot function properly without these cookies.


Cookies that measure website use

If you provide permission, we will use Google Analytics to measure how you use the website so we can improve it based on our understanding of user needs. Google Analytics sets cookies that store anonymised information about how you got to the site, the pages you visit, how long you spend on each page and what you click on while you’re visiting the site.

Vacancy: Hadoop Systems Engineer, UK Data Archive

UK Data Archive

Based at the UK Data Archive, the Smart Meter Energy Research Lab (SERL) is a five year multimillion pound project intended to give researchers access to smart meter data from up to 100,000 UK households. We are going into production soon and need someone to care for and nurture a petabyte scale Hadoop infrastructure. As well as getting exposure to big data technology in a real-world production environment, you will acquire skills around other cutting edge tech stacks like Red Hat OpenShift and ElasticSearch.

Duties of the Role

The Hadoop Systems Engineer is the lynchpin of the SERL data and research infrastructure and ensures that the services that the SERL team provides for researchers are performant and reliable. The scope of responsibility is considerable: proactively monitoring the ingest and egress of data to and from the system, analysing and reporting  the health and performance of a petabyte-scale big data ecosystem, ensuring that the development team have the optimal microservice deployment pathways and ensuring that researchers have an optimal secure lab experience.

Application closing date: 05/09/2019

Location: Colchester

Salary: £30,942 – £33,797 per annum

Job pack

More information and how to apply