Generator system expansion

As part of the recent expansion and capacity upgrade project at our London Central data centre, we have deployed another backup diesel generator, which joins the existing sets already providing protection to our clients.

This ensures our N+1 resilience level on backup power is maintained as we continue to introduce new customers into the data centre, and provide ongoing scalable growth to those already with us.

The new set – while outputting the same level of power as its existing counterparts – is a next generation unit that we’ve had presented in an inverse colourway; anthracite grey. This stands in contrast to the existing units, which are in an off-white colourway. Of the three sets which now make up the full system, it is the smallest, quietest, and sleekest looking unit, perfect for demonstrating where we’ve made tangible upgrades to our critical infrastructure.

As part of this new deployment, we’ve adjusted how the setup works as a homogeneous system, with regards to the operational logic for running three sets in an N+1 fail-over scenario.

The new generator is actually now Set 1, with the existing units becoming Sets 2 and 3. This allows the newest set to become the primary unit in this multi-generator system.


How our generator system works

We’re not doing anything particularly ‘special’ when it comes to mixing in our backup generator sets, however in the interest of total transparency, we thought it of interest to explain exactly how this system works in real-world scenarios.

We have enough backup generator capacity on-site to cover full load in the facility on two sets, reserving one as a swing set. This can be called into service should one fail during emergency operation, hence giving us our N+1 resilience.

There are two main invocation scenarios in a facility with A+B mains power systems, which are:

  • A single side power failure, either A or B (the most common)
  • A full blackout of both A and B (less common)

The computer systems that control our generator logic (both inside the generators and as part of our Automatic Transfer Switches) handle each case slightly differently, depending on what has happened.


A single side power failure

As expected with any mains power issue, our UPS systems take load immediately to ensure faultless operation while the generators are instructed to start up. We have a minimum run-time on our UPS’s of 10 minutes, though most have more than 20 minutes in reality.

All generators as part of our system are kept on hot-standby, with all oils and pumps kept warm ready for the immediate firing of engines. In this state, the generators are known as ‘At Rest’, and available for service.

During a single side failure, two of the three generators will be instructed to fire, which will then startup, self-test, and synchronise with the sister unit.

If for any reason one unit fails to sync, the remaining swing set will be called up and take over, placing the other into a cool-down state.

Once online and synchronised, which takes around 60 seconds, the ATS’s will switch through the load, allowing the generators to take over from the inline UPS’s.

If the load is at below 60% of a single unit’s capacity, the system will then allow for the load to be taken up by a single generator, placing two units back into the swing pool, to be invoked again if required.

We’re then running on generator for as long as required, with 48 hours of fuel on-site, and refuelling contracts with two separate entities for refuelling within 2 hours.

Once the mains feed is seen to be restored by the system, it will hold on generator for another three minutes to ensure stability, before automatically switching back to the mains feed for load.

The online generators then enter into a three minute cool-down cycle, before dropping back into their ‘At Rest’ state, ready to be called up again if required.


A full blackout of both A and B

Although this is a less common real-world scenario, it is one of our test simulations, and invokes the generators in a slightly different manner.

Should this occur, most actions as above remain the same, however in this case, all three generators would fire as part of stage one, rather than just two.

They will then test and sync together, and again have a set fall away to become the swing unit once the system is spun up and ready to take load.

In this way, the backup system is always able to both take load, and provide a swing set for resilience should there be an issue with a unit during emergency operation.

The entire system enjoys a rigorous testing schedule, which is incredibly important for a backup power system. Sets are test fired every two weeks and allowed to run warm for five minutes, checking for any running issues. We also complete on-load tests every month, to ensure the sets can take full load; an important step missed by many facility operators.

The system is also fully maintained by Shenton Group, the organisation responsible for the build, supply and initial testing, ensuring our units are in tip-top operational condition year-round.


What’s next?

That’s not the only upgrade coming as part of our backup generator system. The investment in this critical area continues in Q4, as we introduce a brand new mixing enclosure in our Electrical Intake Room, which will improve and update what is in place at present, finalising developments in this area in the mid-long term.

The new internal enclosure will allow for the use of next generator smart rotary breakers, something not presently in service as part of the current enclosure panel.

Full speed ahead for Data Hall 1 cooling system

This summer, we’ve been hard at work taking the high-tech cooling system in Data Hall 1 to its final specification, ready for full capacity.

Our entire facility follows a modular build methodology, which includes our unique evaporative cooling system. Everything is installed in A+B resilient pairs, which includes the cooling stack design employed at our London Central data centre. These act as the lungs of our data centre, breathing cool air into the overhead plenum.

Until now, we’ve had lot’s of headroom on the existing two stacks, comprised of four wet box units. Last summer, we rolled out a fully-integrated AC system to supplement this evaporative units, both for added operational resilience, as well as further cooling capacity should it be required.

Intake Fan

Each of our stacks have intelligently controlled intake fans and active damping

We’ve now added the final two stacks to the system in Data Hall 1, taking our cooling capacity to maximum load. This further improves resilience on the system as a whole, and also provides a great deal of additional cooling as we continue to welcome new customers into our world-class data centre.

CREC Units

Our unique, highly-efficient cooling stack design

Part of this additional capacity includes the tripling of available extraction outlets, which gives us greater control over the pressure differential between hot and cold aisles.

At full speed we are now able to move 208,000 cubic metres of four-times filtered, climate controlled air through Data Hall 1 per hour. That’s a lot of air, creating a flow of freshly tempered air which refreshes hall-wide every 45 seconds (on average).

Extraction

Our extraction capabilities have been heavily bolstered

Extraction Fans

We now have nine high-powered extraction fans

Further to this, we’ve also installed a new probe matrix overhead, meaning we now have temperature and humidity mapping capabilities across the entire data hall floor. This both feeds into the control systems which manage the cooling system, as well as our own monitoring and management systems for greater insights into heat and flow control.

Later this year, we’ll also be adding in further granular monitoring on the circuits which feed our cooling systems, which will allow us to see our PUE as it dynamically adjusts in real-time.

The cooling system in Data Hall 1 is now at full capacity, which is fantastic news as our ever-growing roster of clients continue to deploy new systems in our facilities.

Learn more about our world-class London Central data centre.

Build Blog – One year on

When we began the lengthy design and build process for our new London Central data centre, we decided to start a comprehensive build blog which would track the progress made each week, including photographs of the changes and a short write up of what’s been happening.

This ended in July 2015, shortly after we soft-opened the facility to existing clients. From a technical standpoint, the facility was indeed ‘finished’, however we still had plenty of additions to make with regards to customer amenities. We officially launched the new facility in February 2016, after completing another run of works inside the data centre.

We posted our first build blog update in November 2016, which documented the overhaul of our much-loved Build Room for data hall one. We’re now almost exactly a year on from our official launch event, and so thought it would be a good opportunity to provide an update post that documents all the changes we have made over the past 12-18 months.

This photographic tour of the facility shows all of the key spaces in their current configuration, bringing the build blog fully up to date with the facility as it stands today.

NOC

Our NOC screens command centre stage in our open plan office.

Workstations

All workstations in our office now have a triple-screen setup.

Office

Our open plan HQ office has become a real hive of activity over the past 12 months.

Meeting Room

Our much-lauded meeting room is a real favourite with site visitors.

Meeting Room

Two large conference screens sit at the head of our Vitra board table.

Reception

Our reception now sports a sleek desk with custom white logo.

Reception

We have a new tube status readout screen above the main entrance, for the convenience of visitors as they leave.

Reception

A look up at the soaring atrium in the main entrance.

Customer Lounge

Our new Customer Lounge is very much a space that will evolve over the coming months, but it is already a uniquely interesting space that our customers love to use.

Customer Lounge

Our new Customer Lounge is very much a space that will evolve over the coming months, but it is already a uniquely interesting space that our customers love to use.

Customer Lounge

Our new Customer Lounge is very much a space that will evolve over the coming months, but it is already a uniquely interesting space that our customers love to use.

Customer Kitchen

Our dedicated customer kitchen, while still a blank canvas awaiting further work, is rarely pictured.

Customer Kitchen

Our dedicated customer kitchen, while still a blank canvas awaiting further work, is rarely pictured.

Electrical Intake

Our electrical intake room has had colour coding for both A and B sides applied, with further colouring to come soon.

Electrical Intake

Our electrical intake room has had colour coding for both A and B sides applied, with further colouring to come soon.

Showers

Our shower facilities received a full make over shortly after opening.

Build Room

Build Room 1 received a full overhaul recently, much to the praise of its users.

Build Room

Build Room 1 received a full overhaul recently, much to the praise of its users.

Build Room

The two workstations in Build Room 1 are always ready for customer use.

Data Hall 1

A look down the length of Data Hall One as it stands today, an ever-evolving modular space.

Data Hall 1

A look down the length of Data Hall One as it stands today, an ever-evolving modular space.

Data Hall 1

An alternative view of Data Hall One, this time from Row B/C.

Data Hall 1

A look at the new optical distribution infrastructure recently upgraded in Data Hall One.

We have additional improvement works scheduled for 2017, including additional perimeter fencing with razor wire and a man trap, the deployment of additional rack and cooling capacity in data hall one, as well as improved on-site amenities for both customers and staff.

Build Blog – Build Room 1 Update

Our last official Build Blog entry was in July 2015, shortly after the soft-opening of our facility to existing clients. That was nearly 18 months ago, and it’s fair to say that the facility has evolved fairly extensively since then.

Anyone that knows our data centres will understand our obsession with quality and progression, which permeates everything we design and build here at Netwise. As much as the build room for Data Hall 1 functioned perfectly well, it’s fair to say that we are not huge fans of plain white rooms. The inclusion of the sound system in September was of course a welcome addition, however the space was still lacking some imagination.

Build Room 1 now adheres to our new technical design direction, which will follow suit in Data Hall 1 in 2017. The space has 360 degree wrap-around checker plate cladding, and a newly inviting entrance to Data Hall 1 – giving a greater indication that you are entering the primary technical space inside of the facility.

The old white space masked up for painting

The old white space masked up for painting

First coat of paint on both wall and door

First coat of paint on both wall and door

The finished paintwork

The finished paintwork

The first of the check plate being installed

The first of the check plate being installed

A look at the more intricate corner detail

A look at the more intricate corner detail

A look across the build room as the checker plate reaches completion, with work benches re-positioned

A look across the build room as the checker plate reaches completion, with work benches re-positioned

The space returned to normal function, pending final orange accents

The space returned to normal function, pending final orange accents

The space returned to normal function, pending final orange accents

The space returned to normal function, pending final orange accents

The space returned to normal function, pending final orange accents

The space returned to normal function, pending final orange accents

February 2017 will mark our first anniversary since officially launching to the public. Check back here in late February for a special Build Blog post; one year on, which will detail all of the changes to the facility since launching.

London Central Build Blog – Week 71 Onwards

Further finishing touches have gone into the site over the past two weeks, while primary efforts are focused on deploying new systems and configuring various elements of our infrastructure management.

New parking signage to ensure our private bays are kept for the exclusive use of our staff and customers

New parking signage to ensure our private bays are kept for the exclusive use of our staff and customers

More signage governing the dedicated customer entrance along the roadside of the facility

More signage governing the dedicated customer entrance along the roadside of the facility

Custom flags for the exterior of our building

Custom flags for the exterior of our building

One of the new flags being installed

One of the new flags being installed

Both flags installed to the front of the facility

Both flags installed to the front of the facility

Our on-site NOC screens being tested after some initial systems integration

Our on-site NOC screens being tested after some initial systems integration

Fully restored lighting over our main / reception entrance

Fully restored lighting over our main / reception entrance

This post signifies the end of our regular build blog series. Whilst the site will always have on-going works, particularly as new modules of the facility come online, the initial build can now be considered complete.

As such, we will now only put up new build blog posts during specific projects, or at the end of further system installations, to give our readers an insight into new developments.

We thank all of our avid readers for following the project – it has been a very long and at times difficult task, but our London Central site is now online and operating at full steam!