HPC Halloween horrors: terrifying nightmares around the cobweb-like complexities of HPC storage

Todd Ruff, VP Corporate Marketing, Panasas, explores the cobweb-like complexities and Halloween nightmares often involved in HPC storage.   
Todd Ruff, VP Corporate Marketing, Panasas, explores the cobweb-like complexities and Halloween nightmares often involved in HPC storage.   

From rendering the latest horror film, to sequencing the genome of Frankenstein’s monster or carrying out simulations to make aeroplanes as streamlined as a ghost through a wall, HPC IT environments are the driving force behind a growing number of industries and use cases. According to the World Economic Forum, by 2025, an estimated 463 exabytes of data will be created on a daily basis. Organizations of all shapes and sizes, from governments to banks to automotive manufacturers, are taking advantage of this ever-growing mountain of data to make quicker and better-informed decisions. Indeed, the global HPC memory market is growing at an average rate of 7% and is expected to reach seven billion US dollars by 2023.

However, there is a dark side to this market: the majority of HPC storage solutions are shrouded in complexity, unreliability and frighteningly high costs. A global study by Hyperion Research highlights three ways in which organizations can become ensnared in a hair-raising high total cost of ownership.

1. The alarming cost of HPC storage staffing

Employees represent a monstrous cost factor for HPC storage; 18% of HPC storage installations each require four or more people to manage it, while almost 14% had expenditures of US$500,000 or more for HPC storage staff. For 38% of organizations, recruiting and training storage professionals alone was the most difficult operational aspect of HPC storage.

2. Installation and maintenance nightmares

Organizations are also haunted by complicated installation and maintenance tasks. Just 6% of organizations had their new HPC storage rigs up and running within a day, while 28% were still installing after a week. And the gremlins and goblins do not disappear once the storage system is up and running. Almost half had to tune and retune systems monthly, with 4% returning weekly (and 2% even daily!).

3. Spine-chilling outages

Last but certainly not least, the most petrifying of HPC horrors: outages. One-third of organizations suffered monthly failures and 8% weekly outages. 41% revealed that recovery took two days or longer. The expense of just a single day’s outage is blood-curdling: depending on company size, a day’s outage can cost up to, or even over, $1mn.

These entanglements of complex and unreliable storage trap organizations into a haunted house where they are victims of a shockingly high total cost of ownership, impacting their productivity and, ultimately, their bottom lines. As HPC storage installations increasingly tackle a broader range of use cases, the shortcomings of traditional approaches are becoming increasingly clear, and the hidden costs of HPC storage, such as staffing and outages, are harder to disguise or ignore.

READ MORE:

To avoid HPC storage costs spinning out of control, organizations must take a step back to re-evaluate their storage solutions and demand predictability, ease of use, and reliability from their technology providers to ensure that they have no skeletons hidden in their closets that may end up haunting the users later on.

For more news from Top Business Tech, don’t forget to subscribe to our daily bulletin!

Follow us on LinkedIn and Twitter

Amber Donovan-Stevens

Amber is a Content Editor at Top Business Tech

Unlocking productivity and efficiency gains with data management

Russ Kennedy • 04th July 2023

Enterprise data has been closely linked with hardware for numerous years, but an exciting transformation is underway as the era of the hardware businesses is gone. With advanced data services available through the cloud, organisations can forego investing in hardware and abandon infrastructure management in favour of data management.

The Future of Cloud: A Realistic Look at What’s Ahead

Erin Lanahan • 22nd March 2023

Cloud computing has transformed the way we work, communicate, and consume technology. From storing data to running applications, the cloud has become an essential part of our lives. But what does the future hold for this technology? In this article, we’ll take a realistic look at the future of the cloud and what we can...

Ab Initio partners with BT Group to deliver big data

Luke Conrad • 24th October 2022

AI is becoming an increasingly important element of the digital transformation of many businesses. As well as introducing new opportunities, it also poses a number of challenges for IT teams and the data teams supporting them. Ab Initio has announced a partnership with BT Group to implement its big data management solutions on BT’s internal...