HPC Halloween horrors: terrifying nightmares around the cobweb-like complexities of HPC storage

Todd Ruff, VP Corporate Marketing, Panasas, explores the cobweb-like complexities and Halloween nightmares often involved in HPC storage.   
Todd Ruff, VP Corporate Marketing, Panasas, explores the cobweb-like complexities and Halloween nightmares often involved in HPC storage.   

From rendering the latest horror film, to sequencing the genome of Frankenstein’s monster or carrying out simulations to make aeroplanes as streamlined as a ghost through a wall, HPC IT environments are the driving force behind a growing number of industries and use cases. According to the World Economic Forum, by 2025, an estimated 463 exabytes of data will be created on a daily basis. Organizations of all shapes and sizes, from governments to banks to automotive manufacturers, are taking advantage of this ever-growing mountain of data to make quicker and better-informed decisions. Indeed, the global HPC memory market is growing at an average rate of 7% and is expected to reach seven billion US dollars by 2023.

However, there is a dark side to this market: the majority of HPC storage solutions are shrouded in complexity, unreliability and frighteningly high costs. A global study by Hyperion Research highlights three ways in which organizations can become ensnared in a hair-raising high total cost of ownership.

1. The alarming cost of HPC storage staffing

Employees represent a monstrous cost factor for HPC storage; 18% of HPC storage installations each require four or more people to manage it, while almost 14% had expenditures of US$500,000 or more for HPC storage staff. For 38% of organizations, recruiting and training storage professionals alone was the most difficult operational aspect of HPC storage.

2. Installation and maintenance nightmares

Organizations are also haunted by complicated installation and maintenance tasks. Just 6% of organizations had their new HPC storage rigs up and running within a day, while 28% were still installing after a week. And the gremlins and goblins do not disappear once the storage system is up and running. Almost half had to tune and retune systems monthly, with 4% returning weekly (and 2% even daily!).

3. Spine-chilling outages

Last but certainly not least, the most petrifying of HPC horrors: outages. One-third of organizations suffered monthly failures and 8% weekly outages. 41% revealed that recovery took two days or longer. The expense of just a single day’s outage is blood-curdling: depending on company size, a day’s outage can cost up to, or even over, $1mn.

These entanglements of complex and unreliable storage trap organizations into a haunted house where they are victims of a shockingly high total cost of ownership, impacting their productivity and, ultimately, their bottom lines. As HPC storage installations increasingly tackle a broader range of use cases, the shortcomings of traditional approaches are becoming increasingly clear, and the hidden costs of HPC storage, such as staffing and outages, are harder to disguise or ignore.

READ MORE:

To avoid HPC storage costs spinning out of control, organizations must take a step back to re-evaluate their storage solutions and demand predictability, ease of use, and reliability from their technology providers to ensure that they have no skeletons hidden in their closets that may end up haunting the users later on.

For more news from Top Business Tech, don’t forget to subscribe to our daily bulletin!

Follow us on LinkedIn and Twitter

Amber Donovan-Stevens

Amber is a Content Editor at Top Business Tech

Birmingham Unveils the UK’s Best Emerging HealthTech Advances

Kosta Mavroulakis • 03rd April 2025

The National HealthTech Series hosted its latest event in Birmingham this month, showcasing innovative startups driving advanced health technology, including AI-assisted diagnostics, wearable devices and revolutionary educational tools for healthcare professionals. Health stakeholders drawn from the NHS, universities, industry and front-line patient care met with new and emerging businesses to define the future trajectory of...

Why DEIB is Imperative to Tech’s Future

Hadas Almog from AppsFlyer • 17th March 2025

We’ve been seeing Diversity, Equity, Inclusion, and Belonging (DEIB) initiatives being cut time and time again throughout the tech industry. DEIB dedicated roles have been eliminated, employee resource groups have lost funding, and initiatives once considered crucial have been deprioritised in favour of “more immediate business needs.” The justification for these cuts is often the...

The need to eradicate platform dependence

Sue Azari • 10th March 2025

The advertising industry is undergoing a seismic shift. Connected TV (CTV), Retail Media Networks (RMNs), and omnichannel strategies are rapidly redefining how brands engage with consumers. As digital privacy regulations evolve and platform dynamics shift, advertisers must recognise a fundamental truth. You cannot build a sustainable business on borrowed ground. The recent uncertainty surrounding TikTok...

The need to clean data for effective insight

David Sheldrake • 05th March 2025

There is more data today than ever before. In fact, the total amount of data created, captured, copied, and consumed globally has now reached an incredible 149 zettabytes. The growth of the big mountain is not expected to slow down, either, with it expected to reach almost 400 zettabytes within the next three years. Whilst...

What can be done to democratize VDI?

Dennis Damen • 05th March 2025

Virtual Desktop Infrastructure (VDI) offers businesses enhanced security, scalability, and compliance, yet it remains a niche technology. One of the biggest barriers to widespread adoption is a severe talent gap. Many IT professionals lack hands-on VDI experience, as their careers begin with physical machines and increasingly shift toward cloud-based services. This shortage has created a...

Tech and Business Outlook: US Confident, European Sentiment Mixed

Viva Technology • 11th February 2025

The VivaTech Confidence Barometer, now in its second edition, reveals strong confidence among tech executives regarding the impact of emerging technologies on business competitiveness, particularly AI, which is expected to have the most significant impact in the near future. Surveying tech leaders from Europe and North America, 81% recognize their companies as competitive internationally, with...