CASE STUDY and research . Services range from private cloud compute to data management to safe haven services and bespoke projects . EIDF computing services are designed for data science , including its GPU-enabled Machine-Learning compute platform for driving Artificial Intelligence ( AI ) application development , focused on Europe ’ s first Cerebras CS1 large-scale AI engine . EIDF data management services enable users to archive and reuse data , offering long-term storage and preservation for the Data Driven Innovation ( DDI ) programme ’ s data assets while growing EIDF ’ s analytics-ready collection to make data available for researchers and innovators .
EIDF also provides a large trusted research environment that can be tailored to meet the information governance needs of data controllers . The EDIF provides a range of secure environments for data analysis and archive services .
Finally , EIDF works with partners from the DDI programme to co-create and tailor services using a building block approach to data hosting , highperformance AI analytics , modelling and beyond .
To support its full range of research services , EIDF required a data storage solution that enabled it to be as agile and responsive as possible to the needs of its many stakeholders across the DDI programme , which involves collaboration between industry , the public sector and academia .
The solution
To set the foundation for its long-term storage strategy , EIDF implemented a joint solution from HPE and Spectra Logic . EIDF deployed two four-frame Spectra TFinity ExaScale Tape Libraries with LTO-8 tape drives and media . The TFinity systems are uniquely designed with robotic pickers called High Performance Transporters – each tape library contains two to support dual operations . Instead of individual tape slots , the library has shelves of TeraPack containers — 10 tape cartridges bound together in a single tray . The TeraPacks allow for the library ’ s higher tape storage density in a smaller footprint than would be possible with a traditional design . This compact architecture allows the robots to travel a linear path , loading and unloading multiple tape cartridges at a time for maximum efficiency .
EIDF uses HPE Data Management Framework ( HPE DMF ) software to enable hierarchical , tiered storage management to the TFinity tape libraries , optimising data accessibility .
To manage AI workloads and applications at scale , EIDF is exploring HPE ’ s Ezmeral Container
Platform running on HPE Apollo Systems . The HPE Ezmeral Container Platform provides native Kubernetes support and enables self-service Artificial Intelligence / Machine Learning ( ML ) applications for EIDF scientists , with flexible use of accelerators such as GPUs – allowing developers to standardise ML workflows . EIDF has deployed a mixture of HPE storage solutions including Lustre and CEPH for persistent data storage for high-performance and high-throughput advanced analytics .
“ EIDF is combining computing and data resources to create a facility that will allow users to leverage data to innovate throughout their organisations ,” said Parsons . “ The TFinity tape systems provides the scalability that this project demands as it develops over the next decade .”
The combined storage solution enables EIDF to meet its most challenging long-term scalable storage requirements . EIDF has 20 petabytes of cold storage capacity with the new system which is being used for a multitude of EIDF projects including vital COVID-19 research at the University of Edinburgh .
Environment snapshot
• Two four-frame Spectra TFinity ExaScale Tape Libraries
• LTO-8 tape drives and media
• BlueScale standard encryption
• Cerebras Systems AI Supercomputer
• HPE DMF software
• HPE Apollo Systems
• HPE Superdome Flex Servers
• HPE Ezmeral Container Platform
• 27 petabytes of mixed fast storage
Why Spectra ?
• Consultative solution design
• Scalable and adaptable to growth
• Integration with HPE
• Excellent customer and product support
• Superior reliability , scalability and accessibility
Solution recap
Spectra TFinity ExaScale Tape Library – With unsurpassed storage density in the smallest footprint of any enterprise library on the market , the Spectra TFinity ExaScale offers industry-leading scalability with the speed necessary to meet requirements of the most demanding environments . In addition to LTO tape technology , the Spectra TFinity Exascale is also compatible with IBM ’ s TS11X0 enterprise tape technology and Oracle ’ s T10000x enterprise tape technology , enabling all three tape formats in the same library . p
www . intelligentcio . com INTELLIGENTCIO EUROPE 65