A New Data Paradigm Is Unleashing the Power of AI

    By

    Feb 27, 2024

    Data is a new factor of production in the digital economy, and has become a standard, strategic resource. As the data scale surges to yottabytes and data applications boom, powerful, resilient, and reliable data infrastructures are needed to safeguard enterprises. Professional storage devices are responsible for protecting valuable data assets in various industries. Zero data loss, continuous access, and no latency are the major concerns of industries that are focused on professional storage. 

    Huawei OceanStor storage believes that an era of uncertainty, complexity, and diversity requires inclusive capabilities that are changeable on demand to identify and integrate imperceptible data requirements.

    For AI storage, Huawei launched OceanStor A310, which is oriented to the data lake scenarios of foundation models and industry-specific models. It can implement mass data management throughout the entire AI development lifecycle from data collection and preprocessing to model training, inference, and application. Another storage model, FusionCube A3000, is oriented to the training/inference scenarios of industry-specific models and model applications with 10 billion-level parameters. It integrates OceanStor A300's high-performance storage nodes, training/inference nodes, switching devices, AI platform software, and O&M software, so as to provide AI model vendors with a ready-to-use deployment experience and one-stop delivery.

    Huawei's OceanStor Dorado all-flash storage enhances NAS capabilities and provides industry-leading SAN features. Its comprehensive functions for cyber resilience, such as Quota, QoS, and ransomware protection, facilitate resilient cross-agency file sharing. OceanStor Dorado boasts the industry's only integrated SAN and NAS active-active solution, ensuring service continuity. Additionally, customers can leverage OceanStor Dorado's high performance, reliability, and manageability to support the new application ecosystem, such as distributed databases and containers, and implement smooth cloud-native transformation.

    OceanStor Pacific scale-out storage configures high-performing, large-capacity all-flash disks that apply data reduction algorithms. It is the only device that supports hybrid workloads and lossless multi-protocol interworking in the industry, enabling one storage system to support diverse applications, including AI, HPDA, videos, and archiving. Huawei has advanced all-flash scale-out storage to support mass unstructured data entering the production decision-making systems. This has significantly increased enterprise efficiency and service experience.


    For data protection, OceanProtect Backup Storage provides up to 72:1 data reduction ratio, as well as 3x backup bandwidth and 5x recovery bandwidth, higher than the industry average. Furthermore, the storage can integrate backup software and support automatic backup and recovery management for databases, virtualization, file systems, big data, and data warehouses. Comprehensive ransomware protection solutions help users achieve efficient backup and recovery, building the last line of defense for data protection.



    FusionCube HCI     integrates compute, storage, and network resources, as well as implementing on-demand loading of management, backup, disaster recovery, and more functions through software-defined architecture. Integrated delivery can also be realized thanks to pre-integration. Intelligent management software and algorithms that match various industries cover all scenarios from data centers to enterprise branches, providing FusionCube with flexible architecture, powerful performance, solid resilience, high reliability, simplicity, and high efficiency.



    Data Management Engine (DME)     offers a unified management GUI alongside AI-powered multi-dimensional risk prediction and optimization features to provide automatic management and intelligent O&M throughout the storage lifecycle, which includes planning, construction, O&M, and optimization.

    This streamlines storage management and enhances data center operation efficiency. Additionally, DME enables the fast retrieval, analysis, and tiering of mass unstructured data, which leads to more efficient data access and lower data storage expenses.



    The DCS Lightweight Data Center Solution primarily focuses on providing virtualization, container, and DR and backup suites. It is compatible with mainstream hardware infrastructure through its southbound APIs, and can also connect to third-party cloud management systems via the northbound side to offer cloud services. In addition, the PaaS service incorporates big data solutions and AI enablement platforms.

    It harnesses the power of the eDME unified management platform to coordinate the construction of IT infrastructure and applications and unify applications, hardware, and platforms respectively.




    Huawei Storage has established a presence in more than 150 countries and regions, and has already garnered the trust of more than 25,000 enterprises. Notably, 47 of the world's top 100 banks have chosen to use Huawei storage solutions. Huawei has been categorized as a Leader in the Gartner® Magic Quadrant™ for Primary Storage for eight consecutive years, with scores climbing higher and higher each year.

    Huawei has also been recognized as a Customers' Choice by the Gartner® Peer InsightsTM "Voice of the Customer" for its exceptional scale-out and primary storage. 


    Future trends

    In the future, storage will be used with diversified data application acceleration engines, which can improve storage performance by a factor of 10. In terms of hardware, data flows across two buses: the double data rate (DDR) memory bus and the PCIe system bus. Huawei will use a global data bus with high throughput to integrate these two buses, greatly improving the efficiency of data flows from 5 GB/s to more than 50 GB/s.

    On the software front, employing a control and data plane separation architecture instead of an integrated architecture can significantly reduce data access latency from 100 microseconds to 10 microseconds. To further accelerate applications and enhance user experience, data application acceleration engines will be used to enable near-data processing based on optimized data storage and access functions. This innovative approach can make processing 5-10 times more efficient.

    Huawei Storage is fully committed to implementing a data-centric philosophy to build a more resilient, reliable, and efficient data foundation for customers and support the ever-changing, diversified data applications in the digital era.

    Figure 1: Reshaping storage architectures using a data-centric approach



    Learn more about Huawei Storage and subscribe to this blog to get notifications of all the latest posts.

    Disclaimer: Any views and/or opinions expressed in this post by individual authors or contributors are their personal views and/or opinions and do not necessarily reflect the views and/or opinions of Huawei Technologies.

      Leave a Comment

      Reply
      Cancel Reply
      Post Comment
      Posted in

      TAGGED

      Posted in
      Subscribe to Huawei Blog

      Archives

        Subscribe to Huawei Blog

        Your subscription was successful! Kindly check your mailbox and confirm your subscription. If you don't see the email within a few minutes, check the spam/junk folder. Email Address already exists! You need to wait for some time before subscribing again.
        About Contact Us Privacy