CESS Builds a New Paradigm for Storage, Achieving Large-Scale Commercial Storage, Supporting High-Frequency Dynamic Data
The application and development of Web3 in various fields have become a focal point of discussion. Although the industry has different definitions of Web3, a common consensus is that Web3 gives users ownership and autonomy over their data. This shift is crucial as our lives and work become increasingly digitized, meaning that all human activities will soon be presented in the form of data flows, indicating that our various behaviors will be recorded as data, forming a vast and complex data ecosystem, which will be the underlying form of the Web3 industry and even the digital life of all mankind.
How to effectively store, manage, use, and share data resources, and how to truly unleash the value of data and enjoy its benefits, have become issues that enterprises and individuals are jointly facing. Web3 data solutions, with their emphasis on ownership, have become a means to realize the new data distribution relationship. Web3 data infrastructure providers like CESS (Cumulus Encrypted Storage System) have created a new ecosystem for data economics that is open, decentralized, permissionless and gives users control over their data sovereignty.
However, the Web3 data field still faces issues such as high data loss rates, low storage space utilization, restricted data usage such as slow retrieval speeds, limited data circulation and exchange, and lack of data privacy management. Among them, the most critical issue is the lack of effective solutions for large-scale commercial application storage in the Web3 industry, which will limit the realization of large-scale applications in the Web3 era from the infrastructure level, hindering the full arrival of the next era of the Internet.
This article will introduce CESS’s innovative decentralized object storage service DeOSS from the following perspectives, and how it solves the problems faced by the data storage field.
Analysis of the technical principles of decentralized object storage service DeOSS
Comparative analysis of the performance, security, and cost of “DeOSS” and “OSS” services
DeOSS application scenarios and product usage guidelines
Why do we need the Decentralized Object Storage Service?
With the increasing demand for large-scale commercial storage, the vast amount of unstructured data generated by each user in their digital lives, such as images, videos, and log files, has become the primary data type for enterprises and individuals. Object Storage Service (OSS) has emerged to address this need. Object storage is a storage and management technology designed for unstructured data, providing large-scale, scalable, and cost-effective storage services. Amazon S3 is a well-known example of an object storage service in the industry. However, current OSS services are centralized, leading to issues such as data sovereignty loss, vulnerability to data leaks, digital identity risks, and data being sold to third parties.
Meanwhile, with the rapid development of Web3 applications, especially Dapps that rely on real-time data streams, there is a need for fast and effective processing and storage of high-frequency dynamic data to ensure application responsiveness and user experience. Additionally, the new generation of the internet places higher demands on data storage security, privacy, and data ownership, prompting the storage industry to explore more efficient, secure, and scalable solutions.
In response to the above storage problems and demands, CESS has pioneered the decentralized object storage service DeOSS. CESS aims to provide reliable support for unstructured data, high-frequency dynamic data, and large-scale commercial storage through decentralized technology and innovative storage protocols. This will not only promote the healthy development of the Web3 ecosystem but also provide users with better services, driving forward the new era of data-driven development. DeOSS can not only meet enterprise-level unstructured data storage needs but also provide high-security, scalable, and privacy-managed high-performance storage services for enterprises.
Understanding Decentralized Object Storage Service (DeOSS)
Decentralized Object Storage Service (DeOSS) is a decentralized object-based massive storage service that provides low-cost, secure, and scalable distributed data storage services for the web3 domain.
Both individuals and businesses can leverage OSS to securely store, administer and safeguard data, such as NFT images and videos, DAPP user data, Defi programs, and more. Based on blockchain technology, DeOSS effectively utilizes idle online storage resources and builds a huge distributed storage network.
The purpose of DeOSS is to restore data autonomy to its rightful proprietor, rather than a centralized authority. DeOSS follows the Apache2.0 open-source protocol, allowing anyone to deploy anywhere and access files stored around the world at the same time.
Product Introduction
Product Principle
DeOSS will provide a standard storage method to achieve basic storage functions, such as creating wallets, receiving tokens, purchase space, and authorize space through the blockchain browser with access restrictions, uploading, downloading, deleting, and sharing files with access restrictions, as well as user operation restrictions.
Specifically, user data is stored in the bucket. In the process of using DeOSS to store data, you need to create a storage container first, specify attributes such as region, access permissions, and storage type. The data is then uploaded to the storage container as an object, with each object containing the file (Data), metadata (Metadata), and file name (Key) as its unique identifier.
The storage space inside DeOSS is flat, without a file directory hierarchy. Therefore, data objects belong directly to their corresponding storage space. Enterprises can choose to build their gateway for external access, or use existing gateways. In this way, when users access through the domain name, the DeOSS gateway will forward the user’s request to the corresponding storage service.
Product Features
Decentralization: DeOSS is a decentralized object storage service in the CESS decentralized network, supporting secure HTTPS encryption for online data transmission, ensuring data security and privacy during transmission and storage.
High Scalability: Each account can manage up to 1000 buckets, and each bucket has no space limit, providing massive storage capacity.
Data Ownership: You have control over your data and its ownership, can choose private storage, share with specific individuals, or make it completely public, and have the ability to delete data without interference.
Anti-censorship: Any user can control their own data according to the protocol, avoiding interference from other entities.
Millisecond Data Retrieval: Supports real-time online data sharing and flexible file management.
What does DeOSS store?
DeOSS is suitable for storing high-definition images, audio, videos, backup files, etc., in websites and applications, as well as files in various DApp and cloud storage applications.
Who is DeOSS suitable for?
DApp, NFT, and Web3 application developers, SocialFi developers, and users with large-scale data storage needs.
If you are a non-developer user, you can experience DeOSS by visiting the CESS official website.
If you are a developer, you can experience DeOSS through HTTP requests. (Join link: https://www.cess.cloud/deoss.html)
System Architecture
Unlike mainstream distributed system architectures, DeOSS has achieved a high degree of integration with the CESS blockchain, forming a unique open and decentralized distributed object storage system that diverges from the mainstream distributed system architecture at the bottom layer. The system architecture is divided into four layers, as shown in the figure below: application,service interface, blockchain, and storage service. The application layer provides users with interactive and friendly data management services. The interface layer functions as the middleware between the application layer and the blockchain layer, enabling OSS to provide object storage services for countless custom applications and realize the opening of service functions.
Blockchain Layer
At the core of DeOSS architecture, the blockchain layer connects the scheduler, storage miners, and user applications to provide the essential functions of file metadata management, user storage space management, scheduling, and storage miner account management. The blockchain layer is built atop the CESS chain as the infrastructure that adopts the self-developed consensus algorithm R²S (For a detailed explanation, refer to the article “Detailed Explanation of CESS Mechanism (2): Blockchain Layer and the Random Rotational Selection (R²S) Consensus Mechanism”). DeOSS also has flexible storage expansion capabilities, where all eligible accounts can apply to become a scheduling node or storage miner providing services for DeOSS in exchange for rewards.
Application Layer Services
The DeOSS service interface layer implements the modular encapsulation of commonly used code bases, so the application layer only needs to implement a small number of interfaces to provide complete object storage services. The service architecture of the DeOSS application layer is shown in the figure below. At present, DeOSS provides two application modes: the Go client mode based on the command line, and the server mode based on the Gin framework. Both can quickly start the service with a simple configuration. Users can also add functional module interfaces according to their needs without concerns about the intricacies of the internal code.
Application layer
The DeOSS application service has a three-tier architecture.
The network connection layer provides the upper layer with basic services such as user interaction, data object transmission, and on-chain function calls.
The internal service layer processes user data files from the interactive layer that provides preprocessing such as data confirmation, file fragmentation and redundancy, and file declaration, and submits the processed content to the scheduler for scheduling; processing comes from the chain and storage.
The miner data is displayed to the user through the interactive layer, forming a complete service closed loop.
It also provides additional service support such as data encryption and decryption, and system logs.
The file transfer protocol
DeOSS adopts the TCP protocol as the underlying reliable communication protocol and establishes a safe and reliable file transfer mechanism. The file transfer protocol is shown below. When the service layer of the application initiates a file sending or receiving request, it first establishes a TCP connection with the receiver/sender and then establishes a file segment byte stream transmission channel through the handshake mechanism of the DeOSS file transfer protocol.
DeOSS vs OSS
DeOSS is a new type of storage service based on the CESS blockchain. In addition to having the advantages of existing object storage products on the market (such as high reliability, easy expansion, low cost, high security, etc.), DeOSS also has decentralization, attribution to users, and other advantages. The current traditional OSS products, such as Amazon and Alibaba Cloud’s OSS, are all centralized storage. When users use OSS storage services, they entrust their data to a third party, and there are risks of supervision and monopoly. The data uploaded by users through DeOSS is based on the CESS blockchain technology to achieve decentralized storage, and the ownership of the data belongs to the users. Users can authorize certain applications to use through DeOSS. Of course, these applications cannot control the data authorized by users.
The following is a detailed comparison between DeOSS and OSS:
The comparison above shows that DeOSS not only has the advantages of current object storage (OSS) products in terms of storage performance, cost, etc., but also has the decentralized nature of DeOSS, which breaks the constraints of previous storage services in terms of security, data ownership, and efficiency. This is precisely the problem that enterprise-level big data storage urgently needs to solve.
DeOSS Use Scenarios
In traditional application fields, decentralized object cloud storage like DeOSS can enter the business scope of commercial clouds, such as Amazon Cloud and Google Cloud. Through DeOSS, enterprises and individuals can provide all categories of cloud storage services to meet various use cases, including but not limited to:
Distributed File Systems — Distributed file storage can be used not only for personal user backup and sharing, but also to provide large-scale commercial storage services for enterprises.
Social Media — With its efficient, secure, scalable, and large-scale storage features, DeOSS meets the needs of social applications for secure storage, real-time updates, and user data sovereignty.
Streaming Media Applications — DeOSS provides the best solution for the creation, storage, and streaming transmission of large files such as high-definition images, audio, and video.
Data Trading Markets — DeOSS supports the monetization and circulation of data value, providing a foundation for the establishment of data trading markets.
Blockchain Data Availability Layer — DeOSS can provide low-cost, trustless, and highly available storage for block data and state data of Layer 1, as well as transaction data in Layer 2 rollup solutions.
Creator Platforms — DeOSS integrates decentralized storage networks and content delivery networks, meeting the needs of creator platforms for establishing and tracing data copyrights.
Data Lakes — DeOSS is suitable for storing, processing, and protecting large amounts of data, helping enterprises reduce costs, manage data, and use AI.
Biological Data — DeOSS supports multi-type data authorization and tracing, provides massive storage, and efficient retrieval, solving the problems faced by biological data, such as huge quantities, rapid growth, wide-ranging and complex sources, and difficulty in standardization and structuring.
Experience DeOSS Now
In the process of the Web3 revolutionary construction and innovation, new data infrastructure architectures and data circulation mechanisms are gradually forming, creating an economic system for data element authorization, circulation, and transactions. It is expected to promote the transformation of Internet business models and value distribution models, accelerate the development and innovation of the digital economy.
The innovative decentralized object storage service DeOSS provided by CESS will become one of the important products and services driving this process. DeOSS products not only have the advantages of current object storage products on the market, such as high reliability, scalability, low cost, and high security, but also have the advantages of decentralization, data ownership belonging to users, and resistance to censorship.
Dear partners, we sincerely invite you to experience and use DeOSS products! DeOSS features can be used after source code editing and deployment. For beginners, please refer to the link below: https://docs.cess.cloud/deoss/
Finally, if you encounter any problems during use, please feel free to contact us. We eagerly look forward to working with global partners to contribute to the construction of decentralized storage + CD²N for the next generation of the Internet of Value!
