《英语(全英文)architecture-design-of-global-distributed-storage-system-for-data-grid本科学位论文》由会员分享，可在线阅读，更多相关《英语(全英文)architecture-design-of-global-distributed-storage-system-for-data-grid本科学位论文（18页珍藏版）》请在金锄头文库上搜索。
1、英语毕业论文Architecture Design of Global Distributed Storage System for Data GridLongbo Ran, Hai Jin, Zhiping Wang, Chen Huang, Yong Chen, and Yongjie JiaInternet and Cluster Computing CenterHuazhong University of Science and Technology, Wuhan 430074, ChinaEmail: AbstractData grids are becoming increasin
2、gly important for sharing large data collections, archiving and disseminating. In this paper we describe architecture of global distributed storage system for data grid. We focus on the management and the capability for the maximum users and maximum resources on the Internet, as well as performance
3、and other issues.Keywords: Data grids, Match tree, Metadata, Name space1. IntroductionData-intensive, high-performance computing applications require the efficient management and transfer of terabytes or petabytes of information in wide-area, distributed computing environments 128. Examples of data-
4、intensive applications include experimental analyses and simulations in several scientific disciplines, such as high-energy physics, climate modeling, earthquake engineering and astronomy 23. These applications share several requirements. Massive data sets must be shared by a large community of hund
5、reds or thousands of users distributed around the world. Data grids are becoming increasingly important for sharing large data collections, archiving and disseminating.Researches on massive storage system have gained significant achievements. There are already a number of storage systems used by the
6、 grid community, each of which was designed to satisfy specific needs and requirements for storing, transferring and accessing large datasets. These include Distributed Parallel Storage System (DPSS) and High Performance Storage System (HPSS), which provide high performance access to data and utiliz
7、e parallel data transfer and/or striping across multiple servers to improve performance 428. Distributed File System (DFS) supports high-volume usage, dataset replication and local caching. OceanStore is a global persistent data store designed to scale to billions of users. It provides a consistent,
8、 high available, and durable storage utility atop an infrastructure comprised of untrusted servers 5. GridFTP is a high-performance, secure, reliable data transfer protocol optimized for high-bandwidth wide-area networks 68. Storage Resource Broker (SRB) connects heterogeneous data collections, prov
9、ides a uniform client interface to storage repositories, and provides a metadata catalog for describing and locating data within the storage system 4. Other systems allow clients to access structured data from a variety of underlying storage systems.In this paper, we present a novel architecture of
10、a global distributed storage system built atop SAN, NAS, or any other storage systems, called Global Storage Provider (GSP). We provide a data management service in the data grid environment. Our purpose is to construct a distribute storage system with high scalability, high security, high efficienc
11、y, which offers a high quality storage service to millions of users over Internet. The scalability and efficiency of global name space and the meta-data service is discussed in detail in order to provide easy and efficient access or share of files to the wide area storage system.We give a user and g
12、roup-based multi-namespace architecture, and develop a new approach to solve the bottleneck problem of metadata server. A new component, called Storage Service Provider (SSP), is introduced to supply storage service to users, and plays as a user agent to the storage system. The data sharing and acce
13、ss control among different users and groups are completed by the combination of user-based access control methods and role-based access control methods. To supply different QoS to different users, files can be replicated, clipped, and stored in different storage pools. A prototype has been developed
14、 to provide extended ftp service to end users and some simple file APIs.The rest of the paper is organized as follows. Section 2 describes the design principles of GSP. Section 3 details the architecture of GSP. Section 4 discusses the relate works closely to our project. Section 5 ends with the cur
15、rent state of our project and the future work.2. Design Principles of Global Storage ProviderGSP is a middleware to unify heterogeneous storage resources to provide huge available storage resources for enormous users. The system provides high availability, high expansibility and high speed.2.1 GSP I
16、nterfacesIn the global data grid environment there are many kinds of storage resources existing on different platforms. Uniform interface for the users access different resources transparently must be provided.In order to meet the requirements of different applications, three kinds of interfaces are needed. First, standard FTP interface is needed, because most general methods for access storage resources thr
