《网格数据库访问和集成服务DAIS》由会员分享，可在线阅读，更多相关《网格数据库访问和集成服务DAIS（42页珍藏版）》请在金锄头文库上搜索。
1、网格计算网格计算Grid Computing Grid Computing 肖侬肖侬网格数据库访问和集成服务DAISStillwatersrundeep.流静水深流静水深,人静心深人静心深Wherethereislife,thereishope。有生命必有希望。有生命必有希望网格计算网格计算Grid Computing Grid Computing 肖侬肖侬Data GridsDataGrid : A dynamic logical namespace that enables coordinated sharing of heterogeneous distributed storage r
2、esources and digital entities based on local and global policies across administrative domains in a virtual enterprise. DataGridvLogical name space for location independent identifiersvAbstractions for storage repositories, information repositories, and access APIsvLatency management网格计算网格计算Grid Com
3、puting Grid Computing 肖侬肖侬Data Characteristics in GridMostly unstructured data, heterogeneous resourcesvImages, files, semi-structured, databases, streams, vFile systems, SAN, FTP sites, web servers, archivesCommunity-BasedvShared amongst one or more communitiesMeta-datavDifferent meta-data schemas
4、for the same datavDifferent notations, ontologiesSensitive to Sharing网格计算网格计算Grid Computing Grid Computing 肖侬肖侬Data Grid TransparenciesAccess data without knowing the type of storagevStorage repository abstraction Find data without knowing the identifiervDescriptive attributesAccess data without kno
5、wing the locationvLogical name spaceRetrieve data using your preferred APIvAccess abstractionProvide transformations for any data collectionvData behavior abstraction网格计算网格计算Grid Computing Grid Computing 肖侬肖侬Logical Layers (bits,data,information,.)Storage Resource TransparencyStorage Location Transp
6、arencyData Identifier TransparencyData Replica TransparencyVirtual Data TransparencySemantic data Organization (with behavior)Inter-organizational Information Storage Management网格计算网格计算Grid Computing Grid Computing 肖侬肖侬Storage Resource TransparencyStandard operations at storage repositories vPOSIX l
7、ike operations on all resourcesStorage specific operationsvDatabases - bulk metadata accessvObject ring buffers - object based accessvHierarchical resource managers - status and staging requests网格计算网格计算Grid Computing Grid Computing 肖侬肖侬DAIS- Requirements & Functionalities Key Access & Integration Fu
8、nctionalities:Publication and DiscoveryStatements (Data Operations)Structured Data TransportData TransformationTransactionsMetadataManagement: Operation & PerformanceData ReplicationConnections and SessionsIntegration网格计算网格计算Grid Computing Grid Computing 肖侬肖侬DAIS Functional ScopingPublishing and Dis
9、coveryService discovery via a registryData service registry structure and contentData service descriptionDatabase contents descriptionvLogical and Physical schema, physical characteristicsDatabase capabilityvLanguages, features, characteristicsTerminology and structure of descriptions 网格计算网格计算Grid C
10、omputing Grid Computing 肖侬肖侬DAIS Functional ScopingStatementsAccess to RDBMS, XML, other databasesOperationsvPrepared and dynamic statementsvNative DML, DDL, Context, Procedures/PackagesvScripted operationsSynchronous & asynchronous statement interfacesvPreparation/validation, application, deliveryN
11、otificationvEvent and informational Natural Query language网格计算网格计算Grid Computing Grid Computing 肖侬肖侬DAIS Functional ScopingStructured Data TransportDelivery from one source to one or more specified destinations along a series of channelsTemporary storage during transportAlternative delivery modesvSt
12、reaming, multicastDelivery monitoring and notifications Support for different protocols for delivery along different channelsSystematic methods of encryption or compression on selected channels网格计算网格计算Grid Computing Grid Computing 肖侬肖侬DAIS Functional Scoping Data TransformationBefore, during, after
13、statement executionRestructuringvFormatting, sequencingSchema changevRestructuring, naming, constraintsConversionvUnits, coordinate system, algorithmic (e.g. Fourier)vComposition with computational services网格计算网格计算Grid Computing Grid Computing 肖侬肖侬DAIS Functional Scoping TransactionsDBMS capability
14、vE.g. Set transaction, commit, rollbackvEvent and informational notificationDistributed transactionsvHeterogeneous two-phase commit Relaxed transaction modelsvCore activity service model, collaborationsDefinition of new transaction models网格计算网格计算Grid Computing Grid Computing 肖侬肖侬DAIS Functional Scop
15、ing Authentication, Access Control, AccountingBasic cost modelvDBMS capability, e.g.resources usedDelegation of fine grained access rights Access based role model 网格计算网格计算Grid Computing Grid Computing 肖侬肖侬DAIS Functional Scoping MetadataTechnical metadatavLocation, physical schema, data characterist
16、ics, owner, version, access methodsvDatabase capabilities and extensionsContextual metadatavLogical schema, classifications, terminologies, ontologies, derived dataContext for schema mappingvSchema conversion and evolution网格计算网格计算Grid Computing Grid Computing 肖侬肖侬DAIS Functional Scoping Management:
17、Operations and PerformanceExploit DBMS capabilitiesvRAMPSvReorganisation, backup/recovery, user management网格计算网格计算Grid Computing Grid Computing 肖侬肖侬DAIS Functional Scoping Data ReplicationExploit DBMS capabilitiesvReplication and synchronisation featuresCore replication capability vData definition,
18、manipulation, transport operations网格计算网格计算Grid Computing Grid Computing 肖侬肖侬DAIS Functional Scoping Connections and SessionsFurther investigation required网格计算网格计算Grid Computing Grid Computing 肖侬肖侬DAIS Functional Scoping IntegrationHighly dynamic federation Alternate source selection form available r
19、eplicasFacilitate optimisationSemantic based integration网格计算网格计算Grid Computing Grid Computing 肖侬肖侬Traditional Distributed Database Management System and Their Limitations Challenges to Distributed Database Management System Scale Heterogeneity Distribution AutonomyTransparency网格计算网格计算Grid Computing
20、Grid Computing 肖侬肖侬Federated DBsData DistributionNo Common SchemaA federated DBMS serves as a middlewareSolved Some Problem partially:Heterogeneity transparencyDistribution transparency网格计算网格计算Grid Computing Grid Computing 肖侬肖侬Traditional Distributed Data Management System and Their Limitations Inte
21、r-Operations Using ODBC/JDBC/OLE DB网格计算网格计算Grid Computing Grid Computing 肖侬肖侬传统的分布环境下数据管理系统和传统的分布环境下数据管理系统和 网格环境中数据管理系统的区别网格环境中数据管理系统的区别特征传统分布环境下 数据管理系统网格环境下 数据管理系统开放性需求和技术：有一定确定性和封闭性开放系统、开放技术通用性专门领域、专门技术通用技术集中性统一规划、集中控制自然进化、非集中控制使用模式终端 或 C/S服务模式标准化领域标准或行业标准通用标准（+行业标准）平台性应用解决方案平台或基础设施网格计算网格计算Grid Co
22、mputing Grid Computing 肖侬肖侬Grid-enable DatabaseDatabase Requirements of Grid ApplicationThe most important requirementsDBS must support the,Grid standards: relevant, existing and emerging ,for example the Grid Security InfrastructureOther important requirementsRetrieval(Grid IR)ScalabilityHandling u
23、npredictable usageMeta-driven accessMultiple Database Federation 网格计算网格计算Grid Computing Grid Computing 肖侬肖侬Grid-enable DatabaseCollective view of vInter-organizational data vOperations on grid spaceLocal autonomy and global state consistencyCollaborative communitiesvMultiple administrative domains o
24、r “Grid Zones”Self-describing and self-manipulating data vHorizontal and vertical behaviorvLoose coupling between data and behavior (dynamically)vRelationships between a digital entity and its Physical locations, Logical names, Meta-data, Access control, Behavior, “Grid Zones”.网格计算网格计算Grid Computing
25、 Grid Computing 肖侬肖侬Need for Standard DGLDatabaseSQL121.EventHits.sqlUniversity of Gators121.EventThit.xmlNational LabGrid-Enable DatabaseXML based,Invoke OperationsSubset XQueryDGLDDL,DML,DQL网格计算网格计算Grid Computing Grid Computing 肖侬肖侬网格计算网格计算Grid Computing Grid Computing 肖侬肖侬信息技术的演变信息技术的演变Mainframe大
26、型主机客户服务器Internet计算结构部门级服务器网格计算网格计算Grid Computing Grid Computing 肖侬肖侬“目前目前 IT 部部门运行效率十分低下，运行效率十分低下，通常只利用了通常只利用了总容量的小部分容量的小部分”Frank E. GillettForrester 研究公司，2002年10月网格计算网格计算Grid Computing Grid Computing 肖侬肖侬当前当前IT所面临的问题所面临的问题信息孤岛信息孤岛v为最大负载而配置为最大负载而配置v伸缩性有限伸缩性有限v可用性可用性 99.x% v安全控制分散安全控制分散成本不断上涨成本不断上涨影响
27、所有行业影响所有行业网格计算网格计算Grid Computing Grid Computing 肖侬肖侬降低降低IT 成本成本昂贵的硬件设备昂贵的硬件设备附加成本亦十分昂贵附加成本亦十分昂贵单点故障单点故障提供企业级服务成本高提供企业级服务成本高昂昂低成本模块化设备低成本模块化设备附加成本低附加成本低无单点故障无单点故障提供企业级服务成本低提供企业级服务成本低大型专用服务器Oracle 网格技术网格计算网格计算Grid Computing Grid Computing 肖侬肖侬企业级网格计算意味着企业级网格计算意味着CEOsv降低费用降低费用v随用随付随用随付IT 经理经理v提高可用性提高可用
28、性v提高服务质量提高服务质量IT 管理人员管理人员v提高自动化程度和生产率提高自动化程度和生产率v减少错误减少错误网格计算网格计算Grid Computing Grid Computing 肖侬肖侬对开发人员和独立软件商意味对开发人员和独立软件商意味着着无须更改程序代码无须更改程序代码应用系统的管理功能更强应用系统的管理功能更强v处理过程自动化处理过程自动化v数据库自动化管理数据库自动化管理利用共有服务功能利用共有服务功能v如：身份认证等如：身份认证等硬件系统的成本更低硬件系统的成本更低网格计算网格计算Grid Computing Grid Computing 肖侬肖侬Oracle 网格计算结
29、构网格计算结构计算机资源共享池虚拟与信息提供负载均衡高质量服务自动化网格控制网格控制存存储网格网格数据数据库网格网格应用服用服务器网格器网格网格计算网格计算Grid Computing Grid Computing 肖侬肖侬基于规则的负载均衡技术基于规则的负载均衡技术实现于数据库和应用服务器集群中实现于数据库和应用服务器集群中基于规则动态分配服务器资源基于规则动态分配服务器资源自动分派服务请求自动分派服务请求一个服务器出现故障，处理过程自动分派一个服务器出现故障，处理过程自动分派到其他服务器上到其他服务器上处理量变化时，重新分配服务器容量处理量变化时，重新分配服务器容量网格计算网格计算Grid
30、 Computing Grid Computing 肖侬肖侬网格管理网格管理统一管理和监控统一管理和监控利用标准的规则进行利用标准的规则进行管理管理系统配置系统配置性能调整性能调整安全控制安全控制自动化处理自动化处理应用系统多个系统网格计算网格计算Grid Computing Grid Computing 肖侬肖侬现有应用系统现有应用系统不需要修改不需要修改就可以利用网格技术就可以利用网格技术套装应用系统客户定制的应用系统所有的应用系统网格计算网格计算Grid Computing Grid Computing 肖侬肖侬数据库集群和应用服务器集群：数据库集群和应用服务器集群：经受考验的成熟技术经
31、受考验的成熟技术全球成千上万用户全球成千上万用户运行于所有平台上运行于所有平台上网格计算网格计算Grid Computing Grid Computing 肖侬肖侬 Transaction Processing Council (TPC), www.tpc.org. As of December 8, 2003: Sixteen-node HP Integrity rx5670 server cluster, each with 4 Itanium 2 1.5 GHz processors, 1,184,893.38 tpmC, $5.52/tpmC, available April 30,
32、2004. HP Integrity Superdome server with 64 Itanium 2 1.5 GHz processors, HP-UX 11iv2, 1,008,144.49 tpmC, $8.33/tpmC, available December 31, 20031,184,893数据库性能数据库性能1,108,144As of November 4, 2003: Oracle Database 10g Enterprise Edition, HP Integrity Superdome, 1,008,144.49 tpmC, $8.33/tpmC, availabl
33、e 12/31/03. Source: Transaction Processing Council (TPC), www.tpc.org创TPC-C世界记录541,764423,414As of September 5, 2003: Oracle Database 10g Enterprise Edition, HP Integrity Superdome, 824,164.53 tpmC, $8.28/tpmC, available 12/31/03. Oracle Database 10g Enterprise Edition, HP 9000 Superdome Enterprise
34、Server, 541,673 tpmC, $10.69/tpmC, available 12/31/03. Oracle9i Database Enterprise Edition, HP 9000 Superdome Enterprise Server, 423,414 tpmC, $15.64/tpmC, available 12/31/03Source: Transaction Processing Council (TPC), www.tpc.org比Oracle9i快28%As of September 5, 2003: Oracle Database 10g Enterprise
35、 Edition, HP Integrity Superdome, 824,164.53 tpmC, $8.28/tpmC, available 12/31/03. NEC Express5800/1320Xd, Oracle Database 10g Enterprise Edition, 521,440.53 tpmC, $11.77/tpmC, available February 15, 2004. HP Integrity rx5670, (Oracle Database 10g Standard Edition), 136,110.98 tpmC, $4.09/tpmC, avai
36、lable December 31, 2003. Source: Transaction Processing Council (TPC), www.tpc.org136,111 以及 Linux世界记录网格计算网格计算Grid Computing Grid Computing 肖侬肖侬1,165(2个个cpu)应用服务器性能应用服务器性能2003年9月12日: HP ProLiant ML370G3 (2个CPU); Red Hat Linux AS 2.1; Oracle 应用服务器10g; 431.26 TOPS双节点，$160.62/TOPS单节点。HP rx5670 (4 CPUs)
37、; HP-UX 11i; BEA WebLogic Server 7.0; 408.02 TOPS双节点, $1075.17/TOPS双节点。来源: SPEC (http:/www.spec.org)?IBM创Linux SpecjAS2002世界记录1,037BEA(4个个cpu)网格计算网格计算Grid Computing Grid Computing 肖侬肖侬Oracle公司的数据中心公司的数据中心Oracle大学网格大学网格外包业务网格外包业务网格网格控制网格控制存存储网格网格数据数据库网格网格应用服用服务器网格器网格网格计算网格计算Grid Computing Grid Comput
38、ing 肖侬肖侬如何开展网格之旅如何开展网格之旅 自自动化及化及优化化合并合并标准化准化网格计算网格计算Grid Computing Grid Computing 肖侬肖侬经过实施施标准化、自准化、自动化及合并，化及合并，拥有有主机、主机、Unix 和和 Windows 典型配置的企典型配置的企业即能即能节省省 8.5% 到到 10.5% 的构建数据的构建数据中心的中心的预算。算。“”Gartner Research :Gartner Research : 实时基基础架构架构对 IT IT 运运营预算的影响算的影响 ( (Donna Scott, John A. Donna Scott, John A. Oborn, Barbara Gomolski) Oborn, Barbara Gomolski) 2003 2003 年年 7 7 月月 17 17 日日
