版权说明:本文档由用户提供并上传,收益归属内容提供方,若内容存在侵权,请进行举报或认领
文档简介
GRID:ComputingWithoutBordersKajariMazumdarDepartmentofHighEnergyPhysicsTataInstituteofFundamentalResearch,Mumbai.Soft-computingworkshopUniversityofMumbai,December1,2009Disclaimer:Iamonlyaphysicistwhoseresearchfieldinduces&utilizescutting-edgetechnologyIhavemostlyborrowedslidesfromvariousresourcesPlanoftalkGridconceptinsimpletermsRequirementsoftoday’sscientificcommunityEvolutionofGridLHCComputingGrid
TIFRgridcomputingcentreDAEcontributionsOutlookGridcomputinginsimplewords
Gridisanutilityorinfra-structureforcomplex,hugecomputations,whereremoteresourcesareaccessiblethroughweb(internet),fromdesktop,laptop,mobilephone.
Itissimilartopowergrid,wheretheuserdoesnothavetoworryaboutthesourceofthecomputingpower.Imaginemillionsofcomputersownedbyindividuals,institutesfromvariouscountriesacrosstheworldconnectedtoformasingle,huge,super-computer!
Thistechnology,developedsincelastonlyonedecade,isbeingusedpresently,by
HighenergyphysiciststoanalyzedatatobeproducedverysooninLHCexperimentwhereIndianscientistsaretakingpart.
EarthscientiststomonitorOzonelayeractivity(dealsdailywithDatawhosevolumeisequivalentto150CDs).Itisthenaturalevolutionofinternetfacility.1.SharemorethaninformationData,computingpower,applicationsindynamic,multi-institutional,virtualorganizations(IanFoster:AnatomyofGrid)2.Efficientuseofresourcesatmanyinstitutes.Peoplefrommanyinstitutionsworkingtosolveacommonproblem(virtualorganisation).3.Joinlocalcommunities.4.Interactionswiththeunderneathlayersmustbetransparentandseemlesstotheuser.FromWebtoGridComputingComputingrequirementsHigh-endcomputingapplicationWeatherforecastSharedatabetweenthousandsofscientistswithmultipleinterestsLinkmajorandminorcomputercentresEnsurealldataaccessibleanywhere,anytimeGrowrapidly,yetremain
reliable
formorethanadecadeCopewith
differentmanagementpolicies
ofdifferentcentresEnsure
datasecurityBeupandrunningroutinelyNeedtocheckuphealthoffaciltyon24X7basis.Ahugemanpowerisatworkinvisibly.ChallengesinscientificcomputationsEver-increasingdemandPCofearly2000eraisasfastasofsupercomputersof1990’s.Still,formanyapplicationitisnotadequate!
userscontinuetobuynewmachines!StorageavailableinaPCcouldnotbethoughtofduring1990’s
storagecapacitydoublesevery12monthorso!RecentyearsofthisdecadeisseeingmammothscientifcprojectswheredatasizeisseveralPetabytesperyear.ToworkwithacolleagueevenacrossacampusonPetabytescaleweneedultrafastnetwork.EventhoughCPUpower,discstorage,communicationspeedcontinuetoincrease,computingresourcesarefailingtosatisfyusers’demands,theyaredifficulttouse.SupercomputerParallelcomputerPCclusters,multiplePCsClusters:PrimaryITinfrastructuresClustersreplacetraditionalcomputingplatformsandcanbeconfiguredaccordingtotheneedNetworkloaddistributionandloadbalanceHighavailability,Highperformance/computationintensive,..IssuesrelatedtobuildingclustersScalabilityofinterconnectionnetworkScalabilityofsoftwarecomponents(libraries,applications,..)Auto-installation,clustermanagement,trouble-shooting,…Spacemanagement(desktop/rackmounted)Layoutofnodes,noises,cablelayout,cooling,..PowermanagementCentralizedinfrastructuremanagementsoftwarePerformance/Price/Powerconsumption
Costofownershipnotverylow!
PeertoPeer(P2P)computingComputingbasedonideaofsharingdistributedresourceswitheachotherwithorwithoutthesupportfromaserver
Therearemanyunder-utilisedresourcesWithpowerfulpcs,realutilisationtodayis<10%
Inlargeorganizations,withthousandsofPCs,increasingdaybyday
utilisethatincyclestealingmode!Totaldeliveredpoweris>fewMflopsTotalavailablefreediskspace>100TerabytesLatencyandbandwidthofLANenvironmentisquiteadequateforp2pcomputingmostly.Spaceisalsonotaproblem,keepthePCswherevertheyare!InternetcomputingTodayyoucannotrunyourjobsontheinternet.InternetcomputingusingidlePC’sisbecominganimportantcomputingplatform(Seti@home,Napster,..)wwwisthepromisingcandidateforcorecomponentofwide-areadistributedcomputingenvironment.Efficientclient/servermodels/protocolsTransparentnetworking,navigation,GUIwithmultimediaaccessanddisseminationfordatavisualization.Mechanismfordistributedcomputing:CGI,JavaWithimprovedprice/performanceandopensource,freesoftware,web-services,itisbecomingeasytodeveloplooselycoupleddistributedapplications.WorkingtogetherapartEssentialsofGRIDcomputingVirtualorganizations:GRIDTIFR
GridComponentsGridoverviewHowdoesgridwork?GRIDportal/GatewayGridServices:gridmiddlewareLHCandtheGRIDComputingApathologistusesamicroscopetoexaminebloodcells,ofsizeaboutonethousandthofamm,ie,10-6mHighenergyprobesstructureoffundamentalmatter.LHCwillcollidevery,veryhighenergyprotonsforthispurpose.Mammoth,verycomplexdetectors(length30m,dia20m)arethetechnicaleyeofseveralthousandscientiststoprobethesmallestlengthscale.ComplexityofLHCexperimentsWhen2veryhighenergyprotonswillcollideatLHC,mostlythesituationinthedetectorwillbelikethis,verycrowded.About10millionelectricalsignalswillhavetoberecordedintinyfractionofasecond,repeatedlyforalongtime(about10years).Usingcomputers,adigitalimageiscreatedforeachsuchinstance.Imagesizeisabout2MBonaverage,butvariesconsiderably.Butmostofthesepicturesarenotinteresting!Goodthingsarealwaysrare!InLHCexperimentthetaskofthescientistis,to
Lookforaninstancewithpatternsofthistypefrom10thousandBillion(1013)crowdedpictures.Thispicturecontainstheclueaboutouruniverse.Suchajobislike,searchingforaneedleinamillionhaystacks!
Similartolookingforaparticularpersoninathousandworldpopulationsoftoday(6Billion,India’spopulation1.2Billion)Asinglecomputingsystemwillneverscaleuptothechallenge.ConceptofGRIDcomputingdevelopedfromsuchrequirementsLHCwillcollide6-8hundredmillionproton-on-protonpersecondforseveralyears.Only1in20thousandcollisionswillhaveanimportanttaletotell,butwedonotknowwhichone!
sowehavetosearchthroughallofthem!
Hugetask!15PBytes(1015bytes)
ofdataayearAnalysisrequires~100,000computerstogetresultsinreasonabletime.GRIDcomputingisessentialInhardnumbersLHC-CERNDAEcollaboration175Mbps100Mbps100Mbps100MbpsCAF450MB/s(300Hz)30-300MB/s(ag.800MB/s)~150kjobs/day~50kjobs/day50-500MB/s10-20MB/sCMSdetectorTier-0PromptReconstructionArchivalofCopyofRawandFirstRECOdataCalibrationStreams(CAF)DataDistribution
Tier-17Tier-1sRe-ReconstructionSkimmingSecondArchivalofRAWServedCopyofRECOArchivalofSimulationDataDistribution
Tier-2~50Tier-2sPrimaryResourcesforPhysicsAnalysisandDetetectorStudiesbyusersMCSimulation
Tier-1WLCGComputingGridInfrastructureThewayCMSusestheGRID(WLCG)TIER-3TIER-3TIER-3TIER-3100MB/sCMSinTotal:1Tier-0atCERN(GVA)7Tier-1son3continents50Tier-2son4continents33P.Kreuzer-GRIDComputing-MumbaiTier0Tier1NationalcentresTier2RegionalgroupsDifferentUniversities,InstitutesIndividualscientist’sPCExperimentalsiteCERNcomputercentre,GenevaASIA(Taiwan)IndiaChinaKoreaPakistanFranceItalyGermanyUSATIFRDelhiU.PanjabU.UsefulmodelforParticlePhysicsexperiments,butnotnecessaryforothersT2_IN_TIFRTiered/Layered
Structure
connectingcomputersacrosstheglobeHardwareatTIFRsite:T2_IN_TIFRAbout50users/scientistsatpresent,stillgrowing.AnothersimilarTier2centreinKolkataforadifferentexperimentatLHC.GridfacilityhasbeenfunctionalatTIFRforalmostayear.TheCMScollaborationatLHC,CERNhasbeenusingthecomputerresources.Storage:350TB300workernodes.Internetbandwidth:1GBps.
Tobeupgradedinnearfuture.Note,continuousmonitoringessential,wearemanageingwith5engineers,notallarefulltime.Networking,GRIDMiddleware,SitesGRIDMiddlewareServices-StorageElementsComputingElementWorkloadManagementSystemLocalFileCatalogInformationSystemVirtualOrganisationManagementServiceInter-operabilitybetweenGRIDsEGEE,OSG,NorduGriD..NetworkingSiteSpecificities,e.g.Storage/BatchsystemsatCMSTier-1s:Storage:dCache/CastordCache/HPSSdCache/CastorCastor+dCache/ChimeraEnstore Enstore Storm TSMBatch:Condor Torque/MauiBQSTorque/MauiTorque/MauiLSFPBSProFNALRALCCIN2P3PICASGCINFNFZK36P.Kreuzer-GRIDComputing-MumbaiDataTransfersfrom/toTIFRTIFR
T1TransferQuality(last3months):improving,aimforstability:TIFR
T1productiontransfers(lastyear):modestbutreadytogrow!TIFR
ASGC8TBMCdata(custodialstorage)T1
TIFRTot37TBfrom7T1s
温馨提示
- 1. 本站所有资源如无特殊说明,都需要本地电脑安装OFFICE2007和PDF阅读器。图纸软件为CAD,CAXA,PROE,UG,SolidWorks等.压缩文件请下载最新的WinRAR软件解压。
- 2. 本站的文档不包含任何第三方提供的附件图纸等,如果需要附件,请联系上传者。文件的所有权益归上传用户所有。
- 3. 本站RAR压缩包中若带图纸,网页内容里面会有图纸预览,若没有图纸预览就没有图纸。
- 4. 未经权益所有人同意不得将文件中的内容挪作商业或盈利用途。
- 5. 人人文库网仅提供信息存储空间,仅对用户上传内容的表现方式做保护处理,对用户上传分享的文档内容本身不做任何修改或编辑,并不能对任何下载内容负责。
- 6. 下载文件中如有侵权或不适当内容,请与我们联系,我们立即纠正。
- 7. 本站不保证下载资源的准确性、安全性和完整性, 同时也不承担用户因使用这些下载资源对自己和他人造成任何形式的伤害或损失。
最新文档
- 2024住房公积金担保借款协议书
- 2024公司之间居间服务合同范本
- 2024办公用品供货合同模板
- 2024全新担保追偿协议范本下载
- 2024变压器购买合同书样本
- 2024劳务外包的合同
- 团队拓展户外系列游戏大全
- 材料范文之双型党支部汇报材料
- 材料力学金属扭转实验报告
- 材料科学与工程专业解析
- 2024-2030年中国畜牧业新质生产力市场全景调研及发展前景研判报告
- D -Z-T 0425-2023 地质勘查活动质量管理规范(正式版)
- 2024年团体心理辅导理论考试题库(附答案)
- 2024年4月自考05680婚姻家庭法试题及答案含评分参考
- 2024年开展《安全生产月》活动方案 汇编2份
- 2024年眉山东坡国有资本投资运营集团有限公司招聘笔试冲刺题(带答案解析)
- 2024年浙江省衢州龙游县机关事业单位编外招聘52人(第二期)历年公开引进高层次人才和急需紧缺人才笔试参考题库(共500题)答案详解版
- 2024年四川泸州古蔺县事业单位选调人员历年公开引进高层次人才和急需紧缺人才笔试参考题库(共500题)答案详解版
- 中药熏洗法操作流程图
- 雨天里的多多.ppt
- 汉字听写专用纸
评论
0/150
提交评论