版权说明:本文档由用户提供并上传,收益归属内容提供方,若内容存在侵权,请进行举报或认领
文档简介
ValidationofEconomicCapitalModels:StateofthePractice,SupervisoryExpectationsandResultsfromaBankStudyMichaelJacobs,Ph.D.,CFASeniorFinancialEconomist/CreditRiskAnalysisDivisionU.S.OfficeoftheComptrolleroftheCurrencyRiskConferenceonEconomicCapital,NYC,February2010TheviewsexpressedhereinarethoseoftheauthoranddonotnecessarilyrepresenttheviewsoftheOfficeoftheComptrolleroftheCurrencyortheDepartmentoftheTreasury.经济资本模型验证方法共37页,您现在浏览的是第1页!Outline Introduction,BackgroundandMotivationFitnessforUseofEconomicCapital(EC)ModelsProvidingConfidenceRegardingECModelAssumptionsAssessingtheValueofValidationMethodologiesQualitativeApproachesQuantitativeApproachesSupervisoryConcernsandExpectationsLimitationsofValidationEffectiveReportingofModelOutputsTechnicalChallengesinTestingtheAccuracyofECModelsAssessingAccuracyintheTailsoftheLossDistributionExample:AlternativeModelsforRiskAggregation经济资本模型验证方法共37页,您现在浏览的是第2页!Introduction,BackgroundandMotivationThevalidationofECmodelsisataverypreliminarystageInternalcapitaladequacyassessmentprocess(ICAAP):notamodelforEC,butanoverallframeworkforassessingifECisappropriateECmaybeaquantitativeponentofICAAP,butitisnotrequiredofallbanksbysupervisors(onlythelargest)ValidationofthequantitativeECponentofICAAP,ifthereisone,isaponentofICAAPECmodelscanbeplex,havingmanyponents,anditmaynotbeimmediatelyobviousthatasuchmodelworkssatisfactorilyModelsmayembodyassumptionsaboutrelationshipsamongstorbehaviorofvariablesthatmaynotalwayshold(e.g.,stress)Validationcanprovideadegreeofconfidencethatassumptionsareappropriate,increasingtheconfidenceofusersinthemodeloutputsAdditionally,validationcanbealsousefulinidentifyingthelimitationsofECmodels(i.e.,whereembeddedassumptionsdonotfitreality)经济资本模型验证方法共37页,您现在浏览的是第3页!Introduction,BackgroundandMotivation(continued)Thereexistsawiderangeofvalidationtechniques,eachprovidingevidenceregardingonlysomeofthedesirablepropertiesofamodelSuchtechniquesarepowerfulinsomeareas(risksensitivity)butnotinothers(accuracyofabsoluteECorquantileestimator)ArangeofvalidationtechniquescanprovidemoresubstantialevidencefororagainsttheperformanceofthemodelParticularlyinanenvironmentofgoodcontrolsandgovernanceThereappearstobescopefortheindustrytoimprovethevalidationpracticesthatshedlightontheoverallcalibrationofmodelsParticularlyincaseswhereassessmentofoverallcapitalisanimportantapplicationofthemodel经济资本模型验证方法共37页,您现在浏览的是第4页!FitnessforPurposeofECModels(continued)ECareconceptuallysimilartoVaRmodels,butseveraldifferencesforcevalidationmethodstodifferinpracticefromthoseusedinVaRLongtimehorizon,highconfidencelevels,andthescarcityofdataFullinternalECmodelsarenotusedforPillar1minimumcapitalrequirements,sofitnessforpurposeneedstocoverarangeofusesMostofwhichandperhapsalltheseusesareinternaltothefirminquestionNotethatECmodelsandregulatorycapitalservedifferentobjectives&mayreasonablydifferinsomedetailsofimplementationBCBS’sValidationPrinciple1referstopredictiveabilityofcreditratingsystems,anemphasisonperformanceofmodelforecastsThenaturalevolutionofthisprincipleforECisthatvalidationisconcernedwiththepredictivepropertiesofthosemodelsI.e.,embodyforward-lookingestimatesofrisk&theirvalidationinvolvesassessingthoseestimates,sothisrelatedprincipleremainsappropriateBroadlyinterpretedvalidationprocessessetouthereinindifferentwaysallprovideinsightintothepredictiveabilityofECmodel经济资本模型验证方法共37页,您现在浏览的是第5页!ProvidingConfidenceRegardingECModelAssumptions(cont.)ThereisgreatdifficultyinvalidatingconceptualsoundnessofanECmodelduetomanyuntestableorhard-to-testassumptionsmade:FamilyofstatisticaldistributionsforriskfactorsEconomicprocessesdrivingdefaultorloss(e.g.,observablevs.latent)Dependencystructureamongrisksorlosses(e.g.,copulae)Behaviorofmanagementoreconomicagents&howthesevaryovertimeSomeECmodelsareofriskaggregationmodelswhereestimatesforindividualcategoriesarebinedtogenerateasingleriskfigureTheremaybenobestoruniquewaytodothisaggregationSincemanyoftheseassumptionsmaybeuntestable,itmaybeimpossibletobecertainthatamodelisconceptuallysoundWhiletheconceptualunderpinningsmayappearcoherentandplausible,theymayinpracticebenomorethanuntestedhypothesesOpinionsmayreasonablydifferaboutthestrengthorweaknessofanyparticularprocessinrespectofanygivenproperty经济资本模型验证方法共37页,您现在浏览的是第6页!ValidationofECModels:RangeofPracticeinQualitativeApproachesThephilosophyoftheusetestasincorporatedintotheBaselIIframework:ifabankisactuallyusingitsriskmeasurementsystemsforinternalpurposes,thenwecanplacemorerelianceonitApplyingtheusetestsuccessfullywillentailgainingacarefulunderstandingofwhichmodelpropertiesarebeingusedandwhicharenotBankstendtosubjecttheirmodelstosomeformofqualitativereviewprocess,whichcouldentail:ReviewofdocumentationordevelopmentworkDialoguewithmodeldevelopersormodelmanagersReviewandderivationofanyformulaeoralgorithmsComparisontootherfirmsorwithpubliclyavailableinformationQualitativereviewisbestabletoanswerquestionssuchas:Doesthemodelworkintheory?Doesthemodelincorporatetherightriskdrivers?Isanytheoryunderpinningitconceptuallywell-founded?Isthemathematicsofthemodelright?经济资本模型验证方法共37页,您现在浏览的是第7页!RangeofPracticeinQualitativeApproachestoValidation(concluded)Asallmodelsrestonpremisesofvariouskinds,varyinginthedegreetowhichobvious,wehaveexaminationofassumptionsCertainaspectsofanECmodelare'built-in'andcannotbealteredwithoutfundamentallychangingthemodelToillustrate,theseassumptionscouldbeabout:Fixedmodelparameters(PDs,correlationsorrecoveryrates)Distributionalassumptions(margins,copulae&shapeoftaildistributions)BehaviorofseniormanagementorofcustomersSomebanksgothroughadeliberateprocessofdetailingtheassumptionsunderpinningtheirmodels,includingexaminationof:ImpactonmodeloutputsLimitationsthattheassumptionsplaceonmodelusageandapplicability经济资本模型验证方法共37页,您现在浏览的是第8页!RangeofPracticeinQuantitativeValidation:ModelReplicationModelreplicationisusefultechniquethatattemptstoreplicateECmodelresultsobtainedbythebankThiscoulduseindependentlydevelopedalgorithmsordatasources,butinpracticereplicationmightleverageabank’sexistingprocessesE.g.,runamodelofthesametypeorclassonathebank'sdata-setHowever,butoncetheeithertheoriginalortestmodelhasbeenvalidatedThistechniqueandthequestionsthatoftenariseinimplementingreplicationcanhelpidentifyif:Definitions&algorithmsthebankclaimstousecorrectlyareunderstoodbystaffwhodevelop,maintain,operateandvalidatethemodelThebankisusinginpracticethemodelingframeworkthatitpurportstoComputercodeiscorrect,efficientandwell-documentedDataclaimedtobeusedbythebanktoobtainitsresultsisinfactbeingusedHowever,thistechniqueisrarelysufficienttovalidatemodels,andinpracticethereislittleevidenceofitbeingusedbybanksforeithervalidationortoexplorethedegreeofaccuracyoftheirmodelsNotethatreplicationsimplybyre-runningasetofalgorithmstoproduceanidenticalsetofresultswouldnotbesufficientmodelvalidationduediligence经济资本模型验证方法共37页,您现在浏览的是第9页!RangeofPracticeinQuantitativeValidation:Benchmarking(continued)Theremaybegoodreasonswhymodelsproduceoutliersinbenchmarking,allofwhichplicateinterpretationoftheresults:MaybedesignedtoperformwellunderdifferingcircumstancesMaybemoreorlessconservativelyparameterizedMaydifferintheireconomicfoundationsComparisonsofinternalECaremadewithvariedalternatives:IndustrysurveyresultsRatingagencyorindustry-widemodelsConsultancymarketedmodelsAcademicpapersRegulatorycapitalmodels经济资本模型验证方法共37页,您现在浏览的是第10页!RangeofPracticeinQuantitativeValidation:BacktestingBacktestingaddressesthequestionofhowwellthemodelforecaststhedistributionofoutesTherearemanyformsofthisthatentailsomedegreeofparisonofoutestoforecasts,andthereisawideliteratureonthesubjectHowever,weakpowerofbacktestingtestsformodelsofriskthatquantifyhighquantileshasbeennotedE.g.,forportfoliocreditmodelsseeBCBS(1999)Variationstothebasicbacktestingapproachwhichcanincreasethepowerofthetestshavebeensuggestedintheliterature:Backtestingmorefrequentlyovershorterholdingperiods(e.g.,inmarketriskusingaone-daystandardversusthe10-dayregulatorycapitalstandardUsingcross-sectionaldataonarangeofreferenceportfoliosUsinginformationinforecastsofthefulldistributionTestingexpectedvaluesofdistributionsasopposedtohighquantiles经济资本模型验证方法共37页,您现在浏览的是第11页!RangeofPracticeinQuantitativeValidation:StressTestingStresstestingcoversbothstressingofthemodelandparisonofmodeloutputstostresslossesTheoutputsofthemodelmightbeexaminedunderconditionswheremodelinputsandmodelassumptionsmightbestressedThisprocesscanrevealmodellimitationsorhighlightcapitalconstraintsthatmightonlybeeapparentunderstressWhilestresstestingofregulatorycapitalmodels,particularlyIRBmodels,ismonlyundertakenbybanks,thereismorelimitedevidenceofstresstestingofeconomiccapitalmodelsThroughaplementaryprogrammeofstresstesting,thebankmaybeabletoquantifythelikelylossesthatthefirmwouldconfrontunderarangeofstresseventsComparisonofstresslossesagainstmodel-basedcapitalestimatesmayprovideamodestdegreeoffortoftheabsolutelevelofcapitalBanksreportsomeuseofthisstresstestingtechniquetovalidatetheapproximatelevelofmodeloutput经济资本模型验证方法共37页,您现在浏览的是第12页!SupervisoryConcernsandExpectationsintheValidationofECModelsGiventheinherentlimitationsofECmodelvalidation,thereisanemphasisoneffectivereportingtoavoidmisuseormisunderstandingArecognitionofintrinsicdifficultyinevaluationofhighquantilesoflossoverlongperiods,datascarcity&technicaldifficultiesClearreportingofsuchdifficulties&limitationstousers&seniormanagementisnecessaryforthemtounderstandthattheremaybegreateruncertaintyaroundtheoutputfromECmodelsModelsnotfullyvalidatedimpliesoutputshouldgenerallybetreatedwithextraconservatismUnderstand&explorethepotentialcostsofusingmodelsinthissituation(i.e.,ifkeyassumptionsprovetobeinaccurate)Whilevalidationpracticesdependonmodeltype&use,weaknessestargetedatevaluationofoverallperformancemightresultinbanksoperatingwithinappropriatelycalibratedmodelsThiscouldbeofconcernifassessmentofoverallcapitaladequacyisanimportantapplicationofthemodelImprovementsintheseareascouldincludefurtherbenchmarking&industry-wideexercises,backtesting,P/Lanalysisandstresstesting经济资本模型验证方法共37页,您现在浏览的是第13页!TechnicalChallengesinAssessingtheAdequacyofanECModelAfundamentaldifficultyfacedinECmodelingisthelackofdatatoestimatehighquantilesinthetailsofthelossdistributionleadstoaveryhighdegreeofuncertaintyOneapproachtodealingwiththisproblemisBayesiantechniques,whichbineexpertassessmentswithavailabledataSeeKiefer&Jacobs(2010,forthing)However,thisisputationallydemanding,andalsorequirestheelicitationofapriordistributionfromanexpect,whichisveryinvolvedButifthepriorisdiffuse,thenmuchuncertaintystillremainsAswedon’tseethisusedinpracticecurrently,wewillnotfurtherpursuethisapproachhereAsnotedpreviously,traditionalbacktestingproceduresasappliedinmarketriskVaRmodelsareimpracticalinanECmodelsettingAnalternativeapproachistotrytoassesstheaccuracyoftheECoutputbyapproximatingastatisticalmeasureofuncertaintyE.g.,throughresamplingorbootstrapmethods(Efronetal,1986)Butthindatainthetailsimpliesconfidenceboundsarelikelytobewide
.经济资本模型验证方法共37页,您现在浏览的是第14页!ValidationExample:AlternativeRiskAggregationModels–RiskProxyDataSummary(LargestBanksAsOf4Q08)经济资本模型验证方法共37页,您现在浏览的是第15页!ValidationExample:AlternativeRiskAggregationModels–CorrelationsofRiskProxies(LargestBanksAsOf4Q08))经济资本模型验证方法共37页,您现在浏览的是第16页!ValidationExample:AlternativeRiskAggregationModels–AbsoluteECComparison(LargestBanksAsof4Q08)经济资本模型验证方法共37页,您现在浏览的是第17页!ValidationExample:AlternativeRiskAggregationModels–%DiversificationComparison(LargestBanksAsof4Q08)经济资本模型验证方法共37页,您现在浏览的是第18页!ValidationExample:AlternativeRiskAggregationModels–ECVariabilityComparison(LargestBanksAsof4Q08)经济资本模型验证方法共37页,您现在浏览的是第19页!ValidationExample:AlternativeRiskAggregationModels–ECVariabilityComparison(LargestBanksAsof4Q08)经济资本模型验证方法共37页,您现在浏览的是第20页!FitnessforPurposeofEconomicCapitalModelsInsomecasesthetermvalidationisusedexclusivelytorefertostatisticalexpostvalidation(e.g.,backtestingofaVaR)InothercasesitisseenasabroaderbutstillquantitativeprocessthatalsoincorporatesevidencefromthemodeldevelopmentstageHerein,“validation”ismeantbroadly,meaningalltheprocessesthatprovideevidence-basedassessmentofamodel'sfitnessforpurposeThisassessmentmightextendtothemanagementandsystemsenvironmentwithinwhichthemodelisoperatedItisadvisablethatvalidationprocessesaredesignedalongsidedevelopmentofthemodels,ratherthanchronologicallyThisinterpretationofvalidationisconsistentwiththeBaselCommittee(2005)inrelationtotheBaselIIFrameworkHowever,thatwasphrasedintermsoftheIRBparameters&developedinthecontextofassessmentofriskestimatesforuseinminimumcapitalrequirementsValidationofECdifferstoanIRBmodelastheoutputisadistributionratherthanasinglepredictedforecastagainstwhichactualoutesmaybepared经济资本模型验证方法共37页,您现在浏览的是第21页!ProvidingConfidenceRegardingECModelAssumptionsPropertiesofanECmodelthatcanbeassessedusingpowerfultools,andhencethatarecapableofrobustassessment,include:IntegrityofmodelimplementationDegreetowhichgroundedinhistoricalexperienceSensitivitytorisk&totheexternalenvironmentGoodmarginalpropertiesRankordering&relativequantificationPropertiesofanECmodelforwhichonlyweakervalidationprocessesareavailableinclude:Conceptualsoundness&validityofassumptionsDegreetowhichmodelisforward-lookingAbsoluteriskquantification&predictiveaccuracyofriskestimateItisimportanttostressthepowerofindividualtests&acknowledgethatviewsastostrengthandweaknessarelikelytodiffer经济资本模型验证方法共37页,您现在浏览的是第22页!ValidationofECModels:IntroductiontoRangeofPracticeWhilewewilldescribethetypesofvalidationprocessesthatareinuseorcouldbeused,notethatthelistisnotprehensiveWedonotsuggestthatalltechniquesshouldorcouldbeusedbybanksWewishtodemonstratethatthereisawiderangeoftechniquespotentiallycoveredbyourbroaddefinitionofvalidationThisiscreatingalayeredapproach,themore(fewer)ofwhichthatcanbeprovided,themore(less)fortthatvalidationisabletoprovideevidencefororagainsttheperformanceofthemodelEachvalidationprocessprovidesevidencefor(oragainst)onlysomeofthedesirablepropertiesofamodelThelistpresentedbelowmovesfromthemorequalitativetothemorequantitativevalidationprocesses,andtheextentofuseisbrieflydiscussed经济资本模型验证方法共37页,您现在浏览的是第23页!RangeofPracticeinQualitativeApproachestoValidation(continued)Extensivesystemsimplementationtestingisstandardforproduction-levelriskmeasurementsystemspriortoimplementationE.g.,useracceptancetesting,checkingofmodelcode,etc.Theseprocessescouldbeviewedaspartoftheoverallvalidationeffort,sincetheywouldassistinevaluatingwhetherthemodelisimplementedwithintegrityManagementoversightistheinvolvementofseniormanagementinthevalidationprocessE.g.,reviewingoutputfromthemodel&usingtheresultsinbusinessdecisionsSeniormanagementknowinghowthemodelisused&outputsareinterpretedThisshouldtakeaccountofthespecificimplementationframeworkadoptedandtheassumptionsunderlyingthemodelanditsparameterizationDataqualitychecksrefertotheprocessesdesignedtoprovideassuranceofthepleteness,accuracyandappropriatenessofdatausedtodevelop,validateandoperatethemodelE.g.,Reviewof:datacollectionandstorage,datacleaningoferrors,extentofproxydata,processesthatneedtobefollowedtoconvertrawdataintosuitablemodelinputs,andverificationoftransactiondatasuchasexposurelevelsWhilenottraditionallyviewedbytheindustryasaformofvalidation,increasinglyformingamajorpartofsupervisorythinking经济资本模型验证方法共37页,您现在浏览的是第24页!RangeofPracticeinQuantitativeApproachestoValidation:InputsApletevalidationofanECmodelwouldinvolvetheinputsandparameters,bothstatisticallyestimatedandnotExamplesofestimated(assumed)parametersarethemainIRBparameters(PDorLGD)(correlations,PDinalowdefaultportfolio)Techniquescouldincludeassessingparametersagainst:HistoricaldatathroughreplicationofestimatorsOutesovertimethroughbacktestingMarket-impliedparameters(e.g.,impliedvolorcorrelation,CDSspreadsforPD)MaterialitythroughsensitivitytestingThistestingofinputparameterscouldplementexaminationofassumptionspreviously&sensitivitytestingtodescribedlaterHowever,thatcheckingofmodelinputsisunlikelytobefullysatisfactorysince,everymodelisbasedonunderlyingassumptionsThemoresophisticatedthemodel,themoresusceptibletomodelerror,socheckinginputparameterswillnothelphereHowever,modelaccuracyandappropriatenesscanbeassessed,atleasttosomedegree,usingtheprocessesdescribedinthissection经济资本模型验证方法共37页,您现在浏览的是第25页!RangeofPracticeinQuantitativeValidation:BenchmarkingBenchmarkingtheparisonofabank’sECmodeltoalternativemodelsonthebank’sportfolioE.g.,toavendormodelafterstandardizationofparametersAmongthemostmonlyusedformsofquantitativevalidationusedinternallyAlimitationofbenchmarkingisitonlyprovidesrelativeassessmentsandprovideslittleassurancethatanymodelaccuratelyreflectsrealityorabouttheabsolutelevelsofcapitalTherefore,asavalidationtechnique,benchmarkingislimitedtoprovidingparisonofonemodelagainstanotheroronecalibrationtoothers,butnottestingagainst‘reality’Itisthereforedifficulttoassessthedegreeoffortprovidedbysuchbenchmarkingmethods,astheymayonlybecapableofprovidingbroadparisonsconfirmingthatinputparametersormodeloutputsarebroadlyparable经济资本模型验证方法共37页,您现在浏览的是第26页!RangeofPracticeinQuantitativeValidation:HypotheticalPortfoliosHypotheticalportfoliotestingisanexaminationofeitherdifferentbank’sECmodelsonareferenceportfolio,ordifferentbanksECoutputfromagivenreferencemodelThisistypicallyaeitherareferencemodelorportfolioexternaltoanyonebankFromasupervisoryperspective:permitsidentificationofmodelsthatproduceoutliersamongstasetofbanksA“modelriskmanagement”toolAlternatively,thishelpssupervisorsidentifybanksthatareoutliersinriskwithrespecttoareferencemodelA“bankportfolioriskmanagement”toolIneithercasethismeansparisonacrossbank’smodelsagainstthesamereferenceportfolio(externaltothebank)orofbanksthemselves(theirECforagivenreferencemodel)Capableofaddressingsimilarquestionstobenchmarking,butbydifferentmeansThetechniqueisapowerfuloneandcanbeadaptedtoanalyzemanyofthepreferredmodelpropertiessuchasrank-orderingandrelativeriskquantification经济资本模型验证方法共37页,您现在浏览的是第27页!RangeofPracticeinQuantitativeValidation:Backtesting(continued)BacktestingisusefulprincipallyformodelswhoseoutputsareaquantifiablemetricwithwhichtopareanouteHowever,someriskmeasurementsystemsinusehaveoutputscannotbeinterpretedinthiswayandcannotbebacktestedSuchriskmeasurementapproachesnotamenabletooutes-basedvalidationmightneverthelessbevaluabletoolsforbanksE.g.,ratingsystems,sensitivitytestsandaggregatedstresslosses.Theroleofbacktestingforsuchmodels,ifused,wouldneedelaborationInpractice,backtestingisnotyetakeyponentofbanks'validationpracticesforeconomiccapitalpurposes经济资本模型验证方法共37页,您现在浏览的是第28页!RangeofPracticeinValidation:AdditionalConsiderationsWehavenotmentionedinternalaudit,butvalidationoftheoverallimplementationframeworkandprocessshouldalsobesubjecttoindependentandperiodicreviewThisworkshouldbemadebypartieswithinthebankingorganizationthatareindependentofthoseaccountableforthedesignandimplementationofthevalidationprocessApossibilityisthatinternalauditwouldbeinchargeofundertakingthisreviewprocess,andassuchitcouldbeviewedasprisingapartofthemanagementoversightprocessdiscussedpreviouslyThelistofvalidationtoolsalsodoesnotaddresstheissueofadequateinternalstandardsrelevantforvalidationExamplesofsuchstandardsinclude:AdescriptionoftheissuesthatneedtobeaddressedaspartofvalidationThestandardsthatcapitalmodelsareexpectedtoachieveAseriesofquantitativethresholdsthatmodelsneedtomeetWarningindicatorsforparticularmonitoringmetricsAssessmentagainstmodeldevelopmentstandards经济资本模型验证方法共37页,您现在浏览的是第29页!SupervisoryConcernsandExpectationsintheValidationofECModels(cont.)Mainareasofimprovementseentobeinbenchmarkingofmodelparametersandtheconductofcross-firmparisonsofmodelsE.g.,IACPMandISDAstudy(2006)onportfoliocreditriskmodelsEvidencethatbanksensureECmodelsaresensitivetothe
温馨提示
- 1. 本站所有资源如无特殊说明,都需要本地电脑安装OFFICE2007和PDF阅读器。图纸软件为CAD,CAXA,PROE,UG,SolidWorks等.压缩文件请下载最新的WinRAR软件解压。
- 2. 本站的文档不包含任何第三方提供的附件图纸等,如果需要附件,请联系上传者。文件的所有权益归上传用户所有。
- 3. 本站RAR压缩包中若带图纸,网页内容里面会有图纸预览,若没有图纸预览就没有图纸。
- 4. 未经权益所有人同意不得将文件中的内容挪作商业或盈利用途。
- 5. 人人文库网仅提供信息存储空间,仅对用户上传内容的表现方式做保护处理,对用户上传分享的文档内容本身不做任何修改或编辑,并不能对任何下载内容负责。
- 6. 下载文件中如有侵权或不适当内容,请与我们联系,我们立即纠正。
- 7. 本站不保证下载资源的准确性、安全性和完整性, 同时也不承担用户因使用这些下载资源对自己和他人造成任何形式的伤害或损失。
最新文档
- 一级注册建筑师之建筑物理与建筑设备考试题库含答案(b卷)
- 2024口罩合同模板
- 2024个人向公司借款合同参考范本
- 学前教育政府助学金申请表
- 2024保密知识竞赛试题有答案解析
- 2024安全员保安服务考核题库(各地真题)
- 2024年【安全员(初级)】考试带答案
- 2024年安全员(初级)考试题库加解析答案
- 2024年安全员理论考试题库及参考答案1套
- 2024年度安全员资格考试(历年真题)
- 2023年湖南普通学业水平考试物理真题卷及答案
- 《乡土中国》 《礼治秩序》课件
- 贵州省遵义市初中毕业生地理生物会考试题之生物word
- HY/T 039-1995微孔滤膜孔性能测定方法
- 行为治疗课件
- 三只松鼠分析报告课件
- 二手车鉴定评估报告书最终版(建文)
- 充电桩检测报告模板
- 2022年WAPI十大发展回顾
- 安全生产风险辨识和管控培训讲学课件
- 使用盾棍叉处置严重暴力犯罪警情训练教案
评论
0/150
提交评论