《计量经济学英文课件：Chapter 4 Multiple Regression Analysis Inference》由会员分享，可在线阅读，更多相关《计量经济学英文课件：Chapter 4 Multiple Regression Analysis Inference（56页珍藏版）》请在金锄头文库上搜索。
1、2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Chapter 4MultipleRegressionAnalysis:Inference2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Cha
2、pter4MultipleRegressionAnalysis:Inference4.2 Testing Hypotheses about a Single Population Parameter: The t Test4.3 Confidence Intervals4.4 Testing Hypotheses about a Single Linear Combination of the Parameters4.5 Testing Multiple Linear Restrictions: The F Test4.1 Sampling Distributions of the OLS E
3、stimators4.6 An application estimation of the weights of CPI components in ChinaAssignments: Promblems 1, 2, 4, 5, 7, 8, 10 Computer Exercises C1, C2, C3, C8, C9 C8: smplifmarr=1andfsize=2(401ksubs.wf1)The End2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapublicl
4、yaccessiblewebsite,inwholeorinpart.Statistical inference in the regression modelHypothesistestsaboutpopulationparametersConstructionofconfidenceintervalsSampling distributions of the OLS estimatorsTheOLSestimatorsarerandomvariablesWealreadyknowtheirexpectedvaluesandtheirvariancesHowever,forhypothesi
5、stestsweneedtoknowtheirdistributionInordertoderivetheirdistributionweneedadditionalassumptionsAssumptionaboutdistributionoferrors:normaldistributionChapter4MultipleRegressionAnalysis:Inference4.1 Sampling Distributions of the OLS Estimators (1/5)ChapterEnd2013CengageLearning.AllRightsReserved.Maynot
6、bescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Assumption MLR.6 (Normality of error terms)independentlyofItisassumedthattheunobservedfactorsarenormallydistributedaroundthepopulationregressionfunction.Theformandthevarianceofthedistributiondoesnotdependonanyoftheexpl
7、anatoryvariables.Itfollowsthat:Chapter4MultipleRegressionAnalysis:Inference4.1 Sampling Distributions of the OLS Estimators (2/5)ChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Discussion of the normality assumpt
8、ionTheerrortermisthesumofmany“differentunobservedfactorsSumsofindependentfactorsarenormallydistributed(CLT)Problems:Howmanydifferentfactors?Numberlargeenough?PossiblyveryheterogenuousdistributionsofindividualfactorsHowindependentarethedifferentfactors?ThenormalityoftheerrortermisanempiricalquestionA
9、tleasttheerrordistributionshouldbeclose“tonormalChapter4MultipleRegressionAnalysis:Inference4.1 Sampling Distributions of the OLS Estimators (3/5)ChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Discussion of the
10、normality assumption (cont.)Exampleswherenormalitycannothold:Wages(nonnegative;also:minimumwage)Numberofarrests(takesonasmallnumberofintegervalues)Unemployment(indicatorvariable,takesononly1or0)Insomecases,normalitycanbeachievedthroughtransformationsofthedependentvariable(e.g.uselog(wage)insteadofwa
11、ge)Important:Forthepurposesofstatisticalinference,theassumptionofnormalitycanbereplacedbyalargesamplesizeChapter4MultipleRegressionAnalysis:Inference4.1 Sampling Distributions of the OLS Estimators (4/5)ChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapub
12、liclyaccessiblewebsite,inwholeorinpart.TerminologyTheorem 4.1 (Normal sampling distributions)UnderassumptionsMLR.1MLR.6:TheestimatorsarenormallydistributedaroundthetrueparameterswiththevariancethatwasderivedearlierThestandardizedestimatorsfollowastandardnormaldistributionGauss-Markovassumptions“Clas
13、sicallinearmodel(CLM)assumptions“Chapter4MultipleRegressionAnalysis:Inference4.1 Sampling Distributions of the OLS Estimators (5/5)ChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.4.2.1 Theorem 4.2 t Distribution
14、for the Standardized EstimatorsChapter4MultipleRegressionAnalysis:Inference4.2 Testing Hypotheses about a Single Population Parameter: The t Test4.2.3 Two-Sided Alternatives4.2.4 Testing Other Hypotheses about b bj4.2.2 Testing against One-Sided Alternatives4.2.5 Computing p-Values for t Tests4.2.6
15、A Reminder on the Language of Classical Hypothesis Testing4.2.7 Economic, or Practical, versus Statistical SignificanceChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.UnderassumptionsMLR.1MLR.6:Ifthestandardizati
16、onisdoneusingtheestimatedstandarddeviation(=standarderror),thenormaldistributionisreplacedbyat-distributionNote:Thet-distributionisclosetothestandardnormaldistributionifn-k-1islarge.Chapter4MultipleRegressionAnalysis:Inference4.2.1 Theorem 4.2 t Distribution for the Standardized Estimators (1/3)Proo
17、f:SectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Null hypothesis (for more general hypotheses, see below)t-statistic (or t-ratio)Distribution of the t-statistic if the null hypothesis is trueThet-statisti
18、cwillbeusedtotesttheabovenullhypothesis.Thefarthertheestimatedcoefficientisawayfromzero,thelesslikelyitisthatthenullhypothesisholdstrue.Butwhatdoesfar“awayfromzeromean?Thisdependsonthevariabilityoftheestimatedcoefficient,i.e.itsstandarddeviation.Thet-statisticmeasureshowmanyestimatedstandarddeviatio
19、nstheestimatedcoefficientisawayfromzero.Thepopulationparameterisequaltozero,i.e.aftercontrollingfortheotherindependentvariables,thereisnoeffectofxjonyChapter4MultipleRegressionAnalysis:Inference4.2.1 Theorem 4.2 t Distribution for the Standardized Estimators (2/3)SectionChapterEnd2013CengageLearning
20、.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Goal: Define a rejection rule so that, if it is true, H0 is rejected only with a small probability (= significance level, e.g. 5%)Thepreciserejectionruledependsonthealternativehypothesisandthec
21、hosensignificancelevelofthetest.Asignificancelevel:theprobabilityofrejectingH0whenitistrue.Chapter4MultipleRegressionAnalysis:Inference4.2.1 Theorem 4.2 t Distribution for the Standardized Estimators (3/3)SectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpos
22、tedtoapubliclyaccessiblewebsite,inwholeorinpart.Testagainst.Testing against one-sided alternatives (greater than zero)4.2.2 Testing against One-Sided Alternatives (1/8)Rejectthenullhypothesisinfavourofthealternativehypothesisiftheestimatedcoefficientistoolarge“(i.e.largerthanacriticalvalue).Construc
23、tthecriticalvaluesothat,ifthenullhypothesisistrue,itisrejectedin,forexample,5%ofthecases.Inthegivenexample,thisisthepointofthet-distributionwith28degreesoffreedomthatisexceededin5%ofthecases.!Rejectift-statisticgreaterthan1.701Chapter4MultipleRegressionAnalysis:InferenceSectionChapterEnd2013CengageL
24、earning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Example: Wage equationTestwhether,aftercontrollingforeducationandtenure,higherworkexperienceleadstohigherhourlywages(1)Testagainst.Onewouldeitherexpectapositiveeffectofexperienceonhourly
25、wageornoeffectatall.Standarderrors4.2.2 Testing against One-Sided Alternatives (2/8)Chapter4MultipleRegressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Example: Wage equation (cont.
26、)Theeffectofexperienceonhourlywageisstatisticallygreaterthanzeroatthe5%(andevenatthe1%)significancelevel.“Thoughttheestimatedreturnforanotheryearofexperience,holdingtenureandeducationfixed,isnotespeciallylarge,wehavepersuasivelyshownthatthepartialeffectofexperienceispositiveinthepopulation.t-statist
27、icCriticalvaluesforthe5%andthe1%significancelevel(theseareconventionalsignificancelevels).Thenullhypothesisisrejectedbecausethet-statisticexceedsthecriticalvalue.(2)Degreesoffreedom;herethestandardnormalapproximationapplies(3)(4)4.2.2 Testing against One-Sided Alternatives (3/8)Chapter4MultipleRegre
28、ssionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Testagainst.Testing against one-sided alternatives (less than zero)Rejectthenullhypothesisinfavourofthealternativehypothesisiftheestim
29、atedcoefficientistoosmall“(i.e.smallerthanacriticalvalue).Constructthecriticalvaluesothat,ifthenullhypothesisistrue,itisrejectedin,forexample,5%ofthecases.Inthegivenexample,thisisthepointofthet-distributionwith18degreesoffreedomsothat5%ofthecasesarebelowthepoint.!Rejectift-statisticlessthan-1.7344.2
30、.2 Testing against One-Sided Alternatives (4/8)Chapter4MultipleRegressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Example: Student performance and school sizeTestwhethersmallerscho
31、olsizeleadstobetterstudentperformanceTestagainst.Dolargerschoolshamperstudentperformanceoristherenosucheffect?PercentageofstudentspassingmathstestAverageannualtea-chercompensationSchoolenrollment(=schoolsize)Staffperonethousandstudents4.2.2 Testing against One-Sided Alternatives (5/8)Chapter4Multipl
32、eRegressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Example: Student performance and school size (cont.)Onecannotrejectthehypothesisthatthereisnoeffectofschoolsizeonstudentperforma
33、nce(notevenforalaxsignificancelevelof15%).t-statisticCriticalvaluesforthe5%andthe15%significancelevel.Thenullhypothesisisnotrejectedbecausethet-statisticisnotsmallerthanthecriticalvalue.Degreesoffreedom;herethestandardnormalapproximationapplies4.2.2 Testing against One-Sided Alternatives (6/8)Chapte
34、r4MultipleRegressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Example: Student performance and school size (cont.)Alternativespecificationoffunctionalform:Testagainst.R-squaredsligh
35、tlyhigher4.2.2 Testing against One-Sided Alternatives (7/8)Chapter4MultipleRegressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Example: Student performance and school size (cont.)Th
36、ehypothesisthatthereisnoeffectofschoolsizeonstudentperformancecanberejectedinfavorofthehypothesisthattheeffectisnegative.t-statisticCriticalvalueforthe5%significancelevel!rejectnullhypothesisHowlargeistheeffect?(smalleffect)+10%enrollment!-0.129percentagepointsstudentspasstest4.2.2 Testing against O
37、ne-Sided Alternatives (8/8)Chapter4MultipleRegressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Testing against two-sided alternativesTestagainst.Rejectthenullhypothesisinfavourofthe
38、alternativehypothesisiftheabsolutevalueoftheestimatedcoefficientistoolarge.Constructthecriticalvaluesothat,ifthenullhypothesisistrue,itisrejectedin,forexample,5%ofthecases.Inthegivenexample,thesearethepointsofthet-distributionsothat5%ofthecaseslieinthetwotails.!Rejectifabsolutevalueoft-statisticisle
39、ssthan-2.06orgreaterthan2.064.2.3 Two-Sided Alternatives (1/3)Chapter4MultipleRegressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Example: Determinants of college GPALecturesmissedp
40、erweekTheeffectsofhsGPAandskippedaresignificantlydifferentfromzeroatthe1%significancelevel.TheeffectofACTisnotsignificantlydifferentfromzero,notevenatthe10%significancelevel.Forcriticalvalues,usestandardnormaldistribution4.2.3 Two-Sided Alternatives (2/3)Chapter4MultipleRegressionAnalysis:InferenceS
41、ectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Statistically significant“ variables in a regressionIfaregressioncoefficientisdifferentfromzeroinatwo-sidedtest,thecorrespondingvariableissaidtobestatisticall
42、ysignificant“Ifthenumberofdegreesoffreedomislargeenoughsothatthenormalapproximationapplies,thefollowingrulesofthumbapply:statisticallysignificantat10%level“statisticallysignificantat5%level“statisticallysignificantat1%level“4.2.3 Two-Sided Alternatives (3/3)Chapter4MultipleRegressionAnalysis:Inferen
43、ceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Testing more general hypotheses about a regression coefficientNull hypothesist-statisticThe test works exactly as before, except that the hypothesized valu
44、e is substracted from the estimate when forming the statisticHypothesizedvalueofthecoefficient4.2.4 Testing Other Hypotheses about b bj (1/3)Chapter4MultipleRegressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccess
45、iblewebsite,inwholeorinpart.Example: Campus crime and enrollmentAninterestinghypothesisiswhethercrimeincreasesbyonepercentifenrollmentisincreasedbyonepercentThehypothesisisrejectedatthe5%levelEstimateisdifferentfromonebutisthisdifferencestatisticallysignificant?4.2.4 Testing Other Hypotheses about b
46、 bj (2/3)Chapter4MultipleRegressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.4.2.4 Testing Other Hypotheses about b bj (3/3)Chapter4MultipleRegressionAnalysis:InferenceSectionChapte
47、rEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.4.2.5 Computing p-Values for t Tests (1/2)Computing p-values for t-testsIfthesignificancelevelismadesmallerandsmaller,therewillbeapointwherethenullhypothesiscannotberejec
48、tedanymoreThereasonisthat,byloweringthesignificancelevel,onewantstoavoidmoreandmoretomaketheerrorofrejectingacorrectH0Thesmallestsignificancelevelatwhichthenullhypothesisisstillrejected,iscalledthep-valueofthehypothesistestAsmallp-valueisevidenceagainstthenullhypothesisbecauseonewouldrejectthenullhy
49、pothesisevenatsmallsignificancelevelsAlargep-valueisevidenceinfavorofthenullhypothesisP-valuesaremoreinformativethantestsatfixedsignificancelevelsChapter4MultipleRegressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclya
50、ccessiblewebsite,inwholeorinpart.How the p-value is computed (here: two-sided test)Thep-valueisthesignificancelevelatwhichoneisindifferentbetweenrejectingandnotrejectingthenullhypothesis.Inthetwo-sidedcase,thep-valueisthustheprobabilitythatthet-distributedvariabletakesonalargerabsolutevaluethanthere
51、alizedvalueoftheteststatistic,e.g.:Fromthis,itisclearthatanullhypothesisisrejectedifandonlyifthecorrespondingp-valueissmallerthanthesignificancelevel.Forexample,forasignificancelevelof5%thet-statisticwouldnotlieintherejectionregion.valueofteststatisticThesewouldbethecriticalvaluesfora5%significancel
52、evel4.2.5 Computing p-Values for t Tests (2/2)Chapter4MultipleRegressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.4.2.6 A Reminder on the Language of Classical Hypothesis TestingExa
53、mple 4.5 Housing Prices and Air PollutionWedonotwanttotestthatbnox=0.Instead,H0:bnox=-1t=(-.954+1)/.117=.393Thereislittleevidencethattheelasticityisdifferentfrom-1.wefailtorejectH0atthex%level.H0isacceptedatthex%level.H0:bnox=-.9t=(-.954+.9)/.117=-.462Chapter4MultipleRegressionAnalysis:InferenceSect
54、ionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.4.2.7 Economic, or Practical, versus Statistical Significance (1/2)economicsignificance:statisticalsignificance:Example 4.6 Participation Rates in 401(k) Plans C
55、onsiderbtotemp.Example 4.7 Effect of Job Training on Firm Scrap Rates Considerbhrsemp.Someresearchersinsistonusingsmallersignificancelevelsasthesamplesizeincreases.Mostresearchersarealsowillingtoentertainlargersignificancelevelsinapplicationswithsmallsamplesizes.Chapter4MultipleRegressionAnalysis:In
56、ferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Guidelines:Ifthevariableisstatisticallysignificantattheusuallevels,discussthemagnitudeofthecoefficienttogetanideaofitseconomicimportance.Thefactthatac
57、oefficientisstatisticallysignificantdoesnotnecessarilymeanitiseconomicallyorpracticallysignificant!Ifavariableisstatisticallyandeconomicallyimportantbuthasthewrong“sign,theregressionmodelmightbemisspecified.Ifavariableisstatisticallyinsignificantattheusuallevels(10%,5%,1%),onemaythinkofdroppingitfro
58、mtheregression.Ifthesamplesizeissmall,effectsmightbeimpreciselyestimatedsothatthecasefordroppinginsignificantvariablesislessstrong.variableswithsmalltstatisticsthathavethe“wrong”sign.(multicollinearity)4.2.7 Economic, or Practical, versus Statistical Significance (2/2)Chapter4MultipleRegressionAnaly
59、sis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Criticalvalueoftwo-sidedtestConfidence intervalsSimple manipulation of the result in Theorem 4.2 implies thatInterpretation of the confidence in
60、tervalTheboundsoftheintervalarerandomInrepeatedsamples,theintervalthatisconstructedintheabovewaywillcoverthepopulationregressioncoefficientin95%ofthecasesLowerboundoftheConfidenceintervalUpperboundoftheConfidenceintervalConfidencelevelChapter4MultipleRegressionAnalysis:Inference4.3 Confidence Interv
61、als (1/3)ChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Confidence intervals for typical confidence levelsRelationship between confidence intervals and hypotheses testsrejectinfavorofUserulesofthumbChapter4Multi
62、pleRegressionAnalysis:Inference4.3 Confidence Intervals (2/3)ChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Example: Model of firms R&D expendituresSpendingonR&DAnnualsalesProfitsaspercentageofsalesTheeffectofsa
63、lesonR&Disrelativelypreciselyestimatedastheintervalisnarrow.Moreover,theeffectissignificantlydifferentfromzerobecausezeroisoutsidetheinterval.Thiseffectisimpreciselyestimatedasthein-tervalisverywide.Itisnotevenstatisticallysignificantbecausezeroliesintheinterval.Chapter4MultipleRegressionAnalysis:In
64、ference4.3 Confidence Intervals (3/3)ChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Testing hypotheses about a linear combination of parametersExample: Return to education at 2 year vs. at 4 year collegesYearsof
65、educationat2yearcollegesYearsofeducationat4yearcollegesTestagainst.Apossibleteststatisticwouldbe:Thedifferencebetweentheestimatesisnormalizedbytheestimatedstandarddeviationofthedifference.Thenullhypothesiswouldhavetoberejectedifthestatisticistoonegative“tobelievethatthetruedifferencebetweentheparame
66、tersisequaltozero.4.4 Testing Hypotheses about a Single Linear Combination of the Parameters (1/4)Chapter4MultipleRegressionAnalysis:InferenceChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Insertintooriginalregr
67、essionImpossible to compute with standard regression output becauseAlternative methodUsuallynotavailableinregressionoutputDefineandtestagainst.anewregressor(=totalyearsofcollege)4.4 Testing Hypotheses about a Single Linear Combination of the Parameters (2/4)Chapter4MultipleRegressionAnalysis:Inferen
68、ceChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Estimation resultsThis method works always for single linear hypothesesTotalyearsofcollegeHypothesisisrejectedat10%levelbutnotat5%level4.4 Testing Hypotheses abou
69、t a Single Linear Combination of the Parameters (3/4)Chapter4MultipleRegressionAnalysis:InferenceChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.twoyear.wf1lslwagecjcjc+univexperseriestotcoll=jc+univlslwagecjctot
70、collexper4.4 Testing Hypotheses about a Single Linear Combination of the Parameters (4/4)Chapter4MultipleRegressionAnalysis:InferenceChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.4.5 Testing Multiple Linear Res
71、trictions: The F Test4.5.2 Relationship between F and t Statistics4.5.3 The R-Squared Form of the F Statistic4.5.1 Testing Exclusion Restrictions4.5.4 Computing p-Values for F Tests4.5.5 The F Statistic for Overall Significance of a Regression4.5.6 Testing General Linear RestrictionsChapter4Multiple
72、RegressionAnalysis:InferenceChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Testing multiple linear restrictions: The F-testTesting exclusion restrictions YearsintheleagueAveragenumberofgamesperyearSalaryofmajorl
73、ea-guebaseballplayerBattingaverageHomerunsperyearRunsbattedinperyearagainstTestwhetherperformancemeasureshavenoeffect/canbeexludedfromregression.4.5.1 Testing Exclusion Restrictions (1/5)Chapter4MultipleRegressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanne
74、d,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Estimation of the unrestricted model (mlb1.wf1)lslog(salary)cyearsgamesyrbavghrunsyrrbisyrNoneofthesevariabelsisstatisticallysignificantwhentestedindividuallyIdea:Howwouldthemodelfitbeifthesevariablesweredroppedfromtheregressi
75、on?4.5.1 Testing Exclusion Restrictions (2/5)Chapter4MultipleRegressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Estimation of the restricted modelTest statisticThesumofsquaredresid
76、ualsnecessarilyincreases,butistheincreasestatisticallysignificant?NumberofrestrictionsTherelativeincreaseofthesumofsquaredresidualswhengoingfromH1toH0followsaF-distribution(ifthenullhypothesisH0iscorrect)4.5.1 Testing Exclusion Restrictions (3/5)Chapter4MultipleRegressionAnalysis:InferenceSectionCha
77、pterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Rejection rule (Figure 4.7)AF-distributedvariableonlytakesonpositivevalues.ThiscorrespondstothefactthatthesumofsquaredresidualscanonlyincreaseifonemovesfromH1toH0.Choo
78、sethecriticalvaluesothatthenullhypo-thesisisrejectedin,forexample,5%ofthecases,althoughitistrue.4.5.1 Testing Exclusion Restrictions (4/5)Chapter4MultipleRegressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessibl
79、ewebsite,inwholeorinpart.Test decision in exampleDiscussionThethreevariablesarejointlysignificant“TheywerenotsignificantwhentestedindividuallyThelikelyreasonismulticollinearitybetweenthemNumberofrestrictionstobetestedDegreesoffreedomintheunrestrictedmodelThenullhypothesisisoverwhel-minglyrejected(ev
80、enatverysmallsignificancelevels).mlb1.wf1PerformanceinEviews.4.5.1 Testing Exclusion Restrictions (5/5)Chapter4MultipleRegressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.4.5.2 Rela
81、tionship between F and t StatisticsTheFstatisticfortestingexclusionofasinglevariableisequaltothesquareofthecorrespondingtstatistic,whosealternativeistwo-sided.Itispossiblethat,inagroupofseveralexplanatoryvariables,onevariablehasasignificanttstatistic,butthegroupofvariablesisjointlyinsignificantatthe
82、usualsignificancelevels.Often,whenavariableisverystatisticallysignificantanditistestedjointlywithanothersetofvariables,thesetwillbejointlysignificant.Chapter4MultipleRegressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubli
83、clyaccessiblewebsite,inwholeorinpart.4.5.3 The R-Squared Form of the F StatisticChapter4MultipleRegressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.4.5.4 Computing p-Values for F Te
84、stsThep-valueistheprobabilityofobservingavalueofFatleastaslargeaswedid,giventhatthenullhypothesisistrue.Chapter4MultipleRegressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Test of o
85、verall significance of a regressionThe test of overall significance is reported in most regression packages; the null hypothesis is usually overwhelmingly rejectedThenullhypothesisstatesthattheexplanatoryvariablesarenotusefulatallinexplainingthedependentvariable4.5.5 The F Statistic for Overall Sign
86、ificance of a Regression (1/2)Restrictedmodel(regressiononconstant)Chapter4MultipleRegressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.EndSectionChapterExample 4.9 ParentsEducationi
87、naBirthWeightEquation(bwght.wf1)lsbwghtccigsparityfamincmotheducfatheducDependentVariable:BWGHTIncludedobservations:1191VariableCoefficientStd.Errort-StatisticProb.C114.523.72830.7160.0000CIGS-0.5960.110-5.4010.0000PARITY1.7880.6592.7110.0068FAMINC0.0560.0371.5330.1256MOTHEDUC-0.3700.320-1.1580.2470
88、FATHEDUC0.4720.2831.6710.0949R-squared0.038748Meandependentvar119.5298AdjustedR-squared0.034692S.D.dependentvar20.14124F-statistic9.553500Durbin-Watsonstat1.911657Prob(F-statistic)0.0000004.5.5 The F Statistic for Overall Significance of a Regression (2/2)Chapter4MultipleRegressionAnalysis:Inference
89、2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Testing general linear restrictions with the F-testExample: Test whether house price assessments are rationalTheassessedhousingvalue(beforethehousewassold)Sizeoflot(infeet)Ac
90、tualhousepriceSquarefootageNumberofbedroomsIfhousepriceassessmentsarerational,a1%changeintheassessmentshouldbeassociatedwitha1%changeinprice.4.5.6 Testing General Linear Restrictions (1/4)Inaddition,otherknownfactorsshouldnotinfluencethepriceoncetheassessedvaluehasbeencontrolledfor.Chapter4MultipleR
91、egressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Unrestricted regressionRestricted regressionTest statisticcannotberejected4.5.6 Testing General Linear Restrictions (2/4)Chapter4M
92、ultipleRegressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Performance in Eviews.hprice1.wf1lslog(price)clog(assess)log(lotsize)log(sqrft)log(bdrms)c(2)=1,c(3)=0,c(4)=0,c(5)=04.5.6
93、Testing General Linear Restrictions (3/4)Chapter4MultipleRegressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Regression output for the unrestricted regressionThe F-test works for ge
94、neral multiple linear hypothesesFor all tests and confidence intervals, validity of assumptions MLR.1 MLR.6 has been assumed. Tests may be invalid otherwise.Whentestedindividually,thereisalsonoevidenceagainsttherationalityofhousepriceassessments4.5.6 Testing General Linear Restrictions (4/4)Chapter4
95、MultipleRegressionAnalysis:InferenceSectionChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.4.6 An application- estimation of the weights of CPI components in China (1/2)Unrestricted model:cpi=w0+w1*food+w2*daily+
96、w3*cloth+w4*equit+w5*health+w6*trans+w7*entertain+w8*dwell+uH0:w0=0,w1+w2+w3+w4+w5+w6+w7+w8=1Restricted model:cpi-food=w2*(daily-food)+w3*(cloth-food)+w4*(equit-food)+w5*(health-food)+w6*(trans-food)+w7*(entertain-food)+w8*(dwell-food)+ucpi-weight.wf1smpl2003m12005m12lscpicfooddailyclothequithealtht
97、ransentertaindwelllscpi-fooddaily-foodcloth-foodequit-foodhealth-foodtrans-foodentertain-fooddwell-foodChapter4MultipleRegressionAnalysis:InferenceChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.SSRur=0.0358SSRr=
98、0.0372Operate the test in Eviews:Regresstheunrestrictedmodel.IntheEquationwindow,View/CoefficientTests/Wald-CoefficientRestrictionsc(1)=0,c(2)+c(3)+c(4)+c(5)+c(6)+c(7)+c(8)+c(9)=14.6 An application- estimation of the weights of CPI components in China (2/2)Chapter4MultipleRegressionAnalysis:Inferenc
99、eChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.C8401ksubs.wf1smplifmarr=1andfsize=24.6 An application- estimation of the weights of CPI components in China (2/2)Chapter4MultipleRegressionAnalysis:InferenceChapterEnd2013CengageLearning.AllRightsReserved.Maynotbescanned,copiedorduplicated,orpostedtoapubliclyaccessiblewebsite,inwholeorinpart.Chapter4MultipleRegressionAnalysis:InferenceChapter
