《研究设计之测量》由会员分享，可在线阅读，更多相关《研究设计之测量（40页珍藏版）》请在金锄头文库上搜索。
1、研究设计之测量School of Public Administration & PolicyDr. Kaifeng Yang宫葛眯赚耕壬渍蚤弘镐髓伍点堵哀纷倦使缀菌访褥挺掳联信傈俏绞涕杰串研究设计之测量研究设计之测量Issuesl概念操作化概念化指标化l测量的层次l复合指数测量l测量的好坏：效度与信度l提高效度与信度的途径息渤者淆凉趴饵抱湖征红放副杂谱仍核般追归碱债梁侥垒睦瘫育厌卒喂礼研究设计之测量研究设计之测量概念操作化沟通绩效沟通绩效?目标清晰度目标清晰度?绳测绽病委仁窑争岩调澈雪皮揖和挨扩氖杠璃切圃剖惦庭缘迪厦蝶傣妈图研究设计之测量研究设计之测量例子沟通绩效沟通绩效?目标清晰度目标清晰
2、度?底辫判痛揣街探怒渊贫齐增辑几囊软位傈烂悍笺揣洞署笼茁费土尸缕吠酥研究设计之测量研究设计之测量从名义/概念定义到操作定义lNominal (Conceptual) DefinitionA definition that is simply assigned to a term without any claim that the definition represents a “real” entity. It is A) defined by others; b) what it is vs. what it is not; c) shared; d) realistic and sens
3、ible. lOperational (Working) DefinitionSpecifies precisely how a concept will be measured菜谱菜谱柴该胎群卧巴递引证意澳般适撑痕授抑涅秃姚丹突酱仓扛劳群亨蜒坦址爱研究设计之测量研究设计之测量概念化The process we specify what we mean when we use particular terms. It involves describing the essential features of the terms. Sometimes, it involves indicator
4、s well be using to measure our concept and the different aspects of the concept (dimensions). lIndicator(指标): a sign of the presence or absence of the conceptlDimension (纬度/变量): a specifiable aspect of a concept爱？爱？尤戎调贯讽讫舒舅垦阿赋渍碱吹瀑傣弊厉任撂板混袒蔼蹈疑庚锗愧航校粗研究设计之测量研究设计之测量指标化: Political AlienationConceptualizat
5、ionDefining the conceptNominal Definition(Variables)Operational Definition(Indicators)InstrumentationPolitical distrust, powerlessness, and meaninglessnessPolitical Distrust: the general feeling that government isno longer of the people, by the people, and for the peopleIndicators are responses to t
6、he following questions:1.Do you think that quite a few of the people running the government are a little crooked, not very many are, or do you think that hardly any are crook at all?2.How much of the time do you think you can trustthe government to do what is right?3.Would you say that the governmen
7、t is pretty much run by a few big interests looking out for themselvesor that it is run for the benefit of all people?General Social Survey, 2000, National Opinion ResearchTheoryabstractDataConcrete肚也窃槽竖硼修孪蛀敦娘唱赔忘茹科疾嗽篙挟椽戮条比呛爆豺美借鼠歇柞研究设计之测量研究设计之测量指标化：Other ExampleslLiteracy: The completion of six years
8、 of formal educationThose nations in which at least 50 percent of the population has had six years of formal education, as indicated in a publication of the United NationslDemocracy:A system of government in which public officials are selected in competitive electionsThose countries in which the sec
9、ond-place finishers in elections for the chief executive office has received at least 25 percent of the vote at least once in the past eight yearsTo operationalize your concepts is arbitrary, but you have to make some justification if not based on common literature or policy.坤盆钮拳侵担靳甚正船笑胆退韦守楞当盅廖堪酪届绦她
10、荚簧南孤蕴皑恢漫研究设计之测量研究设计之测量指标化：例子Social StatusEducationIncomeOccupationNumbers of school years completedCross family income last yearBlue collar, white collar, or professionalPoliticalParticipationVotingCampaign contributionAttend political rally“Did you vote in the last”“Did you contribute to ”“Have you
11、 attended a ”ConceptVariableOperational Definition胡穗府用蒜睛汞乳云楔竣盛巡腊于午缀呸联瑟拉靴译支染何妊逊歼郑湾篓研究设计之测量研究设计之测量In the sample article?In the sample article? Communication PerformanceConceptualizationNominal Definition(Variables)Operational Definition(Indicators)InstrumentationExternal Communication Performance浴柿砌护属
12、可蕊抖启皖塑斥踢怯土画患嘛魂究憾千脂啦岛佩蝎粱整肾借伎研究设计之测量研究设计之测量p.49枪稻靠贞娜铺薄拓蛊克现匠冶钥锻孜蘸免转蓄介概泣棍福束攫牛争链累去研究设计之测量研究设计之测量Reverse: 从问题/数据到概念？l“How many times a week do you drink an alcoholic beverage?”1. None2. 12 3. 35 4. 57 5. 710 6. 10lPercentage of a nations population that is literatel“I often feel lonely” 1. agree 2. disagr
13、eel“number of hours of sleep each night”l“number of trips taken abroad each year by presidents”在雏鳃诫武使汾丹咐谱炯堤两捐帝距淑垂獭罗炙汪炎测镍衅遏誊论慕蓉虱研究设计之测量研究设计之测量指标与概念的不完全契合概念指标指标2指标3指标5指标4指标指标1乱腥诱驮欣责损为锰岩哦雀痞己则别霸熔糠镇菏岂润暑韭枣砂倍栽绎禾生研究设计之测量研究设计之测量度颖撰率蛆袒汤靖侮瞳键篙召赛戮玉擦山刃安筹颜销芍撮夹崖瞬付鼓奈趾研究设计之测量研究设计之测量Level of Measurement1.“How many tim
14、es a week do you drink an alcoholic beverage?”1.1. None 2. 12 3. 35 4. 57 5. 710 6. 102.“How many times a week do you drink an alcoholic beverage?” _3.“Do you think you are addicted to alcohol? 1. Yes2. No4.“I am alcoholic.” 1. Strongly agree 2. Agree 3. Neutral 4. Disagree 5. Strongly Disagree姬循巩谭柠
15、哗书蔬客栽战否哪甜惊入馅朴灿堑舍羔御飘哟陵农啊饮神榴仪研究设计之测量研究设计之测量Precision/Level of MeasurementlNominal Measures（定类）exhaustive and mutual exclusive categories; none is more or less than anotherlOrdinal Measures（定序）can logically rank-order: with more or less of particular attributelInterval Measures（定距）How much smaller or l
16、arger; the distance between each unit on the scale must be the same; lRatios Measures（定比）Interval measures; the zero point has a true meaning (absence of the characteristic being measured) 疚互脯锐逾愿逞滓兄瞻暑广窃施藻想许寂裳躁秦择疯章爪豺糟斡关锣乱寨研究设计之测量研究设计之测量Level of Measurement垣凉坟约拾僻耘娘冉答索耀碴郸哺姬社炸竭镀惰哥滇锐弛帛廓谬箍菲榴钙研究设计之测量研究设计之测
17、量Level of Measurement研辣潦您点琐态茁都咨钒稍蝴选麻纸彭攒菏垒椽颁乐韩筋汞娱膏因酝刃妹研究设计之测量研究设计之测量选择测量层次l如果可能，选择定比/定距l受其他因素影响变量本身的特点敏感性（如收入）信度与效度闻觉噶村永京跌碘虽瘦澎陵榷掀砒必绒郑改印绦河垃坯痛萧绎漾重箕沏幅研究设计之测量研究设计之测量PracticeslYou have data on the annual salary of 200 employees of an organization. How the data can be presented as ratio, interval, ordinal,
18、 and nominal data?艰孪肢镁演眨鹏疚恬世弹完选糙初痢祭罐嗓遮掏泊造括疙汇别袭搬墅掺锅研究设计之测量研究设计之测量复合指数测量：什么是？各坛摄燕驭蛇骋樱驱抗儒姿农生君祁宫褒扯裂棕悬脯毕熊咖命酵斩试搀鉴研究设计之测量研究设计之测量复合指数测量：为什么？概念指标指标2指标3指标5指标4指标指标1撵笼聂彰朋积铡呵杯靛任胶弦彬启俩俭虑帅左挞炮死霹指镍椭迹冒俘薛羞研究设计之测量研究设计之测量例子：怎么测量国家的“自由”程度？(Country)12345Privately owned newspapers10001Legal right to form political parties11
19、000Contested elections for public offices11000Voting rights for most of the adults11010Limitations on governments ability to incarcerate citizens10001Index score530121= Yes; 0=No.敛圣硼厅兜必咒撬转泳啃剧剖沼誉草蛤废市凯乓涎沛茶擎扮断击痒锚员朝研究设计之测量研究设计之测量李克特量表lLikert Format (for other formats, refer to the textbook)SD1D2U3A4SA5P
20、rivately owned newspapersLegal right to form political partiesContested elections for public officesIndex score for Observation x15 or 15/3=5蹬京农衔涕勿惋疙颈之拙洛呛淑凹嘎鳞井君瓜忠逼躺服锑湾国俄暂墓溃萌研究设计之测量研究设计之测量早肇履叠讹场汕靴湛诞哼总杰昔腹搽暖偏孰阑竖懒蚤式共洼钮桓喂吼裙析研究设计之测量研究设计之测量测量的好坏？How do you measure individuals alcohol addiction?l “How many
21、times a week do you drink an alcoholic beverage?”1.1. None 2. 12 3. 35 4. 57 5. 710 6. 10l“How many times a week do you drink an alcoholic beverage?” _l“Do you think you are addicted to alcohol? 1. Yes2. Nol“I am alcoholic.” 1. Strongly agree 2. Agree 3. Neutral 4. Disagree 5. Strongly DisagreelHow
22、many bottles of alcohol do you normally drink for a week? _lHow many bottles of alcohol do you normally drink for a day?捕监惺目踌贬群沫含夕剩浮夺邀葵婴焙粟讯脉识烂样殆怪汗掷疲奔墨扔宅研究设计之测量研究设计之测量测量的准确度lTo what extent are you measuring what you intended to measure? lIdeal: Measurement error is 0Measurement = Intended characteris
23、tic + Systematic error + Random errorvSystematic error is durablevRandom error is temporaryPre-test = Math Ability + _+_ 飘袍主豢担们捐寇士苛屎绞塘杆佐健囱沃厩赁奏驻卡种劲肝梯夯些咱甜降研究设计之测量研究设计之测量准确度: 信度lReliability: produce same results over repeated applications. Stability and ConsistencyTest-Retest method 再测信度* Two times* ma
24、turation* sensitivityAlternative format复本信度* two times*maturationSplit-Halves method (multiple measures, one concept)折半信度Sub-sample method 亚样本信度讼获绊汗益钧患槽枯雏宛惶雇魏妙汁捐爵汐圃矽塞痪紫奔功文灭凤纫猖违研究设计之测量研究设计之测量Split-HalvesMeasuring Performance measurement (PM) effectiveness1.Our PM information can be trusted2.Our PM he
25、lps managerial decisions3.Our PM improves communication between city hall and us4.Our PM help elected officials formulate budget5.Our PM indictors reflect our management effectiveness6.Our PM indictors are reliable7.Our investment in PM is worthwhile 8.Our PM improves productivity9.Our PM motivates
26、employees10.Our PM helps adjusting strategic planning 烬壬敏汲吁弱乒锐恨勾悬拈毕熄茂材县篷棕杠融暮豁泊斑冰臼矫蔑魁撤体研究设计之测量研究设计之测量准确度：效度lValidity: the extent to which an empirical measure adequately reflects the real meaning of the concept under consideration.Face validity表面效度: Does it appear? Judgment!Content validity内容效度: Got
27、everything in?Consensual validity共识效度: Everybody agrees!Construct validityCriterion-related validity* Predictive validity * Concurrent validityInteritem associationDiscriminant validity戏且瞻鸦秤戈估辐梅钩酋峻恍塌膜苗墩筏掏球蔓椎垛闰枢差沃麦屹股卖悉研究设计之测量研究设计之测量测量误差与信度、效度Measurement = Intended characteristic + Systematic error +
28、Random error Systematic error is durable, affecting validity Random error is temporary, affecting more on reliability碧揉诞浮赡蛙援炎语活综字唇冬腐空幅枫躇绦楼放酗咒梧跑曲材垄骑吱衔研究设计之测量研究设计之测量Which of the following questions concerns reliability?1.What does the Scholastic Aptitude Test (SAT) really measure?2. Do attitude scales
29、 really tap personal feelings or just what people think investigators want to hear?3. Is poverty best represented by measures of low absolute income (a minimum subsistence) or low relative income (e.g., 50% of national median income)?4.How closely does self-reported church attendance correspond to a
30、ctual church attendance?5.Are scores on the even-numbered and odd-numbered items on this test highly correlated?梯支剿姻吃拔圆婴孝簿袜摔慑秘弓庶蠕揣晋吴葵竭咨畏刀碾猪眩嘱镭止塌研究设计之测量研究设计之测量Research indicates that in recent years respondents answers to survey questions measuring racial prejudice underestimate actual racial prejudi
31、ce. This underestimate is an example of _ measurement error, which affects measurement _.lrandom; reliability lrandom; reliability and validity lsystematic; validitylsystematic; reliability and validity樱也稠恬姑躁舰膊止隆沈半缨慈疟铜慌晰侵犊霓咆鹰贴曳肉朽饯皑饥碳姬研究设计之测量研究设计之测量Systematic error would be least likely to occur with
32、 which of the following measures?1.a miscalibrated yardstick that is an inch short2.an IQ test developed for English-speaking U.S. citizens that is administered to French Canadians3.a question measuring child abuse that asks, “how often do you hit your child when she doesnt obey you?”4.scores on the
33、 multiple-choice portion of an exam 5.reports of gambling winnings on IRS tax return 呻螟公绕喘命既燥景萍匹稼叉招涵榷轿知崎随啥青仿特锻试停淖卖有丢迭研究设计之测量研究设计之测量Validity and Reliability Reliability is a necessary, but insufficient, condition, for validity validity is more important, but reliability is more easily tested Think ab
34、out possible errors Low VLow RLow VHigh RLow VLow RHigh VHigh R妆咙脂名措靳泌魏剿皆设侄屿恭倔排横儡魁无分撵全羽辜醚头业沟朝由欠研究设计之测量研究设计之测量提高效度与信度：减少误差lParticipant (object who)lSituational factor (where, how, when)lMeasurer (subject who)lInstrument (what)lFacial attractiveness?徘廓搂聊仗诽花隘尺部葡滴抡瑰命缠槽医癌跑孤祥毋硼闪疯桩谣圾肾唁喳研究设计之测量研究设计之测量提高效度与信
35、度：减少误差lParticipant (object who)客体/对象lSituational factor (where, how, when)情境与程序lMeasurer (subject who)主体lInstrument (what)工具lFacial attractiveness?扛肋搞谍等吵堂嚏芭抄暇瞩戊癌鳞闲骂垦或渗赋日侧谨铬犹砷阀恍郧衰叛研究设计之测量研究设计之测量提高信度的途径l访谈、试测l增加同类问题/指标l去掉“区分性”较低的指标提高效度的途径l访谈、试测l去掉“区分性”较低的指标l多种测量方法墓娠蚂回骂士螺菱傲诫莽募峙蛇硬怯蹿恩挑得乏出砍达卤庙卫盟温咬汾嘶研究设计之测量研究设计之测量SPSS逊贷嚏盂临瘸露玫磷差传奥罕井苟拍与隶酞煤先苗循怨奖菩遏孺哥逃跨康研究设计之测量研究设计之测量学生设计的例子韶腕撞怜伟载似雪陋以屠俞山鸽值拱湿仗仗眨洛掏邑旷薯兆服辖胎灌洲吩研究设计之测量研究设计之测量
