Show simple item record

dc.contributor.advisorArthur, Jr., Winfreden_US
dc.creatorArchuleta, Kathrynen_US
dc.date.accessioned2010-07-15T00:12:47Zen_US
dc.date.accessioned2010-07-23T21:44:11Z
dc.date.available2010-07-15T00:12:47Zen_US
dc.date.available2010-07-23T21:44:11Z
dc.date.created2009-05en_US
dc.date.issued2010-07-14en_US
dc.date.submittedMay 2009en_US
dc.identifier.urihttp://hdl.handle.net/1969.1/ETD-TAMU-2009-05-579en_US
dc.description.abstractMuch research has been conducted on the topic of the construct-related validity of assessment centers, however a definitive conclusion has yet to be drawn. The central question of this debate is whether assessment centers are measuring the dimensions they are designed to measure. The present study attempted to provide more evidence toward the improvement of construct-related validity. The first hypothesis involved determining whether opportunity to observe and opportunity to behave influenced discriminant and convergent validity. The second hypothesis addressed the debate over evaluation method and examined which method, within-exercise or within-dimension, yielded more favorable internal construct-related validity evidence. The third hypothesis explored the call for exercise scoring in assessment centers and compared the criterion-related validity of exercise versus dimension scores within the same assessment center. Finally, the fourth objective looked at the relationship of the stability of the dimensions with internal construct-related validity, specifically convergent validity evidence. A developmental assessment center used in two applied settings supplied the data. Two administrations of the assessment center were conducted for low to mid-level managers in a state agency (N = 31). Five administrations were conducted in a professional graduate school of public administration that prepares students for leadership and managerial positions in government and public service (N = 108). The seven administrations yielded a total sample size of 139 participants. Analysis of multi-trait-multi-method (MTMM) matrices revealed that, as hypothesized, a lack of opportunity to behave within exercises, operationalized using behavior counts, yielded poor discriminant validity. Assessor ratings of opportunity to observe and behave did not produce hypothesized results. Consistent with the second hypothesis, secondary assessors, who represented the within-dimension evaluation method, provided ratings that demonstrated better construct-related validity evidence than the ratings provided by primary assessors, who represented the within-exercise method. Correlation and regression analyses of the dimension/performance relationships and the exercise/performance relationships revealed neither dimensions nor exercises to be the better predictor of supervisor ratings of performance. Using MTMM, partial support was found for the fourth objective: those dimensions that were more stable across exercises yielded better convergent validity evidence versus those dimensions that were more situationally specific. However the differences were not statistically significant or large. Overall results of this study suggest that there are some areas of design and implementation that can affect the construct-related validity of assessment centers, and researchers should continue to search for ways to improve assessment center construct-related validity, but should also look for ways other than MTMM to assess validity.en_US
dc.format.mimetypeapplication/pdfen_US
dc.language.isoengen_US
dc.subjectassessment centeren_US
dc.subjectconstruct validityen_US
dc.subjectevaluation methoden_US
dc.subjectopportunity to behaveen_US
dc.subjectpersonalityen_US
dc.titleEvidence of Construct-Related Validity for Assessment Centers: More Pieces of the Inferential Pieen_US
dc.typeBooken
dc.typeThesisen
thesis.degree.departmentPsychologyen_US
thesis.degree.disciplinePsychologyen_US
thesis.degree.grantorTexas A&M Universityen_US
thesis.degree.nameDoctor of Philosophyen_US
thesis.degree.levelDoctoralen_US
dc.contributor.committeeMemberBergman, Mindyen_US
dc.contributor.committeeMemberMartin, David J.en_US
dc.contributor.committeeMemberPayne, Stephanieen_US
dc.type.genreElectronic Dissertationen_US
dc.type.materialtexten_US


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record