As you begin this work you learn from your supervisor that the current academic and career maturity assessment instrument was developed in the 1980 based on dozens of studies from that time period with samples of diverse graduate students and early career professionals. Your review of the literature identifies a few recent studies that report on the score reliability and validity of the academic and career maturity assessment used at your school. One study provided score reliability (Cronbach) estimates of r_xx= .50 with a diverse high school student sample. Another study using the same assessment protocol with a diverse high school sample found that the relationship between the academic and career maturity and high school GPA was r_xy = .15, p> .06. In addition, you learn that the way in which academic and career maturity is defined (in the assessment) as being individualistic and not depending on others, being rational in making important decisions, and knowledgeable in the areas of science and math. Finally, you learn that for score interpretation purposes the institution uses norm group data from the 1980s with graduate student and early career professionals because the costs for accessing new norm group data, which is more representative, is very costly.

QUESTION

What are the concerns you have about the current assessment approach/instrument in terms of (1) score reliability, (2) score validity, and (3) normative score interpretation? Please discuss each concern in a non-technical manner and, for each concern identified, please provide at least one explanation for why it is important in a practically meaningful way. Finally, for each concern raised, please provide at least one practical recommendations for improving the assessment approach/instrument.