Project 4: Measurement

The purpose of this exercise is to introduce you to the calculations needed to estimate reliability and validity, and to the decisions that must be made when combing predictors into a "model" that can be used to make hiring decisions. Your goal is to maximize validity and keep the total "seat time" around 1 hour.

The predictors include:

• Conscientiousness (times 1 and 2) - seat time = 10 minutes
• Cognitive Ability - seat time = 30 minutes
• Hiring Manager Interview - seat time = 30 minutes
• HR Manager Interview - seat time = 30 minutes

Using the data set provided ("validation data" table), write a one-page summary showing:

1. Reliability - you can estimate the reliability of the measure of conscientiousness (time 1 and Time 2) and the interview (HR Mgr. and Hiring Mgr.), but not cognitive ability.
   1. What is the reliability of both?
   2. Is this good, marginal, or unacceptable?
2. Validity - estimate the validity of conscientiousness (take an average of time 1 and Time 2), cognitive ability, the HR Mgr. interview, and the Hiring Mgr. interview (do the interviews separately - do not average).
   1. What is the validity of all four?
   2. Is this good, marginal, or unacceptable?
3. Adverse Impact Potential - correlate the four predictors with age, race, and gender.Would you be concerned about using any of these?

You will need to compute correlations between the (a) predictors and (b) performance. If you are unsure how, here is a simple tutorial (https://www.youtube.com/watch?v=LTrgAQraf5Y).As a check for you, the correlation between:

• Conscientiousness (mean of Time 1 and 2) and performance is r=.53
• Cognitive Ability and Hiring Mgr Interview is r=.23

Predictor	Reliability	Performance	Age	Race	Gender
Conscientiousness
Cognitive Ability	NA
Hiring Mgr Interview
HR Interview	NA

Emp ID	Consc T1	Consc T2	Cog Abil	Hiring Mgr	HR Mgr	Age	Race	Gender	Performance
1	8	6	95	3	6	54	0	0	30
2	4	3	85	4	3	54	1	1	20
3	2	2	85	6	3	52	2	0	20
4	6	7	95	2	3	45	0	0	30
5	7	7	90	1	4	27	0	1	35
6	5	4	110	2	4	44	0	0	35
7	3	4	80	1	1	43	0	0	15
8	3	5	90	7	5	26	1	1	40
9	7	5	100	2	4	52	0	1	20
10	3	2	105	6	4	27	0	0	20
11	2	4	95	5	7	36	1	0	20
12	5	5	85	4	2	43	0	0	30
13	7	5	90	6	7	49	0	0	50
14	4	3	105	3	5	36	0	0	40
15	9	9	100	2	7	35	0	0	45
16	3	3	110	7	4	41	1	1	30
17	5	7	85	4	3	34	1	1	35
18	7	5	85	7	5	36	1	0	20
19	3	3	100	7	1	42	1	0	20
20	8	7	120	7	4	39	2	1	40
21	5	5	95	6	5	47	1	0	30
22	5	6	85	5	4	35	0	0	15
23	4	4	100	7	4	50	2	0	20
24	5	4	90	4	5	57	0	1	15
25	1	3	100	5	1	45	0	0	15
26	5	6	95	3	4	58	0	1	20
27	4	2	90	6	3	36	1	1	25
28	6	7	100	7	6	36	2	1	35
29	1	1	90	7	3	23	0	1	10
30	2	4	115	6	3	37	1	0	15
31	9	10	110	6	7	48	2	1	45
32	4	6	110	5	2	34	0	1	25
33	5	6	95	7	2	35	1	1	20
34	4	3	100	6	1	51	1	1	30
35	5	3	115	7	4	44	1	1	40
36	4	2	100	7	2	47	2	1	30
37	6	8	105	6	5	39	2	1	40
38	8	10	95	5	6	50	0	0	30