Calculate the following four reliability coefficients using the Pearson product-moment correlation formula, correlate the scores to...
Fantastic news! We've Found the answer you've been seeking!
Question:
Transcribed Image Text:
Calculate the following four reliability coefficients using the Pearson product-moment correlation formula, correlate the scores to determine the reliability coefficient (xx). Show your work. 3. Calculate the interrater reliability coefficient for the Initial interview rating by the HR recruiter by correlating it with the Interview rating of supervisor. a. What is the reliability coefficient b. Should this selection instrument be used for selection purposes? Why or why not? 4. Calculate the interrater reliability coefficient for the interview rating of the Supervisor by correlating it with the Senior Management. a. What is the reliability coefficient_ b. Should this selection instrument be used for selection purposes? Why or why not? 5. Calculate the interrater reliability coefficient for the interview rating by the Senior Management by correlating it with the interview rating of the HR recruiter. a. What is the reliability coefficient_ b. Should this selection instrument be used for selection purposes? Why or why not? TOC Appendix L. Reliability and Validity Data Number 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 23 24 25 26 27 28 29 30 Questions #3 #4 # 5 #6 #7 Applicant #7 (adj) Bobby Jill Jason Helen Jodi Tom Bruce Neil Ira Sydney Mal Bill John Courtney Abby Lisa Shn Christopher Justin Carl Beth Bethany Lenny Gerald Thomas Abigale Christina Table XX. Reliability Results n=30; df=28 Alex Elaine Mildred Augusta Reliability Coefficients Spearman- Brown Prophecy Formula = Intial Interview (HR Recruiter)* Table XX. SEM Results SEM (BAT 2) = 5 5 2 2 7 8 2 = 3 = 7 E 5 5 5 4 5 5 7 2 3 4 - 5 4 A 2 8 5 3 4 = 8 7 3 3 Results Interview Rating (Supervisor)* 2 0 3 5 3 9 8 3 7 5 7 8 9 2 2 2 6 3 9 4 = 7 6 6 7 7 E 5 8 6 8 9 6 5 5 5 7 8 Interview Rating (Senior MGT)* 5 8 6 4 10 7 = 4 7 4 9 6 5 5 7 5 6 4 8 2 = 2 = 3 5 3 5 3 5 6 7 7 4 5 9 5 3 1 Behavioral Assessment Test (BAT) Time 1** 22 62 72 58 92 Cutoff Value 77 44 52 91 84 31 42 37 82 73 48 42 28 88 54 71 73 91 93 52 83 58 44 58 67 Time 2** 38 61 59 Useful (yes/no) 64 94 85 45 61 97 87 38 41 44 89 68 62 52 36 96 45 58 82 94 98 68 95 68 56 52 61 BAT scores Time 2 Even 18 29 27 32 55 40 27 26 41 42 18 17 21 42 33 25 25 16 51 22 21 40 42 44 29 23 30 Hank Notes. * range is 1-10; range is 1-100; other selection instruments mentioned in the case were not included in this exercise. 33 55 55 39 27 29 31 Odd 20 32 32 32 39 45 18 57 35 56 45 20 24 23 47 35 37 27 20 45 23 37 42 52 54 35 40 40 29 Performance* 2 4 5 5 8 8 3 = 6 10 9 3 4 3 9 6 19 4 7 6 9 A 4 7 8 9 10 8 9 7 6 7 6 6. Calculate the test-retest reliability coefficient for the Behavior Assessment Test (BAT) by correlating time 1 and time 2. a. What is the reliability coefficient b. Should this selection instrument be used for selection purposes? Why or why not? 7. Calculate the Split-half reliability coefficient for the Behavior Assessment Test (BAT) time 2 only by correlating time 2 even scores and odd scores. However, the Split-half reliability coefficient tends to underestimate the reliability coefficient, because it is a smaller sample (i.e.. splitting the scores by even and odds, for example). Use the Spearman-Brown (SP) Prophecy formula to adjust for the smaller sample size. a. What is the reliability coefficient b. Calculate the adjusted reliability coefficient based on the Spearman-Brown (SP) Prophecy formula. 21 Ra= 1+I Where Isp = the adjusted reliability coefficient and rxx = the original reliability coefficient. c. Should this selection instrument be used for selection purposes? Why or why not? There was a large pool of qualified applicants. HR needs you to calculate the SEM for BAT at time 2 to help make several employment decisions. 8. Calculate the SEM for BAT (time 2 for adjusted reliability coefficient) using the following formula. SEM = sd 1-r. To calculate the SEM, multiple the standard deviation for the measure (i.e., BAT, time 2) by the square root of 1 - rp. where r is the reliability coefficient for the measure. SEM =_______. Show your work and use rap for your r. Note. It is important to be 95% confident in our predictions, so use 2 SEMs when calculating the confidence intervals. Provide the range of scores around the applicants score. Please use scores from BAT time 2 (#7 adjusted with the Spearman-Brown (SP) Prophecy formula). 9. What is the 95% confidence interval for Jason's (applicant #3) obtained score? 10. What is the 95% confidence interval for Beth's (applicant #19) obtained score? 11. Are these scores the same (there is overlap) or are they significantly different? 12. If you had to selected just one candidate using BAT, time 2, either Jason or Beth, which would it be and why? Note. To calculate the standard deviation use the formula (stdev.p) in Excel Calculate the following four reliability coefficients using the Pearson product-moment correlation formula, correlate the scores to determine the reliability coefficient (xx). Show your work. 3. Calculate the interrater reliability coefficient for the Initial interview rating by the HR recruiter by correlating it with the Interview rating of supervisor. a. What is the reliability coefficient b. Should this selection instrument be used for selection purposes? Why or why not? 4. Calculate the interrater reliability coefficient for the interview rating of the Supervisor by correlating it with the Senior Management. a. What is the reliability coefficient_ b. Should this selection instrument be used for selection purposes? Why or why not? 5. Calculate the interrater reliability coefficient for the interview rating by the Senior Management by correlating it with the interview rating of the HR recruiter. a. What is the reliability coefficient_ b. Should this selection instrument be used for selection purposes? Why or why not? TOC Appendix L. Reliability and Validity Data Number 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 23 24 25 26 27 28 29 30 Questions #3 #4 # 5 #6 #7 Applicant #7 (adj) Bobby Jill Jason Helen Jodi Tom Bruce Neil Ira Sydney Mal Bill John Courtney Abby Lisa Shn Christopher Justin Carl Beth Bethany Lenny Gerald Thomas Abigale Christina Table XX. Reliability Results n=30; df=28 Alex Elaine Mildred Augusta Reliability Coefficients Spearman- Brown Prophecy Formula = Intial Interview (HR Recruiter)* Table XX. SEM Results SEM (BAT 2) = 5 5 2 2 7 8 2 = 3 = 7 E 5 5 5 4 5 5 7 2 3 4 - 5 4 A 2 8 5 3 4 = 8 7 3 3 Results Interview Rating (Supervisor)* 2 0 3 5 3 9 8 3 7 5 7 8 9 2 2 2 6 3 9 4 = 7 6 6 7 7 E 5 8 6 8 9 6 5 5 5 7 8 Interview Rating (Senior MGT)* 5 8 6 4 10 7 = 4 7 4 9 6 5 5 7 5 6 4 8 2 = 2 = 3 5 3 5 3 5 6 7 7 4 5 9 5 3 1 Behavioral Assessment Test (BAT) Time 1** 22 62 72 58 92 Cutoff Value 77 44 52 91 84 31 42 37 82 73 48 42 28 88 54 71 73 91 93 52 83 58 44 58 67 Time 2** 38 61 59 Useful (yes/no) 64 94 85 45 61 97 87 38 41 44 89 68 62 52 36 96 45 58 82 94 98 68 95 68 56 52 61 BAT scores Time 2 Even 18 29 27 32 55 40 27 26 41 42 18 17 21 42 33 25 25 16 51 22 21 40 42 44 29 23 30 Hank Notes. * range is 1-10; range is 1-100; other selection instruments mentioned in the case were not included in this exercise. 33 55 55 39 27 29 31 Odd 20 32 32 32 39 45 18 57 35 56 45 20 24 23 47 35 37 27 20 45 23 37 42 52 54 35 40 40 29 Performance* 2 4 5 5 8 8 3 = 6 10 9 3 4 3 9 6 19 4 7 6 9 A 4 7 8 9 10 8 9 7 6 7 6 6. Calculate the test-retest reliability coefficient for the Behavior Assessment Test (BAT) by correlating time 1 and time 2. a. What is the reliability coefficient b. Should this selection instrument be used for selection purposes? Why or why not? 7. Calculate the Split-half reliability coefficient for the Behavior Assessment Test (BAT) time 2 only by correlating time 2 even scores and odd scores. However, the Split-half reliability coefficient tends to underestimate the reliability coefficient, because it is a smaller sample (i.e.. splitting the scores by even and odds, for example). Use the Spearman-Brown (SP) Prophecy formula to adjust for the smaller sample size. a. What is the reliability coefficient b. Calculate the adjusted reliability coefficient based on the Spearman-Brown (SP) Prophecy formula. 21 Ra= 1+I Where Isp = the adjusted reliability coefficient and rxx = the original reliability coefficient. c. Should this selection instrument be used for selection purposes? Why or why not? There was a large pool of qualified applicants. HR needs you to calculate the SEM for BAT at time 2 to help make several employment decisions. 8. Calculate the SEM for BAT (time 2 for adjusted reliability coefficient) using the following formula. SEM = sd 1-r. To calculate the SEM, multiple the standard deviation for the measure (i.e., BAT, time 2) by the square root of 1 - rp. where r is the reliability coefficient for the measure. SEM =_______. Show your work and use rap for your r. Note. It is important to be 95% confident in our predictions, so use 2 SEMs when calculating the confidence intervals. Provide the range of scores around the applicants score. Please use scores from BAT time 2 (#7 adjusted with the Spearman-Brown (SP) Prophecy formula). 9. What is the 95% confidence interval for Jason's (applicant #3) obtained score? 10. What is the 95% confidence interval for Beth's (applicant #19) obtained score? 11. Are these scores the same (there is overlap) or are they significantly different? 12. If you had to selected just one candidate using BAT, time 2, either Jason or Beth, which would it be and why? Note. To calculate the standard deviation use the formula (stdev.p) in Excel
Expert Answer:
Answer rating: 100% (QA)
3 Calculate the interrater reliability coefficient for the Initial interview rating by the HR recruiter by correlating it with the Interview rating of ... View the full answer
Related Book For
Posted Date:
Students also viewed these finance questions
-
When a drug is injected into a persons muscle tissue, the concentration y of the drug in the blood is a function of the time elapsed since the injection. The graph of a typical timeconcentration...
-
You are considering an investment that is going to pay $1,500 a month starting 20 years from today for 15 years. If you can earn an 8 percent return on any investment, compounded monthly, how much at...
-
Describe either a benefit or concern associated with nuclear power versus more conventional power production
-
Find a function (x, y) such that = (y, x).
-
The vulcanization of polyisoprene is accomplished with sulfur atoms according to Equation 15.4. If 45.3 wt% sulfur is combined with polyisoprene, how many cross-links will be associated with each...
-
a. Identify the time at which Nike recognizes revenues. Does this timing of revenue recognition seem appropriate? Explain. b. Identify the cost-flow assumption(s) that Nike uses to measure cost of...
-
Is the result in exercise 7 still true if we allow the discount rate to be positive? What is the lower bound in this case?
-
Wine Accessories Inc. (WAI) produces two models of corkscrews, the standard model and a deluxe model.WAI follows a level aggregate plan, producing 20,000 corkscrews per month, or 5000 corkscrews per...
-
Evaluate the importance of cash flow to a business of your choice. Explain how a recession would most likely affect this business. (170 words)
-
Utilizing Figure develop the eight elements for the following issue: Daimler Auto Parts, Inc., headquartered in Munich, Germany, is attempting to register with the SEC in order to list its stock on...
-
2. Read PCAOB AS 2201 paragraphs .62-.68. When an auditor identifies a control deficiency on a public company audit, the auditor should assess the severity of the control deficiency. What are the two...
-
How do optimistic concurrency control techniques such as timestamp ordering or multi-version concurrency control (MVCC) mitigate contention and ensure data consistency in highly concurrent...
-
how would you approach optimizing a database query that is slowing down performance of a web application ?
-
how to connect to oracle database from cpp file step by step? I use Visual Studio and Oracle Instant Client. ? Explain your answer
-
How to determine the storage configuration for a database server for 1000+ staff? The server runs Linux and will have an Oracle database server. The estimated databases currently consume about 8 TB...
-
How would you protect data security during database migrations?
-
Accounting - taxation Studying problem Sam and Rachel operate a legal practice in partnership. The Partnerships receipts and payments (not including GST) for the year ended 30 June 2019 are as...
-
A consumer magazine is evaluating five brands of trash compactors for their effectiveness in reducing the volume of typical household products that are discarded. In the experiment, each block...
-
Bad, inept recruiting is my pet peeve, probably because its more difficult to work around than mediocre moderating or reporting. As a client, we go to great lengths to identify the types and mix of...
-
Address-Based Sampling (ABS) offers potential benefits in comparison to a strictly telephone-based method of contact. Landlines offer access to only about 75 percent of U.S. households, and...
-
David Santee addresses marketing researchers and makes a plea for the research industry to become more strategic. Although it may not always be apparent, senior executives want our information and...
-
Ganados Phases. What are the main phases that Ganado passed through as it evolved into a truly global firm? What are the advantages and disadvantages of each?
-
Why Go. Why do firms become multinational?
-
Financial Globalization. Explain the twin agency problems. How do the twin agency problems limit financial globalization?
Study smarter with the SolutionInn App