Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

7. Below is a table showing how two human judges rated the relevance of a set of 12 documents to a particular information need (0=

image text in transcribed

7. Below is a table showing how two human judges rated the relevance of a set of 12 documents to a particular information need (0= nonrelevant, 1= relevant ). Let us assume that you've written an IR system that for this query returns the ranking list: {doc2,doc5, doc6, doc7, doc8, doc 12}.[25 points ] 1) Calculate precision, recall, and F1 of your system if a document is considered relevant only if the two judges agree they are relevant. 2) Calculate precision, recall, and F1 of your system if a document is considered relevant if either judge thinks it is relevant. 3) Now if we use the average rating of two judges as the relevance judgments, Compute the DCG for the ranking list

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

SQL Server Query Performance Tuning

Authors: Sajal Dam, Grant Fritchey

4th Edition

1430267429, 9781430267423

More Books

Students also viewed these Databases questions

Question

=+Does it make you feel cool?

Answered: 1 week ago

Question

Write short notes on Interviews.

Answered: 1 week ago

Question

Define induction and what are its objectives ?

Answered: 1 week ago

Question

3. What are potential solutions?

Answered: 1 week ago

Question

Which team solution is more likely to be pursued and why?

Answered: 1 week ago