Answered step by step
Verified Expert Solution
Question
1 Approved Answer
Objective: The objective of this assignment is to familiarize you with predictive probabilities in the context of fraud detection and demonstrate how the choice of
Objective:
The objective of this assignment is to familiarize you with predictive probabilities in the context of fraud
detection and demonstrate how the choice of cutoff threshold impacts the classification of data.
Data Overview
Below is a table containing two columns: "Transaction Type" for legitimate, for fraudulent and
"Predicted Probabilities" obtained from a machine learning model. This data represents transactions
that need to be classified as either fraudulent or legitimate based on these predicted probabilities.
Transaction Type Predicted Probabilities
Step : Applying Different Cutoffs
Now its your turn to classify the prediction probabilities into classes legitimate and
fraudulent using the cutoff threshold based on the approach illustrated in Step
Repeat the same procedure with cutoff thresholds
Step : Calculate Confusion Matrix
Calculate the confusion matrix for each of three classifications you made in previous step based on
cutoff thresholds
Calculate accuracy, precision, recall and f score for each one.
What is the effect of cutoff threshold based on above observations?
Step : Calculate Cost and Identify Best Classifier
Now consider the following cost function that quantifies the cost associated with making different types
of classification errors eg false positives and false negatives:
Predicted Class Predicted Class
Actual Class $
Actual Class $
Calculate the total cost for each of the classifiers and finally decide which cutoff threshold would be
the best choice?
Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started