Suppose you are using a Linear SVM classifier with $2$ class classification problem. Now you have been given the following data in which some points are circled red that are representing support vectors.

If you remove the following any NON$-$red circled point from the data, the decision boundary will change.