A call center receives $20$ callers per minute on average. On average, a caller spends $1$ minute on hold and $4$ minutes talking to a service representative. On average, how many callers are $"$in$"$ the call center $($meaning that they are either on hold or talking to a service representative$)($round to the nearest integer$)?$