Do I have a clear sense of the skills required to do the job well?

(Being very specific about the job requirements will help you to design questions that get directly at those requirements, rather than relying on vague impressions of the job applicant. Developing a complete list of job requirements may require consultation with other people in the organization.)