The optimal parameter theta according to the Bayesian estimation (standard formulation) corresponds to the expectation of the parameter theta over its posterior distribution p(theta|dataset). the parameter that minimizes the Kullback-Leibler divergence between distributions parametrized by the true and optimal parameter theta. the parameter that maximizes the posterior distribution p(theta|dataset). the parameter that maximizes p(dataset|theta)