Bald Confidence Isn't Free