Blue and Black vs. White and Gold: Why Can't we Trust What We See?