I disagree. People absolutely should be judged by their appearance. Biology and neurology are intimately related and the latter determines psychology.
One should especially judge by looks those who are old enough for their sins to have been written on their features.