Beliefs: the Solution and Cause of our Problems

A well-known commenter suggested I be more open on a subject where I have a strong opinion. He makes the reasonable claim that it's unlikely my single explanation is the only correct one among many, that perhaps the truth is actually a combination of several hypotheses, and further my credibility is dampened by singling out a pet theory, and lastly it causes a biased view of the evidence.

I like to think about epistemology, and the nature of beliefs brings forth a mare's nest of paradoxes. As Richard Feynman noted, the first goal of a scientist is not to fool yourself, because you are the easiest one to fool.  How can this be? For starters, overconfidence is not only ubiquitous, but very beneficial in moderation (Dan Kahneman says it's the bias he would most want his children to have). I've found those who state they are not merely unbiased, but rationally objective to a fault, are usually the most biased thinkers around (Stephen Jay Gould, Richard Dawkins). This is why Alfred Adler noted the hardest thing to do is know yourself, and then change yourself.  Further, it's hard to  explain why two rational people can agree to disagree (see Milgrom and Stokey's No-Trade Theorem)

 It's generally good when discussing a problem to not propose solutions until the problem has been discussed as thoroughly as possible, and only then suggest solutions.  Griffin and Tversky find that once we can predict our beliefs, they are basically fixed; if you think there's a 70% chance you will vote for something, then there's an almost certainty you will. This is why juries aren't supposed to discuss a trial until the end, because if you discuss it earlier you will unconsciously favor points that support your initial view.

As Eliezer Yudkowsky notes, your wisdom is determined by how you create your beliefs, not how you defend them. Alas, most thoughts are focused unconsciously at the latter.

Given that, there's a large cost to having beliefs, because they are difficult to change as a practical matter.  On the other hand, there are many potential theories and facts, and being open to all of them creates indecision. As they say, if you don't know where you are going any road gets you there, but if that's your goal no one will follow you there either. I mean, you can always be a mercenary, someone who does something specific other people  find difficult or onerous (eg, an accountant, programmer), but if you want to be a portfolio manager, you need a clear vision to have a chance of succeeding.

Doubt is the essence of human consciousness, as our lack of instinct means we often think about what we are doing, why and what to do. It is necessary at least once to doubt all things, but eventually, you have to choose beliefs.  Sure, they should be tentative, but more like amendments to the constitution as opposed to annual budget items.

 My thoughts on the risk premium aren't something I think about cavalierly, things like my thoughts on gay marriage or the what ended the Roman Empire. Rather, it's something I've studied in depth for decades, looking at theory and data. If I didn't have a strong opinion after such a time, you could safely conclude I didn't see anything.

Theory is a lens and a blinder, necessarily focusing on some things to the exclusion of others.  You need a theory to see. It may be wrong, but unless you take a point of view you'll never know, and everything will remain as it is, a blooming, buzzing confusion.