Principia Discordia

Principia Discordia => Or Kill Me => Topic started by: Roaring Biscuit! on May 16, 2011, 09:34:18 PM

Title: Occam's Razor (pre-emptive thread split)
Post by: Roaring Biscuit! on May 16, 2011, 09:34:18 PM
QuoteI'll be brief on this, and we can split it into it's own thread, but you don't seem to be using the idea of Occam's Razor correctly.

http://wiki.lesswrong.com/wiki/Occam%27s_Razor

However, you're absolutely right if you consider that what politicians are giving you is a false simplicity, and runs entirely counter to Occam's Razor.


Well, I did have an incorrect interpretation of Occam's Razor, but I still dislike it.  Not because it's a bad idea.

In my eyes, the idea that:
QuoteWhen several theories are able to explain the same observations, Occam's razor suggests the simpler one is preferable.

I completely agree with that, but I think there is one cleverly hidden implication, which is really what I was trying (and failing, as usual  :wink:) to express.  It comes down to that last phrase really:

Quotethe simpler one is preferable

QuoteSIMPLE IS PREFERRABLE

I'd go as far to say that a lot of new scientific theories fall pray to a kind of simplicity halo effect, like when judging the personality of faces we equate beauty with positive characteristics.  Simplicity is dangerously reinforced in a lot of spheres, and it may even be the case (to stretch the meme/gene parallels a touch) that simplicity of memes is selected for in meme transference, for the obvious ease in spreading an idea and in comprehending.

Hell it might even be that our lazy brains select for simplicity, consider the beautiful = good phenomena in face perception.  What is beautiful?  In very broad strokes we're talking about things like skin clarity (textural simplicity?) and symmetry (geometric simplicity?).  Bloody simplicity is everywhere.

Now I'm gonna jump the gun a bit here, and suggest that someone will say something along the lines of "why use a paragraph when you can use a word", which is absolutely right (sort of).  But there's no point in doing that if you're using the wrong word.  So to bring it back to the original subject, Occam's Razor for me represents a subtle trend towards simplicity for the sake of simplicity.

xx
Edd

p.s. @LMNO, it may or may not clarify my point somewhat to know that I study psychology, as such the theories in my mind when talking about this sort of thing tend to be psychological theories, which are tend to be a lot messier than in other sciences.
Title: Re: Occam's Razor (pre-emptive thread split)
Post by: LMNO on May 16, 2011, 10:21:07 PM
Yeah, I DEFINITELY think you're approaching this from a different angle.

Maybe think of it this way.  Occam's Razor says "make the answer only as complicated as it has to be."  I think you're bugging out over the word "simple", maybe adding in the alternate definition of "simple" as "dumbed down".  All it asks is for you to throw away the useless terms.  It's not "choose the answer with the fewest words or ideas," it's "take out all the meaningless shit from whatever answer is working."
Title: Re: Occam's Razor (pre-emptive thread split)
Post by: Precious Moments Zalgo on May 17, 2011, 04:05:16 AM
Yes, what LMNO said.

The word simple, in the context of Occam's razor, is used more in the sense of elegance or clever simplicity, rather than in the sense of being dumbed-down and devoid of complexity.

If several theories are capable of explaining all of the observed phenomena, the one that makes the fewest unnecessary assumptions is preferable.
Title: Re: Occam's Razor (pre-emptive thread split)
Post by: Roaring Biscuit! on May 17, 2011, 01:17:15 PM
QuoteI completely agree with that, but I think there is one cleverly hidden implication

Stated again, I understand what Occam's Razor actually is, and why it's good, but it is also a symptom of the simple is good phenomena, which is far more interesting to discuss.  I think there is a general trend in softer sciences, that want to be hard sciences, to look at the simple elegant equations of classical physics and think "If we want to be considered proper scientists we should have simple elegant models" rather having models that are actually accurate/true.

Let's change tack!  Pros and cons of "simplicity = good" meta-meme?

xx

edd
Title: Re: Occam's Razor (pre-emptive thread split)
Post by: LMNO on May 17, 2011, 02:28:00 PM
Linguistics/Semantics.


Ok, fine.  That's usually my default positon.  But hear me out.  First off, it sounds like you're saying the softer sciences are using Occam's Razor horribly incorrectly, in order to make their theories "as elegant" as physics.  Which is something you should never, ever say around a Scientologist, because they'll go batshit insane with glee.  And just because they don't understand what it means, and are distorting words, doesn't make Occam untrue, or unhelpful.

Second, there seems to be another semantic fart when people try to use "simple" as a synonym for "easy".  Because what is more simple?

As an example from Less Wrong, lightning could either be electrical atmospheric discharge, which sounds complicated, or the god Thor, which sounds simple.  But in fact, positing Thor is insanely complicated, because now you have to explain and prove Thor. 

Simply (ha!) put, just because an explanation sounds simple, that doesn't mean it is simple.  Words are incredibly dense signifiers, packed with meaning that most people don't even consider.  Sure, we can sum up a massively fundamental difference in the way the universe has been shown to work by saying "Thor".  But that doesn't mean that it's simpler.  It just means it's shorter in that form.  But once you start unpacking the word "Thor", you'll end up saying, "you know, can we go back to that atmospheric discharge thing?  That's starting to make a lot more sense."

That's what I was saying before about "false simplicities".  They're like icebergs, you only see 10% of them above the water.

Now, the problem you seem to be addressing is the human trait of not wanting to think too hard.  They want to go with first impressions, clear narratives, and obvious themes.  They avoid nuance, they want order not chaos.  That, I believe is partly hard wired into our monkey brains, because to dwell too long on something increases the chances of getting eaten by something large and with a lot of teeth.  So, I don't think that's a meme so much as a good chunk of the OS.
Title: Re: Occam's Razor (pre-emptive thread split)
Post by: Adios on May 17, 2011, 04:40:18 PM
Quote from: LMNO, PhD on May 17, 2011, 02:28:00 PM
Linguistics/Semantics.


Ok, fine.  That's usually my default positon.  But hear me out.  First off, it sounds like you're saying the softer sciences are using Occam's Razor horribly incorrectly, in order to make their theories "as elegant" as physics.  Which is something you should never, ever say around a Scientologist, because they'll go batshit insane with glee.  And just because they don't understand what it means, and are distorting words, doesn't make Occam untrue, or unhelpful.

Second, there seems to be another semantic fart when people try to use "simple" as a synonym for "easy".  Because what is more simple?

As an example from Less Wrong, lightning could either be electrical atmospheric discharge, which sounds complicated, or the god Thor, which sounds simple.  But in fact, positing Thor is insanely complicated, because now you have to explain and prove Thor. 

Simply (ha!) put, just because an explanation sounds simple, that doesn't mean it is simple.  Words are incredibly dense signifiers, packed with meaning that most people don't even consider.  Sure, we can sum up a massively fundamental difference in the way the universe has been shown to work by saying "Thor".  But that doesn't mean that it's simpler.  It just means it's shorter in that form.  But once you start unpacking the word "Thor", you'll end up saying, "you know, can we go back to that atmospheric discharge thing?  That's starting to make a lot more sense."

That's what I was saying before about "false simplicities".  They're like icebergs, you only see 10% of them above the water.

Now, the problem you seem to be addressing is the human trait of not wanting to think too hard.  They want to go with first impressions, clear narratives, and obvious themes.  They avoid nuance, they want order not chaos.  That, I believe is partly hard wired into our monkey brains, because to dwell too long on something increases the chances of getting eaten by something large and with a lot of teeth.  So, I don't think that's a meme so much as a good chunk of the OS.

This is bordering on genius.
Title: Re: Occam's Razor (pre-emptive thread split)
Post by: LMNO on May 17, 2011, 04:47:21 PM
I can't quite take credit for it; it's extrapolated from some of the Less Wrong stuff.  But thanks!
Title: Re: Occam's Razor (pre-emptive thread split)
Post by: Kai on May 18, 2011, 02:05:46 AM
The original wording of Occam's Razor is "Do not multiply entities beyond necessity". IOW, if a particular assumption is unnecessary for the explanation of a particular phenomenon, it should be eliminated from the explanation.

Example: Angels bowling is not a necessary assumption to explain thunder, as it can be explained adequately by air superheated through high voltage static electricity. Therefore, it can be eliminated.
Title: Re: Occam's Razor (pre-emptive thread split)
Post by: LMNO on May 18, 2011, 03:52:31 AM
Master Kai, I'm glad you entered in to this.

Beyond Occam, RB noticed a behavior for humans to ignore nuance in favor (and often counter to reality) of false simplicity.

Though you don't necessarily subscribe to meme theory, does this sound like a conditioned behavior, or does it seem to be a deeper impulse?
Title: Re: Occam's Razor (pre-emptive thread split)
Post by: Cain on May 18, 2011, 12:16:37 PM
The idea is that a simple, abstracted theory will provide an overall better guide to judgement and behaviour than a possibly contradictory but more complicated and nuanced system would.

I know this because I've been reading Mearsheimer's theoretical work recently, Mearsheimer being a prime offender of someone who is totally wrong on a factual level, but insists he is correct on a higher, theoretical/abstract level.  He argues that we need theories as a guide to action (giving the example of a theory of crossing the road, "you look left, then right, then again, then you start to cross, then you make it to the other side."  Often in reality it doesn't work like that, because of traffic, ice, animals presenting a hazard etc, but that is the theory from which we derive practice).

The problem is this removes what I would consider the most basic element of science - fact-checking.  If a theory, like Mearsheimer's, continues to fail to explain past actions and predict future actions accurately, while insisting it is theoretically correct, it is no better than religion.  He argues that where his theory fails, it is because more nuanced theories (mid-level or micro-level) which complement but do not contradict his overall thesis can explain the phenomena in question, something which is not readily apparent.  He also cherry-picks his examples from the historical data, with no good reason even from his own theoretical standpoint for excluding certain data, and so does not explain the counter-examples to his argument.

He also derives an ought from an is which, as a fan of Hume, amuses and infuriates me.

I think it is hard for a social science to ever be like the hard sciences, because they're much more complicated and we don't have the necessary mathematical or conceptual tools to reduce and express such behaviour at this time (and we may never have).  That said, it shouldn't stop people from trying to adhere to basic methods of science, like observation, including anomalous data, not putting theory before facts and so on and so forth.
Title: Re: Occam's Razor (pre-emptive thread split)
Post by: LMNO on May 18, 2011, 01:07:53 PM
This Mearsheimer guy sounds like a total ass.  Are there any upsides to his work?
Title: Re: Occam's Razor (pre-emptive thread split)
Post by: Cain on May 18, 2011, 01:13:03 PM
Well...you could give his stuff to undergrands to look for the logical flaws.

Sadly, this kind of "reasoning" permeates the social sciences, though usually not in such a flagrantly incorrect manner.
Title: Re: Occam's Razor (pre-emptive thread split)
Post by: LMNO on May 18, 2011, 01:52:15 PM
IT'S ALWAYS SUNNY DURING THE DAYTIME.*













*Except when it rains.**

**Or it's generally overcast.***

***Or if you live in Seattle.
Title: Re: Occam's Razor (pre-emptive thread split)
Post by: Cain on May 18, 2011, 01:57:00 PM
Social scientists seem to have not so much science envy as Nobel Prize-winning Grand Unified Theory envy.

They seem to have forgotten Grand Unified Theories were worked up from centuries of observation and testing, and most science started out as small, bounded theories that gradually fit into a more coherent whole as more commonalities or underlying rules of those minor theories were discovered.

Not by some bloviating asshole with tenure making shit up and then shoehorning reality to fit in with his theoretical construct.
Title: Re: Occam's Razor (pre-emptive thread split)
Post by: LMNO on May 18, 2011, 01:59:00 PM
They also seem to have forgotten that the Grand Unified Theory for physics hasn't been found yet.
Title: Re: Occam's Razor (pre-emptive thread split)
Post by: Cain on May 18, 2011, 04:12:34 PM
Yeah.  But it will be.  And when it is, the social scientists will be there to say they discovered their GUT first and neeer neer ne neer neeer.
Title: Re: Occam's Razor (pre-emptive thread split)
Post by: Kai on May 20, 2011, 03:21:47 PM
Quote from: LMNO, PhD on May 18, 2011, 03:52:31 AM
Master Kai, I'm glad you entered in to this.

Beyond Occam, RB noticed a behavior for humans to ignore nuance in favor (and often counter to reality) of false simplicity.

Though you don't necessarily subscribe to meme theory, does this sound like a conditioned behavior, or does it seem to be a deeper impulse?

By our methods of communication, much of the groundwork for it genetically inherited, an explanation such as "The woman down the street is a witch, she did it" is much easier to calculate in our style of communication than an explanation that requires mathematics, physics, etc. It's not so much that a seemingly simple answer such as my example is actually simpler at all, it's just /easier/ for humans to grasp. It's probably instinctual, at least in great part. The ability to see through it, I think, would be conditioned.
Title: Re: Occam's Razor (pre-emptive thread split)
Post by: LMNO on May 20, 2011, 03:27:12 PM
So, we have two words: "Simple" and "Easy".

I'd like to use them in the following way...

Something is "simple" when it has the least number of conjectures, suppositions, unproved assertions and wild guesses.
Something is "easy" when a 10-yer-old can comprehend it.

THEREFORE:

The simplest answer is not always the easiest.
Title: Re: Occam's Razor (pre-emptive thread split)
Post by: Kai on May 20, 2011, 03:37:59 PM
Quote from: LMNO, PhD on May 20, 2011, 03:27:12 PM
So, we have two words: "Simple" and "Easy".

I'd like to use them in the following way...

Something is "simple" when it has the least number of conjectures, suppositions, unproved assertions and wild guesses.
Something is "easy" when a 10-yer-old can comprehend it.

THEREFORE:

The simplest answer is not always the easiest.

That's correct. In fact, the simplest answer is seldom the easiest in science. Otherwise the scientific Renaissance would have happened in ancient Greece.
Title: Re: Occam's Razor (pre-emptive thread split)
Post by: LMNO on May 20, 2011, 03:44:31 PM
So, per RB, there seems to be a self-recursion going on.  The brain wants it to be easy, doesn't care if it's simple.  So when a brain develops theories about itself (which is what a lot of the softer sciences are doing), it naturally slips into easy, and then biases itself into confirming the easy theory.

In physics, when you choose the easy instead of the simple, you tend to get the wrong answer more often than not.  In psychology, not so much, due to the mind's endless obsession with confirmation.

I don't know for sure because I haven't checked, but there must be a kind of science that analyzes the brains of other mammals.  And I would hazard a guess that their studies and conclusions lean further away from the easy.
Title: Re: Occam's Razor (pre-emptive thread split)
Post by: Cain on May 20, 2011, 08:34:22 PM
http://en.wikipedia.org/wiki/Ethology
Title: Re: Occam's Razor (pre-emptive thread split)
Post by: Kai on May 20, 2011, 11:43:28 PM
Quote from: Cain on May 20, 2011, 08:34:22 PM
http://en.wikipedia.org/wiki/Ethology

Also, evolutionary and comparative psychology. Though much of the conclusions are bunk due to poor scientific practices and the sort of projection LMNO is talking about.
Title: Re: Occam's Razor (pre-emptive thread split)
Post by: Cain on May 21, 2011, 02:33:35 PM
Yeah, my first thought was, initially, evolutionary psychology, but I know there is a lot of controversy and dispute around that (I don't know the exact nature of it, because I haven't looked thoroughly, but I know it exists.  Evolutionary psychology as a concept seems fine, sensible even, but I can easily see how it could turn horrible very quickly, especially by those who want to imply is=ought and with particular political agendas).  Ethology seems on fairly secure ground though.