In this episode I look at how research can be conducted poorly and what to watch out for when you either conduct or read about the results of research.

Simmons, J.P., Nelson, L.D. & Simonsohn, U. (2011). False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant.

Simmons et. al Requirements for Authors

1. Authors should decide the rule for terminating data collection before data collection begins and report this rule in the article
2. Authors must collect at least 20 observations per cell or else provide a compelling cost-of-data-collection justification
3. Authors must list all variables collected in a study
4. Authors must report all experimental conditions including failed manipulations
5. If observations are eliminated, authors must also report what the statistical results are if those observations are included
6. If an analysis includes a covariate authors must report the statistical results of the analysis without the covariate.

Psychology Rife with Inaccurate Research Findings

www.psychologytoday.comNovember 16, 2011 12:02:34 AM EST

The case of a Dutch psychologist who fabricated experiments out of whole cloth for at least a decade is shining a spotlight on systemic flaws in the reporting of psychological research.

Diederik Stapel, a well-known and widely published psychologist in the Netherlands, routinely falsified data and made up entire experiments, according to an investigative committee.

Fraud Scandal Fuels Debate Over Practices of Social Psychology

We think money will bring happiness, but research in the area of positive psychology has consistently found that having more money does NOT make us happier. Find out how to spend your money the right way so that it really can bring happiness into your life.

How Money Can Bring Happiness Infographic

Click on the Money and Happiness infographic image below to see the infographic used in this episode.

Affective Forecasting Error

The reason we don’t spend our money the right way is what Dan Gilbert has described as an “affective forecasting” error that our “mental simulation mechanism” makes. That is, when we think about the future we aren’t usually right about what will make us happy because we don’t think about two things:

1. Adaptation – we adapt rather quickly to the things we buy (TVs, computer, etc.). The initial excitement wears off much quicker than we anticipate it will.
2. Context – we don’t pay attention to the context of our lives at that future state. In other words, we focus on that new car or that new TV, but we don’t think about the bills that go along with it.

Stumbling on Happiness List Price: $15.95 Price: $7.72 Read Reviews

Resources on Money and Happiness

• Here’s a fun way to introduce this topic: play the “Money Song” by Monty Python:
• Dunn, E. W., Gilbert D. T., & Wilson T. D. (2011).  If money doesn’t make you happy then you probably aren’t spending it right. Journal of Consumer Psychology. 21(2), 115-125.
• Van Boven, L., & Gilovich, T. (2003). To do or to have: That is the question. Journal of Personality and Social Psychology, 85, 1193-1202.
• Here’s where you can see the infographic on Money and Happiness that I created for this episode.
• I used LineForm to make the infograhic you see in this episode.
• Another vector drawing program is EazyDraw.
• DrawPlus (Windows)

• Dan Gilbert: Exploring the frontiers of happiness

  www.ted.com Dan Gilbert presents research and data from his exploration of happiness — sharing some surprising tests and experiments that you can also try on yourself. Watch through to the end for a sparkling Q&A with some familiar TED faces.TEDTalk…

Psychology Apps

The Phases of the Moon and Admissions to Mental Hospitals

This meta-analysis, published in 1985 in the journal Psychological Bulletin, found very few statistically significant relationships between the moon and human behavior.

Those studies that do find links, Rotton and Kelly said, are inaccurate, either because they don’t take important factors into account (that are responsible for the “lunacy”) or they mistake chance events as proof of a lunar effect. from, “‘Supermoon’ Lunacy: Does the Moon Make Us Crazy?“

A popular correlation that is wrong is this effect of phases of the moon on mood. Research has shown that there is no relationship. The moon is just too far away to affect our individual moods and there is no data that admissions to mental health facilities increase during the phases of the moon.

You have to keep your eye out for a subtle, often unseen 3rd factor that could be causing the two things you’re looking at to appear to be related. This may require a little brainstorming on your part. Humans are “hardwired” to see relationships between all sorts of events. We’re often wrong though.

Resources On Animal Intelligence

• Many thanks to Jason Keagy for his communication regarding this research.
• Here is a link to Dr. Gerald Borgia‘s website where you can learn more about the activities of his research group (including info on applying to become a research assistant).
• Thanks to professor Emeritus Stephen Black from Bishop’s University for alerting the Teaching in Psychology discussion list about this neat study on browerbirds
• More on problem solving animals: If you haven’t seen these crows do some neat problem solving then you’re in for a treat.

• Concept Map – In t his video I refer to the concept mapping program as “MeadMap”. Well, the company “CoMapping” purchased MeadMap. However, the program still looks and runs the same. You’ll see the map below, but you can see it full size by clicking here: Losing Weight and the Schools of Psychology. In addition, feel free to contact me (click on the Contact Michael page to the left) if you would like me to send you a copy of the map which you can import into a MeadMap account and alter it any way you wish.

If you’re old, don’t try to change yourself, change your environment – B.F. Skinner

If you can’t change something, then change the way you think about it – Maya Angelou’s mother

Did you find this video helpful? There’s more!

Learn How to Memorize More Parts of the Brain!

Ace your next Psyc Test! Click to learn more about the Psyc Test Hero smartphone app!

Mnemonic Devices used in this episode

• Cerebral Cortex: imagine a Texas cowboy hat on top of a brain. The cortex is the outer layer of the brain just under the hat where complex thinking occurs.
• Corpus Callosum: The corpus callosum is the fibers that connect the two halves of the brain. Thus, it adds the two parts together. Think of the corPLUS CalloSUM. Since the corpus callosum coordinates communication between the two hemispheres, think of corpus Call Someone.
• Thalamus: the thalamus takes sensations that come from the body and directs them to the appropriate part of the brain for processing. Thus, think of Hal and Amos – two traffic cops in the brain who direct these sensations to the right route.
• Hypothalamus: the hypothalamus regulates a number of things in the body such as body temperature, thirst, hunger, and sex drive. Think of “hypo the llamas”. Your llamas are hot, sweaty and thirsty and you use a hypo to spray water on them to cool them down and give them some water.
• Hippocampus: the hippocampus is the seat of memory. Think of a hippo with a compass. The hippo uses the compass to find his way back to the swamp because he can’t remember where it is.
• Amygdala: the amygdala controls your sense of fear. Think of either a MIG coming right at you and, of course, making you afraid, or picture a scary wig with dollars in it
• Pons: the pons helps you relax and sleep. Think of a relaxing pond.
• 
  
• Cerebellum: the cerebellum helps in coordination and balance. Picture your favorite athlete with bells all over his/her body (hanging from his/her clothes, hands, feet, etc.).
• Reticular Formation: the reticular formation helps you to become alert and aroused when you need to be. Think of what would happen if you were napping and someone tickled you: your reticular formation would kick into gear to wake you up.
• Medulla: the medulla regulates the autonomic activity of your heart and lungs. Picture medals over your heart and lungs, or stick those medals into a heart.

Psych Files listener Toby sent me this link to an excellent site where you can find mnemonics for all kinds of disciplines: Mnemonics Guide from EUdesign.

If you liked the “Tickle Me Freud” doll you saw in the episode (I got it for my wife as a present), you can get it at Amazon. Click on Freud:

Resources for This Episode

• The web site where you can change your appearance by mixing your photo with celebrities is called Hairmixer.

• Here’s a site that is similar to Hairmixer where you can also change the look of any uploaded human face. It’s from Mary Kay

Notes

• Independent Variable: the variable you manipulate (“type of hair” in this example).

• Dependent Variable: the variable you measure (“credibility” in this example).

• Operational Definition: the exact data that you will collect. In this example, a subject’s rating on a 1 to 10 credibility scale is my operational definition of credibility.

Related Episodes

• Why Do Statistics Make Us So Queasy?

• Check out episode 3 in which I discuss hypotheses and Popper’s important concept of falsifiability.

• Looking for more fun with research? Check out my episode on how consumer researcher‘s carefully watch your behavior in the grocery store.

• If you want to review many of the psychological research terms mentioned in this episode, check the “the mappr” – an audio review program I wrote.