Daryl J. Bem
|Born||June 10, 1938|
|Alma mater||University of Michigan|
|Occupation||Social psychologist, parapsychologist|
|Known for||Self-perception theory|
Daryl J. Bem (born June 10, 1938) is a social psychologist and professor emeritus at Cornell University. He is the originator of the self-perception theory of attitude formation and change. He has also researched psi phenomena, group decision making, handwriting analysis, sexual orientation, and personality theory and assessment.
Early life and education
Bem received a BA in physics from Reed College in Portland, Oregon, in 1960 and began graduate work in physics at the Massachusetts Institute of Technology. The civil rights movement had just begun, and he became so intrigued with the changing attitudes toward desegregation in the American South that he decided to switch fields and pursue a career as a social psychologist specializing in attitudes and public opinion. He obtained his PhD in social psychology from the University of Michigan in 1964.
In 1972, Bem proposed the self-perception theory of attitude change, which proposes a different mechanism of change than that of Leon Festinger's cognitive dissonance theory. Although the two theories appear contradictory, evidence suggests that dissonance theory and self-perception theory each explain different aspects of how people adjust their attitudes and behaviors to one another. Dissonance theory explains how people change their attitudes when they find themselves acting in opposition to the attitudes they already hold, while self-perception theory explains how people create their attitudes in the first place.
According to self-perception theory, people infer their attitudes from their own behavior much as an outside observer might. For example, just as a person might watch someone else giving a pro-Fidel Castro speech and infer that the person is in favor of Castro, a person who is asked to give such a speech would consequently come to view him or herself as more in favor of Castro.
In 1970, Bem and Keith McConnell demonstrated that people are often unaware of attitude changes caused by their behavior. Instead, people believe that the views they currently hold are the views that they have always held. Bem and McConnell demonstrated this by measuring the change in Carnegie Mellon students' attitudes toward having control of their university curriculum. After an initial measurement of student attitudes, which were favorable toward student control, Bem and McConnel assigned students to write an essay opposing student control. By writing an essay proclaiming views different from the ones they held, students' views changed to become less favorable toward student control. When Bem and McConnell asked the students how they had felt at the beginning of the study, students insisted that they had always felt less favorable toward student control. The students believed that the experiment had not changed their opinions, even though it had changed their opinions significantly.
Exotic becomes erotic theory
Bem's exotic becomes erotic theory (EBE) presents one possible explanation as to what differentiates the etiology of homosexuality from heterosexuality. Bem theorized that the influence of biological factors on sexual orientation may be mediated by experiences in childhood, that the child's temperament predisposes the child to prefer certain activities over others. Bem noted that because of their temperament, which is influenced by biological variables such as genetic factors, some children will be attracted to activities that are commonly enjoyed by other children of the same gender, while others will prefer activities that are typical of the other gender. Bem theorized that this makes a gender-conforming child feel different from opposite-gender children, while gender-nonconforming children will feel different from children of their own gender. He believes that this feeling of difference evokes physiological arousal when the child is near members of the gender which the child considers as being "different". Bem theorizes that this physiological arousal is later transformed into sexual arousal: that is, as adults, people become sexually attracted to the gender which they came to see as different, or "exotic", while they were children.
Bem based this theory in part on the finding that a majority of gay men and lesbians report being gender-nonconforming during their childhood years. A meta-analysis of 48 studies showed childhood gender nonconformity to be the strongest predictor of a homosexual orientation for both men and women. Bem also noted that in a study by the Kinsey Institute of approximately 1000 gay men and lesbians (and a control group of 500 heterosexual men and women), 63% of both gay men and lesbians reported that they did not like activities typical of their sex in childhood, compared with only 10–15% of heterosexual men and women. Bem also drew from six prospective studies, longitudinal studies that began with gender-nonconforming boys around age 7 and followed them into adolescence and adulthood; a majority (63%) of the gender nonconforming boys become gay or bisexual as adults.
Two criticisms of Bem’s theory in the journal Psychological Review concluded that "studies cited by Bem and additional research show that Exotic Becomes Erotic theory is not supported by scientific evidence." Bem was criticized for relying on a non-random sample of gay men from the 1970's (rather than collecting new data) and for drawing conclusions that appear to contradict the original data. An "examination of the original data showed virtually all respondents were familiar with children of both sexes", and that only 9% of gay men said that "none or only a few" of their friends were male, and most gay men (74%) reported having "an especially close friend of the same sex" during grade school. Further, "71% of gay men reported feeling different from other boys, but so did 38% of heterosexual men. The difference for gay men is larger, but still indicates that feeling different from same-sex peers was common for heterosexual men." Bem also acknowledged that gay men were more likely to have older brothers (the fraternal birth order effect), which appeared to contradict an unfamiliarity with males. Bem cited cross-cultural studies which also "appear to contradict the EBE theory assertion", such as the Sambia tribe in Papua New Guinea, which ritually enforced homosexual acts among teenagers, yet once these boys reached adulthood, only a small proportion of men continued to engage in homosexual behaviour - similar to levels observed in the United States. Additionally, Bem's model could be interpreted as implying that if one could change a child's behavior, one could change their sexual orientation, but most psychologists doubt this would be possible.
Neuroscientist Simon LeVay has said that while the theory was arranged in a "believable temporal order",:65 that it ultimately "lacks empirical support".:164 Social psychologist Justin LehMiller stated that "Bem's theory has received a lot of praise for the way it seamlessly links biological and environmental influences" and that there "is also some support for the model in the sense that childhood gender nonconformity is indeed one of the strongest predicators of adult homosexuality", but that the validity of the model "has been questioned on numerous grounds and scientists have largely rejected it."
Bem and Charles Honorton (1994) reviewed the experimental arrangements of the autoganzfeld experiments, and concluded they provided excellent security against deception by subjects and sensory cues. However, Ray Hyman disagreed with Bem and Honorton as he had discovered some interesting patterns in the data that implied visual cues may have taken place in the experiments. Hyman wrote that the autoganzfeld experiments were flawed because they did not preclude the possibility of sensory leakage. Bem and Honorton's review was criticized by the scientific community as it contained errors. Julie Milton and Richard Wiseman (1999) who discovered errors in Bem's research carried out a meta-analysis of ganzfeld experiments in other laboratories. They found no psi effect, the results showed no effect greater than chance from a database of 30 experiments and a non-significant Stouffer Z of 0.70.
Psychologist Susan Blackmore also criticized Bem's review of the Ganzfeld literature, noting that of the nine studies that were used for the review, five came from one laboratory (Chuck Honorton's). Blackmore also noted that Bem included experiments from Carl Sargent in the review, and Blackmore had previously found that Sargent had "deliberately violated his own protocols and in one trial had almost certainly cheated." According to Blackmore, psychologists reading Bem's review in Psychological Bulletin would "not have a clue that serious doubt had been cast on more than a quarter of the studies involved". Blackmore recounts having a discussion with Bem at a consciousness conference where she challenged him on his support of Sargent and Honorton's research; he replied "it did not matter". Writing for Skeptical Inquirer Blackmore states "But it does matter. ... It matters because Bem's continued claims mislead a willing public into believing that there is reputable scientific evidence for ESP in the Ganzfeld when there is not".
"Feeling the Future" controversy
In 2011, Bem published the article "Feeling the Future: Experimental Evidence for Anomalous Retroactive Influences on Cognition and Affect" in the Journal of Personality and Social Psychology that offered statistical evidence for psi. The article's findings challenged modern scientific conceptions about the unidirectional nature of time. Its presentation by a respected researcher, and its publication by an upper-tier journal, engendered much controversy. In addition to criticism of the paper itself, the paper's publication prompted a wider debate on the validity of peer review process for allowing such a paper to be published. Bem appeared on MSNBC and The Colbert Report to discuss the experiment.
Wagenmakers et al. criticized Bem's statistical methodology, saying that he incorrectly provides one-sided p-value when he should have used a two-sided p-value. This could account for the marginally-significant results of his experiment. Bem and two statisticians subsequently published a rebuttal to this critique in the Journal of Personality and Social Psychology.
Jeffrey Rouder and Richard Morey, who applied a meta-analytical Bayes factor to Bem's data, concluded, "We remain unconvinced of the viability of ESP. There is no plausible mechanism for it, and it seems contradicted by well-substantiated theories in both physics and biology. Against this background, a change in odds of 40 is negligible.
After evaluating Bem's nine experiments, psychologist James Alcock said that he found metaphorical "dirty test tubes," or serious methodological flaws, such as changing the procedures partway through the experiments and combining results of tests with different chances of significance. It is unknown how many tests were actually performed, nor is there an explanation of how it was determined that participants had "settled down" after seeing erotic images. Alcock concludes that almost everything that could go wrong with Bem's experiments did go wrong. Bem's response to Alcock's critique appeared online at the Skeptical Inquirer website, and Alcock replied to these comments in a third article at the same website.
One of the nine experiments in Bem's study ("Retroactive Facilitation of Recall") was repeated by scientists Stuart Ritchie, Chris French, and Richard Wiseman. Their attempt to replicate was published in PLoS ONE and found no evidence of precognition. Several failed attempts by the authors to publish their replication attempt highlighted difficulties in publishing replications, attracting media attention over concerns of publication bias. The Journal of Personality and Social Psychology, Science Brevia and Psychological Science each rejected the paper on the grounds that it was a replication. A fourth journal, the British Journal of Psychology, refused the paper after reservations from one referee, later confirmed to be Bem himself, who "might possibly have a conflict of interest with respect to [the] ... submission." Wiseman set up a register to keep track of other replicating efforts to avoid problems with publication bias, and planned to conduct a meta-analysis on registered replication efforts.
In 2012, two independent articles found that the number of rejections of the null hypothesis reported by Bem (nine out of ten test) is abnormally high, given the properties of the experiments and reported effect sizes (Francis, 2012; Schimmack, 2012). Schimmack (2015)  used a more powerful test to reveal selection for significance, The Test of Insufficient Variance, and found even stronger evidence that the reported studies are biased in favor of supporting ESP. These findings imply that studies with non-significant results are missing and the reported evidence overstates the strength of the effect and evidence. According to Francis, this suggests that Bem's experiments cannot be taken as a proper scientific study, as critical data is likely unavailable.
The publication of Bem's article and the resulting controversy prompted a wide-ranging commentary by Etienne LeBel and Kurt Peters. Using Bem's article as a case study, they discussed deficiencies in the accepted methodology most commonly used in experimental psychology. LeBel and Peters suggest that experimental psychology is systemically biased toward interpretations of data that favor the researcher's theory.
In 2012, the same journal that published Bem's original experiments, The Journal of Personality and Social Psychology (Vol. 103, No. 6), published "Correcting the Past: Failures to Replicate Psi" by Jeff Galak of Carnegie Mellon University, Robyn A. LeBoeuf of the University of Florida, Leif D. Nelson of the University of California at Berkeley, and Joseph P. Simmons of the University of Pennsylvania. The paper reported seven experiments testing for precognition that "found no evidence supporting its existence."
In a 2017 follow-up article in Slate magazine on the "Feeling the Future" experiments, Bem is quoted as saying, “I’m all for rigor, but I prefer other people do it. I see its importance—it’s fun for some people—but I don’t have the patience for it.” The article continues: "It’s been hard for him, he said, to move into a field where the data count for so much. “If you looked at all my past experiments, they were always rhetorical devices. I gathered data to show how my point would be made. I used data as a point of persuasion, and I never really worried about, ‘Will this replicate or will this not?’”" While fellow psychologist Stuart Vyse sees this statement as coming "remarkably close to an outright admission of p-hacking", he also notes that Bem "has been given substantial credit for stimulating the movement to tighten the standards for research" such as that taking place in open science.
Bem married Sandra Bem (née Lipsitz), also a psychology professor, in 1965. Though still legally married, they were "amicably separated" from 1994 until her death in 2014. In 2015, he married his partner of twenty years, Ithaca College professor of communication studies, performance studies, and queer studies Bruce Henderson. They live in Ithaca, NY.
- Bem, D. J. (1972). Self-Perception Theory. In L. Berkowitz (Ed.), Advances in Experimental Social Psychology (Vol. 6, pp. 1–62). New York: Academic Press, ISBN 978-0-12-015206-3
- Bem, D. J. (1970). Beliefs, Attitudes, and Human Affairs - Wadsworth Pub Co, ISBN 978-0-8185-8906-5
- R. L. Atkinson, R. C. Atkinson, E. E. Smith, D. J. Bem. Introduction to Psychology 1990 - Harcourt Brace Jovanovich
- Bem, D. J. An experimental analysis of self-persuasion. Attitude change: the competing views, 1971
- A. Caspi, G. H. Elder, D. J. Bem. Moving against the world: Life-course patterns of explosive children. Developmental Psychology, 1987
- A. Caspi, G. H. Elder, D. J. Bem. Moving away from the world: Life-course patterns of shy children. Developmental Psychology, 1988
- D. J. Bem, C. Honorton. Does psi exist? Replicable evidence for an anomalous process of information transfer. Psychological Bulletin, 1994
- D. J. Bem, H. K. McConnell. Testing the self-perception explanation of dissonance phenomena: On the salience of premanipulation attitudes. Journal of Personality and Social Psychology, 1970
- Bem, D. J. (December 2000). "Exotic becomes erotic: interpreting the biological correlates of sexual orientation". Arch Sex Behav. 29 (6): 531–48. doi:10.1023/A:1002050303320. PMID 11100261. S2CID 12078658.
- Bem, D. J. (April 1998). "Is EBE theory supported by the evidence? Is it androcentric? A reply to Peplau et al. (1998)". Psychol Rev. 105 (2): 395–8. doi:10.1037/0033-295X.105.2.395. PMID 9577244.
- Caspi, A; Bem, D. J.; Elder Jr, G. H. (June 1989). "Continuities and consequences of interactional styles across the life course". J Pers. 57 (2): 375–406. doi:10.1111/j.1467-6494.1989.tb00487.x. PMID 2769561.
- S. L. Bem, D. J. Bem Does Sex-biased Job Advertising" Aid and Abet" Sex Discrimination? Journal of Applied Social Psychology, 1973
- Bem, D. J. (1983). "Toward a response style theory of persons in situations". Nebr Symp Motiv: 201–31. PMID 6843717.
- Bem, D. J. (September 1977). "Predicting more of the people more of the time: some thoughts on the Allen-Potkay studies of intraindividual variability". J Pers. 45 (3): 327–33. doi:10.1111/j.1467-6494.1977.tb00155.x. PMID 894467.
- Bem, D. J. (March 1972). "Constructing cross-situational consistencies in behavior: some thoughts on Alker's critique of Mischel". J Pers. 40 (1): 17–26. doi:10.1111/j.1467-6494.1972.tb00645.x. PMID 5013145.
- Bem, D. J.; McConnell, H. K. (January 1970). "Testing the self-perception explanation of dissonance phenomena: on the salience of premanipulation attitudes". J Pers Soc Psychol. 14 (1): 23–31. doi:10.1037/h0020916. PMID 5435536. S2CID 26730816.
- Bem, D. J. (May 1967). "Self-perception: An alternative interpretation of cognitive dissonance phenomena". Psychol Rev. 74 (3): 183–200. CiteSeerX 10.1.1.323.833. doi:10.1037/h0024835. PMID 5342882.
- Bem, D. J. (June 1966). "Inducing belief in false confessions". J Pers Soc Psychol. 3 (6): 707–10. doi:10.1037/h0023226. PMID 5939010.
- Wallach, M. A.; Kogan, N.; Bem, D. J. (August 1962). "Group influence on individual risk taking" (PDF). J Abnorm Soc Psychol. 65 (2): 75–86. doi:10.1037/h0044376. hdl:2027.42/108371. PMID 14004673.
- Blackmore, Susan (2019). "Another scandal for psychology: Daryl Bem's data massage". Skeptical Inquirer. 43 (6): 5.
- Chandler, David L. (February 15, 1993). Study finds evidence of ESP phenomenon. Boston Globe
- "Daryl Bem: a brief professional bio". dbem.ws. Retrieved January 8, 2011.
- "Daryl Bem's home page". dbem.ws. September 9, 2010. Retrieved January 8, 2011.
- Staff report (July 21, 1966). Senators Hear an Interrogation In Study of Confession Ruling The New York Times
- Myers, p. 146.
- Myers, p. 151.
- Myers, David G. (2010). Social Psychology (Tenth ed.). McGraw Hill. p. 86. ISBN 978-0-07-337066-8.
- Bem, Daryl J. (January 1996). "Exotic becomes erotic: A developmental theory of sexual orientation" (PDF). Psychological Review. 103 (2): 320–335. doi:10.1037/0033-295X.103.2.320. Archived from the original (PDF) on 2007-04-11. Retrieved 2009-02-28.
- Bancroft, John (ed.) (2000). The role of theory in sex research. Bloomington, Indiana: Indiana University Press. pp. 67–81. ISBN 978-0-253-33706-1.CS1 maint: extra text: authors list (link)
- Simpson, Kevin; Gorski, Eric (November 12, 2006). "Pastor's case stirs debate". Denver Post. Retrieved February 1, 2012.
- Bailey, J. M.; Zucker, K. J. (January 1995). "Childhood sex-typed behavior and sexual orientation: A conceptual analysis and quantitative review" (PDF). Developmental Psychology. 31 (1): 43–55. doi:10.1037/0012-16184.108.40.206.[permanent dead link]
- Zucker, K. J. (1990). "Gender identity disorders in children: Clinical descriptions and natural history". In R. Blanchard & B. W. Steiner (Eds.), Clinical management of gender identity disorders in children and adults (pp. 1–23). Washington, DC: American Psychiatric Press.
- Peplau, Letitia A.; Garnets, Linda D.; Spalding, Leah R; Conley, Terri D.; Veniegas, Rosemary C. (May 1998). "A Critique of Bern's "Exotic Becomes Erotic" Theory of Sexual Orientation" (PDF). Psychological Review. 105 (2): 387–394. doi:10.1037/0033-295X.105.2.387. PMID 9577243 – via PubMed.
- Lehmiller, Justin J. (2017-12-26). The Psychology of Human Sexuality. John Wiley & Sons. pp. 156–157. ISBN 978-1-119-16471-5.
- LeVay, Simon (2016-08-01). Gay, Straight, and the Reason Why: The Science of Sexual Orientation. Oxford University Press. ISBN 978-0-19-029738-1.
- Bem, Daryl J.; Honorton, Charles (January 1994). "Does psi exist? Replicable evidence for an anomalous process of information transfer" (PDF). Psychological Bulletin. 115 (1): 4–18. doi:10.1037/0033-2909.115.1.4. Archived from the original (PDF) on 2017-03-17. Retrieved 2007-07-31.
- Ray Hyman. Evaluating Parapsychological Claims. In Robert J. Sternberg, Henry L. Roediger, Diane F. Halpern. (2007). Critical Thinking in Psychology. Cambridge University Press. pp. 216-231.
- Milton, Wiseman; Wiseman, R. (1999). "Does Psi Exist? Lack of Replication of an Anomalous Process of Information Transfer". Psychological Bulletin. 125 (4): 387–391. doi:10.1037/0033-2909.125.4.387. PMID 10414223.
- Lilenfeld, Scott (1999). "New Analyses Raise Doubts About Replicability of ESP Findings". Skeptical Inquirer. 23: 9–12.
- Terence Hines. (2003). Pseudoscience and the Paranormal. Prometheus Books. p. 138. ISBN 1-57392-979-4
- Blackmore, Susan (2018). "Daryl Bem and Psi in the Ganzfeld". Skeptical Inquirer. Committee for Skeptical Inquiry. 42 (3): 44–45.
- Bem, D. J. (March 2011). "Feeling the future: experimental evidence for anomalous retroactive influences on cognition and affect" (PDF). Journal of Personality and Social Psychology. 100 (3): 407–25. doi:10.1037/a0021524. PMID 21280961. Archived from the original (PDF) on 2012-01-03. Retrieved 2011-01-11.
- James Alcock, Back from the Future: Parapsychology and the Bem Affair, March/April 2011 Skeptical Inquirer, January 6, 2011.
- "Room for Debate: When Peer Review Falters". The New York Times. January 7, 2011.
- "Professor: Strong evidence ESP is real". NBC News. 2008-01-23. Retrieved January 30, 2011.
- "The Colbert Report: January 27, 2011 — Brian Greene". Comedy Central. 2008-01-23. Retrieved January 30, 2011.
- Wagenmakers, E. J.; Wetzels, R.; Borsboom, D.; van der Maas, H. L. (March 2011). "Why psychologists must change the way they analyze their data: the case of psi: comment on Bem (2011)" (PDF). Journal of Personality and Social Psychology. 100 (3): 426–32. doi:10.1037/a0022790. PMID 21280965.
- Bem, D. J.; Utts, J.; Johnson, W. O. (October 2011). "Must psychologists change the way they analyze their data?" (PDF). Journal of Personality and Social Psychology. 101 (4): 716–719. CiteSeerX 10.1.1.694.2507. doi:10.1037/a0024777. PMID 21928916. Archived from the original (PDF) on 2011-07-14.
- Rouder, J.; Morey, R. (2011). "A Bayes factor meta-analysis of Bem's ESP claim". Psychonomic Bulletin & Review. 18 (4): 682–689. doi:10.3758/s13423-011-0088-7. PMID 21573926.
- "Odds are against ESP: New statistical approach doesn't support claims that extra-sensory perception exists". Science Daily.
- Bem, Daryl (January 6, 2011). "Response to Alcock's "Back from the Future: Comments on Bem"". Retrieved January 31, 2012.
- Alcock, James (January 6, 2011). "Response to Bem's Comments". Retrieved January 31, 2012.
- Ritchie, Stuart J.; Wiseman, Richard; French, Christopher C.; Gilbert, Sam (March 2012). Gilbert, Sam (ed.). "Failing the Future: Three Unsuccessful Attempts to Replicate Bem's 'Retroactive Facilitation of Recall' Effect". PLOS ONE. 7 (3): e33423. doi:10.1371/journal.pone.0033423. PMC 3303812. PMID 22432019.
- Goldacre, Ben (April 23, 2011). "Backwards step on looking into the future". The Guardian. Retrieved March 17, 2012.
- Aldhous, Peter (May 5, 2011). "Journal rejects studies contradicting precognition". New Scientist. Retrieved March 17, 2012.
- Jarrett, Christian (May 11, 2011). "Psi study highlights replication problems". The Psychologist. Retrieved March 17, 2012.
- French, Chris (March 15, 2012). "Precognition studies and the curse of the failed replications". The Guardian. Retrieved March 17, 2012.
- Goldacre, Ben (April 23, 2011). "Backwards step on looking into the future". The Guardian. Retrieved February 1, 2012.
- Wiseman, Richard. "Replication Registry: Are you conducting a replication of Daryl Bem's 'Feeling the Future' experiments?". Retrieved February 1, 2012.
- Schimmack, U. (2012). The Ironic Effect of Significant Results on the Credibility of Multiple-Study Articles. Psychological Methods, 17, 551–566
- "The Test of Insufficient Variance (TIVA): A New Tool for the Detection of Questionable Research Practices | Replicability-Index". Replicationindex.wordpress.com. 2014-12-30. Retrieved 2018-12-11.
- Francis, G. (February 2012). "Too good to be true: Publication bias in two prominent studies from experimental psychology" (PDF). Psychonomic Bulletin & Review. 19 (2): 151–156. doi:10.3758/s13423-012-0227-9. PMID 22351589. S2CID 14700726.
- LeBel, Etienne P.; Peters, Kurt R. (January 2011). "Fearing the future of empirical psychology: Bem's (2011) evidence of psi as a case study of deficiencies in modal research practice" (PDF). Review of General Psychology. 15 (4): 371–379. doi:10.1037/a0025172. S2CID 51686730.
- Frazier, Kendrick. "Failure to Replicate Results of Bem Parapsychology Experiments Published by Same Journal". csicop.org. Retrieved August 7, 2013.
- Engber, Daniel (May 17, 2017). "Daryl Bem Proved ESP Is Real: Which means science is broken". Slate.
- Vyse, Stuart (2017). "P-Hacking Confessions: Daryl Bem and Me". Skeptical Inquirer. 41 (5): 25–27. Archived from the original on 2018-08-05. Retrieved August 5, 2018.
- Nussbaum, Emily (May–June 1998). "Does the exotic become erotic?". Lingua Franca. Archived from the original on July 10, 2011. Retrieved January 8, 2011.
- "and S. Bem, An Unconventional Family (1998)". News.cornell.edu. 2014-05-22. Retrieved 2018-12-11.
- Henig, Robin (May 14, 2015). "The Last Day of Her Life". The New York Times Magazine. Retrieved May 16, 2015.
- Kois, Dan (25 February 2011). "The Case for ESP -- New York Magazine - Nymag". New York Magazine. Retrieved 14 November 2020.
- Frazier, Kendrick (2013). "Failure to Replicate Results of Bem Parapsychology Experiments Published by Same Journal". Skeptical Inquirer. 37: 5–6.
- Chris French. (2012). "Precognition Studies and the Curse of the Failed Replications". The Guardian.
- Nicolas Gauvrit. (2011). "Precognition or Pathological Science? An Analysis of Daryl Bem’s Controversial Feeling the Future Paper". The Skeptics Society.
- Lilenfeld, Scott (1999). "New Analyses Raise Doubts About Replicability of ESP Findings". Skeptical Inquirer. 23: 9–12.
- "Odds Are Against ESP: New Statistical Approach Doesn't Support Claims That Extra-sensory Perception Exists". Science Daily. Retrieved June 14, 2014.