Talk:Publication bias

From Wikipedia, the free encyclopedia
Jump to: navigation, search
          This article is of interest to the following WikiProjects:
WikiProject Science (Rated C-class, Mid-importance)
WikiProject icon This article is within the scope of WikiProject Science, a collaborative effort to improve the coverage of Science on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.
C-Class article C  This article has been rated as C-Class on the project's quality scale.
 Mid  This article has been rated as Mid-importance on the project's importance scale.
 
WikiProject Medicine (Rated C-class, Mid-importance)
WikiProject icon This article is within the scope of WikiProject Medicine, which recommends that this article follow the Manual of Style for medicine-related articles and use high-quality medical sources. Please visit the project page for details or ask questions at Wikipedia talk:WikiProject Medicine.
C-Class article C  This article has been rated as C-Class on the project's quality scale.
 Mid  This article has been rated as Mid-importance on the project's importance scale.
 
WikiProject Philosophy (Rated C-class, Mid-importance)
WikiProject icon This article is within the scope of WikiProject Philosophy, a collaborative effort to improve the coverage of content related to philosophy on Wikipedia. If you would like to support the project, please visit the project page, where you can get more details on how you can help, and where you can join the general discussion about philosophy content on Wikipedia.
C-Class article C  This article has been rated as C-Class on the project's quality scale.
 Mid  This article has been rated as Mid-importance on the project's importance scale.
 
WikiProject Academic Journals (Rated C-class)
WikiProject icon This article is within the scope of WikiProject Academic Journals, a collaborative effort to improve the coverage of Academic Journals on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.
C-Class article C  This article has been rated as C-Class on the project's quality scale.
 
Note icon
This article has been marked as needing an infobox.
See WikiProject Academic Journals' writing guide for tips on how to improve this article.
WikiProject Skepticism  
WikiProject icon This article is within the scope of WikiProject Skepticism, a collaborative effort to improve the coverage of science, pseudoscience, pseudohistory and skepticism related articles on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.
 ???  This article has not yet received a rating on the project's quality scale.
 ???  This article has not yet received a rating on the project's importance scale.
 

Publication bias is a well-documented problem in a range of disciplines. See, for example, V. M. Montori, M. Smieja and G. H. Guyatt, "Publication Bias: A Brief Review for Clinicians," Mayo Clinic Proceedings 75 (2000): 1284-8; A. Thornton and P. Lee, "Publication Bias in Meta-Analysis: Its Causes and Consequences," Journal of Clinical Epidemiology 53 (2000): 207-16 [1]

Merger proposal[edit]

I suggest that File drawer problem should be merged with this article. The two terms are so closely related and the two articles are covering such similar ground that it doesn't seem useful to have separate articles. Publication bias is the more general term and this article is more developed so it makes sense to merge File drawer problem into here rather than vice-versa. --Qwfp (talk) 10:57, 21 February 2008 (UTC)

I agree that "File drawer problem" is an example of Publication Bias. --71.185.40.151 (talk) 11:29, 3 June 2008 (UTC) --SV Resolution(Talk) 11:30, 3 June 2008 (UTC)

No objection. 69.140.152.55 (talk) 03:53, 21 June 2008 (UTC)

Publication Bias – is it always positive outcome?[edit]

Ionnidis( Why Most Published Research Findings Are False) states "Claimed Research Findings May Often Be Simply Accurate Measures of the Prevailing Bias". In some cases, wouldn't the prevailing bias be for a negative result? If the prevailing bias is that Wonderbread-and-bologna sandwiches don't improve serum glucose in diabetics, won't it be difficult to get a paper published that claims a positive result? --SV Resolution(Talk) 13:54, 3 June 2008 (UTC)

The article File drawer problem states

"Publication bias" is a more general term, as it may include differences in the availability or accessibility of published papers due to the language, format or journal of publication.

. What is the accepted definition of "Publication Bias" --SV Resolution(Talk) 13:56, 3 June 2008 (UTC)

It may not be always positive. I was listening to a radio programme, which was discussing this issue. It seems that academic journals favour results that are divergent from the norm. For example, a new theory or unexpected finding is published because it is unexpected/unusual. For a period of time, the prevailing bias amongst journals are studies which support this case. However, as the theory becomes (seemingly) well grounded, there is a prevailing tendency for the publication of research which negate the theory. In light of this, I call for a change in the definition expressed in the opening paragraph of this article.--62.252.10.14 (talk) 07:37, 26 May 2011 (UTC)

there are other kinds of publication bias[edit]

the file drawer problem is just one among many different kinds of publication bias. This entry should thus be kept. (and further developed). --BirgerH (talk) 13:55, 21 February 2009 (UTC)

I went ahead and merged it, there really wasn't enough to stand alone once the OR was removed. Fences and windows (talk) 00:20, 29 March 2009 (UTC)

And indeed there is a "reverse publication bias" in financial economics. Timmerman and Granger (2004) argue (in "Efficient market hypothesis and forecasting", footnote 1) that:

"In studies of market efficiency, a reverse file drawer bias may be present. A researcher who genuinely believes he or she has identified a method for predicting the market has little incentive to publish the method in an academic journal and would presumably be tempted to sell it to an investment bank."

This also provides support for keeping the more general term of "publication" bias, unless we are prepared to live with the implications (of academic journals in financial economics acting as the "file drawer" for the unsold stuff:)

I managed also to trace the original "file drawer" term to Rosenthal (1979) (Rosenthal, Robert, 1979. The file drawer problem and tolerance for null results. Psychological Bulletin 86(3), 638-641.) — Preceding unsigned comment added by 83.7.162.252 (talk) 12:09, 11 December 2011 (UTC)

the scale of the publication bias[edit]

Is the "1 in 3" number attributed to Dickersin (1987) correct or sufficient? The abstract of that paper states that the ratio of published-to-discarded rejections of the null (hypothesis of treatment ineffectiveness) is 55% to 14%. Surely it is equally salient news that the proportion of significant to insignificant results is four times higher in published studies than in those which had been consigned to the file drawer (or rejected by peer review)? 83.7.162.252 (talk) 16:25, 11 December 2011 (UTC)

There were actually 3 other studies that found no difference b/w rates of publication but they never got published ;) — Preceding unsigned comment added by 139.52.176.32 (talk) 16:39, 1 November 2012 (UTC)

Effectiveness of pre-registration[edit]

I'm an outsider to pharmaceutical research, but I'd have thought that “[With pre-registration,] negative results should no longer be able to disappear” is too strong a claim: that one can still do studies not published or registered with such publications, and thus have any negative results disappear. Worse, it would seem that publication bias can still persist even within such publications, because one can choose to register a study only once one is reasonably sure that the outcome will be positive under carefully contrived circumstances while presenting the results as being general.

That is not to say that a pre-registration policy will have no effect on publication bias, merely that “[not] able to disappear” seems too strong a claim, that better wording would be something like “in an attempt to reduce publication bias”. Pjrm (talk) 04:45, 23 February 2009 (UTC)

I think the way of putting it that best keeps to the NPOV is "will still be recorded". It assumes nothing not already declared in the article (the existence of publication bias and the file drawer effect). —Preceding unsigned comment added by 67.86.45.4 (talk) 22:31, 28 July 2009 (UTC)


Sorry, I can't remember where, but I saw something about the pre-registration guidelines not actually being followed. So you still get publication bias, but worse, believe you aren't. Perhaps someone can hunt down more info on this. Could have been Ben Goldacre. 131.107.0.73 (talk) 11:44, 10 February 2010 (UTC)

External links[edit]

I tried to delete the last item in the external links section, because it was a duplicate of the first item in the section, but someone added it back in. What is the problem? It is a duplicate.

"The Truth Wears Off: Is there something wrong with the scientific method? -- Jonah Lehrer" (the first item) goes to the same link as "interesting article on 'the decline effect' and the role of publication bias in that" (the last item).


I also added in a good link to a very good article and it was deleted. Why?

http://cscs.umich.edu/~crshalizi/weblog/698.html

The Neutral Model of Inquiry (or, What Is the Scientific Literature, Chopped Liver?) — Preceding unsigned comment added by 74.38.228.98 (talk) 13:42, 24 September 2011 (UTC)