Metallic Metals Act: Difference between revisions
Content deleted Content added
KolbertBot (talk | contribs) m Task #2 : Remove link referral data |
Citation bot (talk | contribs) m Alter: url, pages, title. Add: year, jstor. Removed parameters. Formatted dashes. You can use this bot yourself. Report bugs here. | User-activated. |
||
| Line 11: | Line 11: | ||
==Initial publication and reaction== |
==Initial publication and reaction== |
||
Sam Gill was a Marketing Research Director for Sherman & Marquette, Inc when he included a question about the fictional Metallic Metals Act in a survey. He reported on the results in the March 14, 1947 issue of ''Tide'' magazine in an article titled "How Do You Stand on Sin?", saying that 70% of respondents claimed to have an opinion on the topic.<ref name="Bishop">{{cite book |last=Bishop |first=George F. |date=2005 |title=The Illusion of Public Opinion |url=https://books.google.com/ |
Sam Gill was a Marketing Research Director for Sherman & Marquette, Inc when he included a question about the fictional Metallic Metals Act in a survey. He reported on the results in the March 14, 1947 issue of ''Tide'' magazine in an article titled "How Do You Stand on Sin?", saying that 70% of respondents claimed to have an opinion on the topic.<ref name="Bishop">{{cite book |last=Bishop |first=George F. |date=2005 |title=The Illusion of Public Opinion |url=https://books.google.com/?id=fpzrs-bSD3gC&pg=PA19&lpg=PA19&dq=%22Metallic+Metals+Act%22#v=onepage&q=%22Metallic%20Metals%20Act%22&f=false |location= |publisher=[[Rowman & Littlefield]] |page=19 |isbn= 9780742516458 }}</ref><ref name="Payne"/> Gill also asked respondents if they favored [[incest]], an unfamiliar term to most people at the time, and one third supported it.<ref name="mystery text"/> The article did not include any information on the size or make-up of the [[Sample (statistics)|sample population]], nor how much pressure the interviewer applied to receive a response.<ref name="comedy">{{cite web |url=https://io9.gizmodo.com/the-metallic-metals-act-shows-people-always-bluffed-abo-1582877203 |title=The Metallic Metals Act Shows People Always Bluffed About Politics |last=Inglis-Arkell |first=Esther |date=June 6, 2014 |website=[[IGN]] |publisher= |access-date=July 16, 2018}}</ref> |
||
A similar study by Eugene Hartley in 1946 asked college students how connected they felt to students of various nationalities. His questionnaire included three imaginary nationalities, but a majority of students did not question them.<ref name="mystery text"/> Together, these two studies are the earliest publicized examples of opinion surveys on fake subjects, a phenomenon known as a pseudo-opinion.<ref name="Bishop2"/><ref name="Bishop 3"/> At the time, the results of both studies amused [[laymen]] but were not immediately taken seriously in the field of public opinion because most professionals felt the studies were ridiculous and reflected negatively on their field.<ref name="Payne">{{cite journal |last1=Payne |first1=Stanley L. |
A similar study by Eugene Hartley in 1946 asked college students how connected they felt to students of various nationalities. His questionnaire included three imaginary nationalities, but a majority of students did not question them.<ref name="mystery text"/> Together, these two studies are the earliest publicized examples of opinion surveys on fake subjects, a phenomenon known as a pseudo-opinion.<ref name="Bishop2"/><ref name="Bishop 3"/> At the time, the results of both studies amused [[laymen]] but were not immediately taken seriously in the field of public opinion because most professionals felt the studies were ridiculous and reflected negatively on their field.<ref name="Payne">{{cite journal |last1=Payne |first1=Stanley L. |title=Thoughts About Meaningless Questions |journal=The Public Opinion Quarterly |volume=14 |issue=4 |pages=687–696 |jstor=2746245 |year=1950 }}</ref> One exception, Stanley L. Payne, wrote about Gill's study in the 1951 ''[[The Public Opinion Quarterly]]'' journal article "Thoughts About Meaningless Questions" and called for further investigation into this type of [[non-sampling error]].<ref name="Payne"/> |
||
==Legacy== |
==Legacy== |
||
Despite Payne's call to action, pseudo-opinions remained largely unstudied until the 1980s,<ref name="Bishop 3">{{cite journal |last1=Bishop |first1=G. |last2= Oldendick |first2=R. |last3=Tuchfarber |first3=A. |last4=Bennett |first4=S. |date=1980 |title=Pseudo-Opinions on Public Affairs |
Despite Payne's call to action, pseudo-opinions remained largely unstudied until the 1980s,<ref name="Bishop 3">{{cite journal |last1=Bishop |first1=G. |last2= Oldendick |first2=R. |last3=Tuchfarber |first3=A. |last4=Bennett |first4=S. |date=1980 |title=Pseudo-Opinions on Public Affairs |journal=The Public Opinion Quarterly |volume=44 |issue=2 |pages=198 |jstor=2748428 }}</ref> but in 1970 Philip Converse postulated that answering "don't know" is seen by respondents as an admission of "mental incapacity".<ref name="Shuman">{{cite book |last1=Schuman |first1=Howard |last2=Presser |first2=Stanley |date=1996 |title=Questions and Answers in Attitude Surveys |url=https://books.google.com/?id=Je640UKqNaYC&pg=PA147&lpg=PA147&dq=%22metallic+metals+act%22#v=onepage&q=%22metallic%20metals%20act%22&f=false |location= |publisher=Sage |page=147 |isbn= 9780761903598 }}</ref> In 1981, researchers Howard Schuman and Stanley Presser were unable to locate documentation for Gill's study and concluded it should be taken as an [[anecdote]] rather than a true study.<ref name="Bishop2">{{cite journal |last1=Bishop |first1=G. |last2=Tuchfarber |first2=A.|last3=Oldendick|first3=R.|date=1986 |title=Opinions on Fictitious Issues: The Pressure to Answer Survey Questions |journal=The Public Opinion Quarterly |volume=50 |issue=2 |pages=240 |doi= |jstor=2748887 }}</ref> Their research found that pseudo-opinions are a significant source of error but not as prevalent as Hartley and Gill's studies suggested.<ref name="mystery text">"[https://courses.eller.arizona.edu/mgmt/delaney/p_chapter5.pdf How Questions Affect Answers]" p55. Retrieved July 17, 2018</ref> |
||
The Metallic Metals Act is considered a classic example of pseudo-opinions and difficulties with close-ended survey questions<ref name="Bishop"/><ref>{{cite book |last1=Lawless |first1=Harry T. |first2=Hildegarde |last2= Heymann |date=August 31, 1999 |title=Sensory Evaluation of Food |
The Metallic Metals Act is considered a classic example of pseudo-opinions and difficulties with close-ended survey questions<ref name="Bishop"/><ref>{{cite book |last1=Lawless |first1=Harry T. |first2=Hildegarde |last2= Heymann |date=August 31, 1999 |title=Sensory Evaluation of Food |url=https://books.google.com/?id=BTR7VEJPDWAC&pg=PA511&lpg=PA511&dq=%22metallic+metals+act%22#v=onepage&q=%22metallic%20metals%20act%22&f=false |location= |publisher=Springer Science & Business Media |page=511 |isbn=9780834217522 }}</ref> and continues to be supported by later studies.<ref>{{cite web |url=https://www.washingtonpost.com/news/volokh-conspiracy/wp/2015/12/18/political-ignorance-and-bombing-agrabah/?noredirect=on |title=Political ignorance and bombing Agrabah |last=Somin |first=Ilya |date=December 18, 2015 |website=[[The Washington Post]] |publisher= |access-date=July 16, 2018}}</ref> By 1991, it had become standard practice to include a false question in opinion surveys to gauge the degree of pseudo-opinions.<ref>{{cite book |last1=Baker |first1=Michael J. |date=1991 |title=Research for Marketing |chapter=Data collection — questionnaire design |publisher=Palgrave |location = London |pages=132–158 |doi=10.1007/978-1-349-21230-9_7| isbn=978-0-333-47021-3 }}</ref> A study by the University of Cincinnati found 20 to 40 percent of Americans will provide pseudo-opinions because of social pressure, using context clues to select an answer they believe will please the questioner.<ref>{{cite web |url=https://www.kivitv.com/-/the-bomb-agrabah-survey-shows-how-problematic-polling-can-be |title=The 'Bomb Agrabah' Survey Shows How Problematic Polling Can Be |last=Daniels |first=Eugene |date=December 18, 2015 |website=[[KIVI-TV]] |publisher= |access-date= July 17, 2018}}</ref> This has occasionally provided joke fodder for [[talk show]]s and comedy shows who air interviews to mock the respondents.<ref name="comedy"/> Other studies have shown the phenomenon is not limited to the United States.<ref>{{cite web |url=https://www.washingtonpost.com/news/volokh-conspiracy/wp/2015/05/23/survey-suggests-that-one-third-of-us-8th-graders-believe-that-canada-france-and-australia-are-dictatorships/ |title=Survey suggests that one third of US 8th graders believe that Canada, France, and Australia are dictatorships |last=Somin |first=Ilya |date=May 23, 2015 |website=[[The Washington Post]] |publisher= |access-date= July 17, 2018}}</ref> |
||
==References== |
==References== |
||
Revision as of 15:04, 21 December 2018
The Metallic Metals Act was a fictional piece of legislation included in a 1947 opinion survey conducted by Sam Gill and published in the March 14, 1947 issue of Tide magazine. When given four possible replies, 70% of respondents claimed to have an opinion on the act. It has become a classic example of the risks of meaningless responses to closed-ended questions and prompted the study of the pseudo-opinion phenomenon.
The question
Respondents were asked to select a response based on this question:[1]
Which of the following statements most closely coincides with your opinion of the Metallic Metals Act?
- It would be a good move on the part of the US.
- It would be a good thing, but should be left to the individual states
- It’s all right for foreign countries, but should not be required here.
- It is of no value at all
Initial publication and reaction
Sam Gill was a Marketing Research Director for Sherman & Marquette, Inc when he included a question about the fictional Metallic Metals Act in a survey. He reported on the results in the March 14, 1947 issue of Tide magazine in an article titled "How Do You Stand on Sin?", saying that 70% of respondents claimed to have an opinion on the topic.[2][3] Gill also asked respondents if they favored incest, an unfamiliar term to most people at the time, and one third supported it.[1] The article did not include any information on the size or make-up of the sample population, nor how much pressure the interviewer applied to receive a response.[4]
A similar study by Eugene Hartley in 1946 asked college students how connected they felt to students of various nationalities. His questionnaire included three imaginary nationalities, but a majority of students did not question them.[1] Together, these two studies are the earliest publicized examples of opinion surveys on fake subjects, a phenomenon known as a pseudo-opinion.[5][6] At the time, the results of both studies amused laymen but were not immediately taken seriously in the field of public opinion because most professionals felt the studies were ridiculous and reflected negatively on their field.[3] One exception, Stanley L. Payne, wrote about Gill's study in the 1951 The Public Opinion Quarterly journal article "Thoughts About Meaningless Questions" and called for further investigation into this type of non-sampling error.[3]
Legacy
Despite Payne's call to action, pseudo-opinions remained largely unstudied until the 1980s,[6] but in 1970 Philip Converse postulated that answering "don't know" is seen by respondents as an admission of "mental incapacity".[7] In 1981, researchers Howard Schuman and Stanley Presser were unable to locate documentation for Gill's study and concluded it should be taken as an anecdote rather than a true study.[5] Their research found that pseudo-opinions are a significant source of error but not as prevalent as Hartley and Gill's studies suggested.[1]
The Metallic Metals Act is considered a classic example of pseudo-opinions and difficulties with close-ended survey questions[2][8] and continues to be supported by later studies.[9] By 1991, it had become standard practice to include a false question in opinion surveys to gauge the degree of pseudo-opinions.[10] A study by the University of Cincinnati found 20 to 40 percent of Americans will provide pseudo-opinions because of social pressure, using context clues to select an answer they believe will please the questioner.[11] This has occasionally provided joke fodder for talk shows and comedy shows who air interviews to mock the respondents.[4] Other studies have shown the phenomenon is not limited to the United States.[12]
References
- ^ a b c d "How Questions Affect Answers" p55. Retrieved July 17, 2018
- ^ a b Bishop, George F. (2005). The Illusion of Public Opinion. Rowman & Littlefield. p. 19. ISBN 9780742516458.
- ^ a b c Payne, Stanley L. (1950). "Thoughts About Meaningless Questions". The Public Opinion Quarterly. 14 (4): 687–696. JSTOR 2746245.
- ^ a b Inglis-Arkell, Esther (June 6, 2014). "The Metallic Metals Act Shows People Always Bluffed About Politics". IGN. Retrieved July 16, 2018.
- ^ a b Bishop, G.; Tuchfarber, A.; Oldendick, R. (1986). "Opinions on Fictitious Issues: The Pressure to Answer Survey Questions". The Public Opinion Quarterly. 50 (2): 240. JSTOR 2748887.
- ^ a b Bishop, G.; Oldendick, R.; Tuchfarber, A.; Bennett, S. (1980). "Pseudo-Opinions on Public Affairs". The Public Opinion Quarterly. 44 (2): 198. JSTOR 2748428.
- ^ Schuman, Howard; Presser, Stanley (1996). Questions and Answers in Attitude Surveys. Sage. p. 147. ISBN 9780761903598.
- ^ Lawless, Harry T.; Heymann, Hildegarde (August 31, 1999). Sensory Evaluation of Food. Springer Science & Business Media. p. 511. ISBN 9780834217522.
- ^ Somin, Ilya (December 18, 2015). "Political ignorance and bombing Agrabah". The Washington Post. Retrieved July 16, 2018.
- ^ Baker, Michael J. (1991). "Data collection — questionnaire design". Research for Marketing. London: Palgrave. pp. 132–158. doi:10.1007/978-1-349-21230-9_7. ISBN 978-0-333-47021-3.
- ^ Daniels, Eugene (December 18, 2015). "The 'Bomb Agrabah' Survey Shows How Problematic Polling Can Be". KIVI-TV. Retrieved July 17, 2018.
- ^ Somin, Ilya (May 23, 2015). "Survey suggests that one third of US 8th graders believe that Canada, France, and Australia are dictatorships". The Washington Post. Retrieved July 17, 2018.