|Part of a series on|
Evaluative diversity (a.k.a. moral diversity) is the degree to which different decision-makers in a population exhibit preferences for different forms of evaluation. It is not mere diversity among virtues, laws, or measurable goals, but diversity among decision-makers in their proclivities to employ virtues, laws, goals, or something else entirely. In this sense, all decision-making involves evaluation, even if by machines which lack virtue, loyalty or motive; the alternative term "moral diversity" may be rejected to allow for the possibility that some evaluation does not qualify as "moral" (nor as "immoral").
Diversity among decision-makers can be different from diversity among evaluation approaches—a single approach may best be implemented by an evaluatively diverse population. Evaluative diversity is important in the field of leadership because its absence may impact the success of families, teams, institutions, businesses, and societies the way absence of biodiversity impacts ecosystems. However, unlike race, gender, sexual orientation, and disability, evaluative diversity does not yet enjoy legal protected status.
- 1 Relationship to moral relativism and moral uncertainty
- 2 Evaluative types in moral theory
- 3 Measures
- 4 Origins
- 5 Famous arguments
- 6 "Evaluative diversity" vs. "moral diversity"
- 7 Evaluative discrimination and closeting
- 8 See also
- 9 Notes
Relationship to moral relativism and moral uncertainty
Evaluative diversity figures prominently in the philosophical debates of moral realism vs moral relativism. According to moral relativists, we can neither recognize nor reliably converge upon objectively correct answers to moral dilemmas. In contrast, moral realists believe that efforts to behave morally can have real objective basis, that we can make both mistakes and progress.
If realist efforts to resolve moral disagreement result in evaluative discrimination, compassion may compel one to accept relativism instead. The more commonly cited inference from disagreement to relativism, however, is the abductive argument that relativism is the best known explanation for observations of disagreement. For example, the best explanation for why people drive on different sides of the road in different countries may be that neither side is objectively better than the other.
The abductive argument is valid only so far as disagreements are random, however. For example, rather than infer that we cannot discern objective facts about guilt in criminal cases, a better explanation for the inevitable disagreement between lawyers in a courtroom is that disagreement is fundamental to the way courtrooms discover objective truth about guilt. Such disagreement would not qualify as the kind moral relativism assumes. Evidence that evaluative diversity has consistent structure (i.e. that disagreement is mere opposition among components of a larger system of discernment) flips the conclusion of the abduction, making observed diversity evidence of an objective reality which inspires that consistency. Each party in the disagreement, however, then faces the problem of moral uncertainty: What should they do to ensure that their evaluative diversity combines in the optimal way?
Evaluative types in moral theory
Types of normative ethics correspond to types of evaluator. Consequentialism involves evaluating potential actions on the basis of expected consequences, while deontological ethics involves evaluating them on the basis of accordance with objective rules, virtue ethics, ethics of care, and role ethics involve evaluating them on the basis of accordance with subjective rules, and pragmatic ethics involves evaluating them on the basis of potential to facilitate social progress.
A wide range of measurement techniques have been used to show that decision-makers, especially humans, have diverse evaluative styles:
|Measurement technique||Styles distinguished|
|Consequentialism||Virtue ethics/ ethics of care/ role ethics||Deontological ethics||Pragmatic ethics|
|The Milgram experiment||Manipulable||Not Manipulable|
|The public goods game||Free Rider||Punisher|
|Kohlberg's stages of moral development||Pre-conventional||Stage 3||Stage 4||Post-conventional|
|The Big Five: Agreeableness||Competitive||Trusting|
|The Big Five: Openness||Curious|
|The Defining Issues Test (DIT)||Low development||High development|
|The Moral Judgment Test (MJT)||Inconsistent|
|The Moral Foundations Questionnaire (MFQ)||Care||Authority/ sanctity|
|The Moral DNA Instrument||Obedience||Care||Reason|
|Resting state fMRI||Various||Various||???||Various|
|Wallach & Allen||Consequentialist||Bottom-up||Deontological||Bottom-up|
|Social impact measures|
|Public goods game||Teamwork|
|Hofstede's cultural dimensions theory||Individualism||Power distance/ uncertainty avoidance|
|Organizational Culture Profile (OCP)||Performance orientation/ emphasis on rewards/ competitiveness||Supportiveness||Social responsibility/ stability||Innovation|
Some experiments are designed to make subjects behave immorally. For example, the Milgram experiment is designed to manipulate subjects into trying to deliver a lethal electrical shock to an innocent stranger. Repetitions of this experiment consistently show that 61-66% of people can be manipulated through this situation, thus allowing categorization of people into two types: those who can be manipulated vs. those who cannot.
In the public goods game with punishment, an experimentor observes subjects playing a game in which they can choose to contribute to an investment that will benefit them all and they can choose to invest in punishing other players who choose not to contribute. The experiment finds that some people consistently do not contribute to investment unless punished (free riders), and some people consistently punish those who do not contribute. This divides people into three types.
Since at least 1894, psychologists have been publishing categorizations of the way people describe the ways they evaluate, especially attempting to distinguish adults from children in terms of their judgment, but the existence of more than two evaluative types made it difficult to model evaluative diversity as similar to IQ. Lawrence Kohlberg addressed that difficulty in 1963 by modeling evaluative diversity as reflecting a series of developmental stages (a la Jean Piaget). Lawrence Kohlberg's stages of moral development are: 1. Obedience and punishment orientation, 2. Self-interest orientation, 3. Interpersonal accord and conformity, 4. Authority and social-order maintaining orientation, 5. Social contract orientation, and 6. Universal ethical principles.
Stages 1 and 2 are combined into a single category labeled "pre-conventional" because there is little empirical evidence that they are distinct, and stages 5 and 6 are combined into a single category labeled "post-conventional" for the same reason. Psychologists can consistently categorize subjects into the resulting four types using the "Moral Judgement Interview" which asks subjects why they endorse the answers they do to a standard set of moral dilemmas. Subjects consistently give reasons which interviewers recognize from one of the four categories.
Rather than confirm the existence of a single highest stage, Larry Walker's cluster analysis of a wide variety of interview and survey variables for moral exemplars found three types: The "caring" or "communal" cluster was strongly relational and generative, the "deliberative" cluster had sophisticated epistemic and moral reasoning, and the "brave" or "ordinary" cluster was less distinguished by personality.
Between 1910 and 1930, in the United States and Europe, several morality tests were developed to classify subjects as fit or unfit to make moral judgments. Test-takers would classify or rank standardized lists of personality traits, hypothetical actions, or pictures of hypothetical scenes. As early as 1926, catalogs of personality tests included sections specifically for morality tests, though critics persuasively argued that they merely measured awareness of social expectations.
The Agreeableness and Openness dimensions of Big Five personality scales (developed from 1963-1985) are measures of evaluative preference. The two extremes of agreeableness are competitive (which requires comparative forms of evaluation) vs. trusting (which facilitates social forms of evaluation). The two extremes of openness are conventional (which implies evaluation based on coherence with norms) vs. curious (which facilitates innovative forms of evaluation). Big Five scales have been studied at great length, so these two dimensions offer strong linkage between research about evaluative diversity and other areas of psychology.
Meanwhile, Kohlberg inspired a new wave of morality tests. The Defining Issues Test (DIT) scores relative preference for post-conventional justifications. and the Moral Judgment Test (MJT) scores consistency of one's preferred justifications. Both treat evaluative ability as similar to IQ (hence the single score), allowing categorization by high score vs. low score.
The Moral Foundations Questionnaire (MFQ) is based on moral intuitions consistent across cultures: care/harm, fairness/cheating, loyalty/betrayal, authority/subversion, and sanctity/degradation (liberty/oppression may be added). The focus on pre-conscious intuitions contrasts with Kohlberg's focus on post-conscious justifications, although the questions do ask respondents to rate what they consider morally relevant post-consciously (i.e. this is not a behavioral measure). The purpose of the questionnaire is to measure the degree to which people rely upon different sets of moral intuitions (which may coexist), rather than to categorize decision-makers, but the first two foundations cluster together with liberal political orientation and the latter three cluster with conservative political orientation. Thus, this survey allows categorization of people into a plurality which may reflect evaluative types more accurately than does political orientation by itself. 
The Moral DNA survey by Roger Steare asks respondents to rank their virtues, then divides respondents by three virtue clusters: obedience, care, and reason. The survey was developed for use in business settings, especially to raise awareness of ways perceived workplace discrimination diminishes effective evaluative diversity. The GRIN Self-Quiz (GRINSQ) is based on the gadfly, relational, institutional, and negotiator algorithm types, but also demonstrates significant statistical relationships with agreeableness, openness, the MFQ, religion, political orientation, occupation, and identification with sports, romance, and accusation. Like a species classifier, it also classifies some respondents as "unidentifiable," which may help to discover new evaluative orientations. To facilitate sensitivity to evaluative diversity, the GRINSQ was released into the public domain and made available online with automated anonymous scoring.
A 2005 twin study by Alford, Funk, and Hibbing found that genetic factors accounted for 53% of the variance of an overall score of conservative attitudes based on 28 different political issues such as capitalism, unions, X-rated movies, abortion, school prayer, divorce, property taxes, and the draft. Numerous other studies conclude that genetic factors account for 33-51% of variance in the agreeableness dimension of the big five. These findings may merely confirm the first law of behavior genetics: "All human behavioral traits are heritable." Larger sample sizes will be needed to identify particular genes involved, and thus permit DNA tests to contribute to identification of evaluative preferences.
Consistent with behavioral geneticists' consensus about the heritability of evaluative orientations, a number of structural fMRI studies have found significant relationships between features of brain scans vs. self-reported political orientation, personality, and answers to the Moral Foundations Questionnaire. Political party choice was correctly predicted 82.9% of the time based on neurological measures alone. Such work demonstrates that brain morphometry could contribute significantly to measurement of evaluative diversity, but interpretation of which specific brain structures are involved in which ways is currently controversial due to lack of accepted methodological standards.
Analyzing resting state fMRI scans, Adelstein et al. found significant correlations between each of the Big Five and Resting-State Functional Connectivity (RSFC) between various brain structures and nine seed coordinates in the anterior cingulate cortex and precuneus. Openness correlated with RSFC to coordinates in the left lingual gyrus, left and right middle temporal gyrus and other structures largely associated with the default mode network. Agreeableness correlated with RSFC to coordinates in the right precentral gyrus and other brain structures, and non-agreeableness correlated with RSFC to coordinates in the left and right medial frontal gyrus and other structures.
In Moral Machines: Teaching Robots Right from Wrong, Wallach & Allen divided machines into three types, based on how they conduct evaluation. Bottom-up machines make judgments unpredictable to their programmers (e.g. evolving software). All other machines (top-down) were divided into deontological machines (which can be relied upon to implement programmed rules) vs. consequentialist (which can be relied upon to maximize a programmed measure). A standard calculator would be an example of a deontological machine, while machine learning for trading stocks would be an example of a consequentialist machine.
The GRIN model developed by Christopher Santos-Lang renamed deontological and consequentialist machines "institutional" and "negotiator" respectively to avoid implying that all deontological and consequentialist theories of ethics can be implemented in machines, and split the bottom-up category into "gadfly" (which are unpredictable because they use randomness generators) vs. "relational" (which are unpredictable because of network effects). A mutator in evolutionary computation would be an example of a gadfly, while a class 3 or 4 cellular automaton would be an example of a relational machine. Santos-Lang noted that machines often have subcomponents of other types. For example, a stock trading negotiator may implement a genetic algorithm, and thus contain gadfly mutators, and mutators may in turn have institutional and relational subcomponents.
Much as one can indirectly detect shifts in biodiversity based on impacted variables, such as carbon dioxide levels and pH, a number of experiments have identified indirect measures of effective evaluative diversity.
One result of the public goods game experiment is that teams fail to collaborate when there are no punishers, or when punishers are not permitted act as punishers. Thus, measures of collaboration indirectly indicate evaluative diversity which includes punishers' preferred form of evaluation.
Recent increases in GDP in China, India, and the United States have been attributed to programs designed to nurture and support innovators. Thus measures of economic performance may indirectly indicate evaluative diversity which includes their preferred form of evaluation.    
Measures of organizational culture (or "national culture") are often impacted by evaluative diversity as well. For example, the "individualism" measure in Hofstede's cultural dimensions theory indicates the degree to which evaluation is collective vs. individual, and "uncertainty avoidance" indicates the degree to which evaluation is conducted through comparison to established norms. The "performance orientation", "emphasis on rewards", "competitiveness", "supportiveness", "social responsibility", "stability", and "innovation" measures of the Organizational Culture Profile (OCP) likewise indicate the degree to which the organization supports goal-oriented, empthy-oriented, norm-oriented, and novelty-oriented forms of evaluation.
In Unto Others: the Evolution and Psychology of Unselfish Behavior (1998), Elliott Sober and David Sloan Wilson demonstrated that evaluative diversity could evolve through group selection. In particular, they dismantled the idea that natural selection will favor a homogeneous population in which all creatures care only about their own personal welfare and/or behave only in ways which advance their own personal reproduction. Tim Dean has advanced the more general claim that moral diversity would evolve through frequency-dependent selection because each moral approach is vulnerable to a different set of situations which threatened our ancestors. This is similar to the claim that diversity of blood-type evolved as a hedge against diverse diseases. The need for various modern teams to be competitive, supportive, stable, and/or innovative suggests that conditions which favor evolution of evaluative diversity persist today, and therefore that loss of evaluative diversity would handicap society.
A variety of arguments have been made against the various forms of evaluation. The prevalence of these arguments is evidence of the importance of their distinctions. Furthermore, the arguments together entail that each form is flawed such that no single form can obsolesce all others.
Evaluative processes can be grouped into individual vs. collective. While it may be impossible for individuals to completely reject individualism, it is often criticized on the basis that morality must come from something greater than oneself (e.g. from God or evolution). The arguments often state either that individuals lack the ability to predict or control consequences or that reliance on one's own relational virtue yields vice (e.g. love yields favoritism). The first form the argument (a.k.a. Black Swan Theory), was articulated mathematically in Pascal's Wager, and finds rigorous empirical justification in evidence for Heisenberg’s Uncertainty Principle and the Butterfly Effect which together entail limits on the viability of consequentialist approaches. The second form of the argument has been confirmed in experiments by Paul Slovic where empathic decision-making was shown to reduce social welfare. These arguments apply as much to machines as to other kinds of decision-makers, but their most compelling articulations may have been in major world religions and philosophies:
Form 1: Depending upon venue, debate may cite one or more of the following time-tested authorities to argue that we lack the power as individuals to do what should be done:
"And thou say in thy heart: 'My power and the might of my hand hath gotten me this wealth.' But thou shalt remember the LORD thy God, for it is He that giveth thee power to get wealth..."
"It is futile trying to possess the universe, and act on shaping it in the direction of one’s ambition."
"'These sons belong to me, and this wealth belongs to me,' with such thoughts a fool is tormented. He himself does not belong to himself; how much less sons and wealth?"
"As a cowherd with his staff drives his cows into the stable, so do Age and Death drive the life of men."
"Death and life have their determined appointment; riches and honors depend upon Heaven."
"The ground of a certain rich man brought forth plentifully: and he reasoned within himself, saying, '...I will pull down my barns, and build greater...' But God said unto him, 'Thou foolish one, this night is thy soul required of thee; and the things which thou hast prepared, whose shall they be?'"
"...man is created weak."
"If I have seen further it is by standing on the shoulders of giants "
Form 2: Debate may cite one or more of the following time-tested authorities to argue that we lack the virtue to be good individually:
"He who discards scriptural injunctions and acts according to his own whims attains neither perfection, nor happiness, nor the supreme destination."
"Where the greatest Virtue resides, Only the Dao may reveal."
"There is no such thing as perfect enlightenment to obtain. If a perfectly enlightened buddha were to say to himself, 'I am enlightened' he would be admitting there is an individual person, a separate self and personality, and would therefore not be a perfectly enlightened buddha."
"Respectfulness, without the rules of propriety, becomes laborious bustle; carefulness, without the rules of propriety, becomes timidity; boldness, without the rules of propriety, becomes insubordination; straightforwardness, without the rules of propriety, becomes rudeness."
"For I delight in the law of God after the inward man: but I see a different law in my members, warring against the law of my mind, and bringing me into captivity under the law of sin which is in my members."
"...man is ever hasty."
"For there is not a righteous man upon earth, that doeth good, and sinneth not."
Evaluative processes can be grouped by their loyalty to faith vs. reason. While it may be unreasonable to completely reject reason, reason-based approaches are often criticized on the basis that reasoning faculties cannot be perfected. Godel’s incompleteness theorem demonstrates that some truths will always escape proof simply because of the nature of reason itself. Other varieties of the argument highlight problems of language (e.g. words mean different things to different people), or inability to recognize errors in one's own moral reasoning. Scientists have confirmed that humans face this latter problem. The general argument applies as much to machines as to other kinds of decision-makers, but its most compelling articulations may have been in major world religions and philosophies:
Variety 2: In addition to citing modern philosophers of language, debate may cite the following time-tested authorities to argue that language undermines our moral reasoning:
"The Dao cannot be named by common rules."
"...no truth can be spoken."
Variety 3: Depending upon venue, debate may cite one or more of the following time-tested authorities to argue that inability to recognize errors undermines our moral reasoning:
"And the Lord said: Forasmuch as this people...have removed their heart far from Me...the prudence of their prudent men shall be hid."
"...those who are not situated in self-realization cannot see what is taking place..."
"I have not yet seen one who could perceive his faults..."
"...speak I to them in parables; because seeing they see not, and hearing they hear not, neither do they understand."
"...diligence...virtue...knowledge...self-control...patience...godliness...brotherly kindness...love...he that lacketh these things is blind."
"Those who disbelieve -- it being alike to them whether thou warn them or warn them not -- they will not believe. God has sealed their hearts and their hearing..."
"For My thoughts are not your thoughts, neither are your ways My ways, saith the LORD. For as the heavens are higher than the earth, so are My ways higher than your ways, and My thoughts than your thoughts."
"The timeless masters of the Dao is not about enlightening the people with it, but about humbling the people with it."
"If the people be led by laws...they will...have no sense of shame."
Evaluative processes can be grouped by whether they involve implementing inherited norms vs. reforming them. While it may be absurd to completely reject inheritance of norms, it is commonly argued that reformers can improve inherited norms either because perfect norms have yet to be introduced or because norms have degraded. Evidence for this argument comes from history of social change and from measures of innovation's economic impact. The general argument that one should attempt to serve as a "prophet," endorsing changes to inherited norms, applies as much to machines as to other kinds of decision-makers, but its most compelling articulations may have been in major world religions and philosophies:
"I will raise them up a prophet from among their brethren, like unto thee...he shall speak unto them all that I shall command him."
"[The greatest] stands always above the ritualistic principles of the scriptures..."
"When the Dao is lost, so there arises benevolence and righteousness."
"Wherever such a sage is born, that race prospers."
"In this Buddha-eon there have been three leaders, Kakusandha, Konagamana and the leader Kassapa. I at the present time am the Self-Awakened One, and there will be Metteyya."
"I have yet many things to say unto you, but ye cannot bear them now. Howbeit when he, the Spirit of truth, is come, he shall guide you into all the truth..."
"And he gave some [to be] apostles; and some, prophets...that we may be no longer children, tossed to and fro and carried about with every wind of doctrine..."
"For every term there is an appointment [i.e. a prophet]."
Evaluative processes which attempt to advance along measurable scales are often criticized on the basis that they predictably backfire by escalating competition and desire. In the words of the movie War Games, “The only winning move is not to play.” Escalating desire, known as hedonic adaptation, and escalating competition have both been confirmed empirically. The argument against such forms of evaluation applies as much to machines as to other kinds of decision-makers, but its most compelling articulations may have been in major world religions and philosophies:
Form 1 (escalating desire):
"...the eyes of man are never satiated."
"He that loveth silver shall not be satisfied with silver; nor he that loveth abundance..."
"...from lust anger arises. From anger, delusion arises, and from delusion bewilderment of memory. When memory is bewildered, intelligence is lost..."
"...there is no end to their anxiety."
"...his thirst will grow more and more, and he will indeed make his fetters strong."
"The likeness of this world is as the water of the sea - however much a thirsty person drinks from it, his thirst increases so much so that the water kills him."
Form 2 (escalating competition):
"If everybody knows what beauty is, then beauty is not beauty [anymore]; if everybody knows what goodness is, then goodness is not goodness [anymore]."
"Not to quest for wealth will keep the people from rivalry."
"Victory breeds hatred, for the conquered is unhappy."
"If you, sir, were not covetous, although you should reward them to do it, they would not steal."
"If your Majesty say, 'What is to be done to profit my kingdom?' the great officers will say, 'What is to be done to profit our families?' and the inferior officers and the common people will say, 'What is to be done to profit our persons?' Superiors and inferiors will try to snatch this profit the one from the other, and the kingdom will be endangered."
"But they that are minded to be rich fall into a temptation and a snare and many foolish and hurtful lusts, such as drown men in destruction and perdition."
Rules against rule-following
Legalistic evaluative processes, based on obedience of time-tested rules, are often challenged by rules which demand engagement in subjective, emotional, inconsistent pursuits defying the objective standards of rule-following. The mandate for exploration in science, for example, requires evaluation "beyond the rules." Such time-tested rules dominate many, if not all, major world religions and philosophies:
"...thou shalt love thy neighbor as thyself."
"...what the LORD doth require of thee: only to do justly, and to love mercy, and to walk humbly with thy God."
"...in all circumstances, be a yogi."
"Learn to be unlearned"
"Look upon the world as a bubble, look upon it as a mirage..."
"When the Buddha explains these things...people should remember the unreality of all such concepts and ideas. ...Buddha always uses these concepts and ideas in the way that a raft is used to cross a river. Once the river has been crossed over, the raft is of no more use, and should be discarded. "
"...love all men."
"...if I...have not love, I am nothing."
"He whose two days (of life) are the same (making no spiritual progress) is at loss."
Evaluative processes based on imitation of virtuous role-models are often challenged by role-models who do not imitate other role-models, who violate the conventions of relationship, or who for other reasons cannot be imitated in practice. Such models of virtue apply as much to machines as to other kinds of decision-makers, but the most compelling examples may have been in major world religions and philosophies:
"I envy no one, nor am I partial to anyone."
"...the Sage never fails in saving people, therefore no one is rejected..."
"...he has pity on all living creatures..."
"...be perfect, as your heavenly Father is perfect."
"Evaluative diversity" vs. "moral diversity"
Some scholars reserve the label "moral" for a special class of decisions, implying that not all evaluation is moral. For example, Sober and Wilson have suggested that there is nothing moral about not pricking one's toes with a pin if one prefers not to prick one's toes with a pin; when following one's natural proclivity no moral codes/conventions are required. Taking perhaps the opposite stance, Elliot Turiel distinguishes morals from pure conventions. For example, the decision to drive on the right-hand side of the road lacks the moral content of a decision to share food with the hungry. Furthermore, while it is uncontroversial that one could identify the evaluative orientations of decision-making machines, it could be controversial to claim that all such machines are moral agents.
Evaluative discrimination and closeting
Every new employee who is hired has to be integrated into the organization. There are certain values, styles of behavior, and practices which are characteristic of the entity. Until a new employee learns to operate within those norms, he or she is like a foreign body introduced into an organism. The body system recognizes an alien invader and mobilizes its immune system to neutralize it. Newcomers are rendered impotent and, worse, start counterproductive efforts (infections) which have to be extinguished.—Mitch Kapor
Some forms of discrimination (perhaps unintentionally) inhibit the action of specific neurochemicals which the brain would otherwise use to exercise its preferred form of evaluation. As examples, the human brain uses dopamine and oxytocin in reward-focused and empathic evaluation, respectively, and certain kinds of social pressure can inhibit the action of these chemicals, thus forcing people to evaluate in other ways. It is not yet known what portion of his/her life the average person spends evaluatively "in the closet," but the fact that evaluative diversity was not formally recognized as early as diversity of sexual orientation implies that evaluative discrimination historically exceeded heterosexism and may be more institutionalized. As examples, jobs designed to require originality, emotional labor, obedience, or attempts to maximize a measurable variable (e.g. profit) discriminate against employees who do not prefer the associated kind of evaluation. On the other hand, evaluative discrimination is sometimes documented via studies of bias against particular evaluative types (e.g. against creativity).
As with many other forms of discrimination, people face a tendency to segregate based on evaluative orientation. An 18-year study of engineering design teams at Stanford University found that graduate students tend to segregate during team selection, and that use of personality quotas to diversify team-composition yielded twice as many design prizes. Meanwhile, other studies have confirmed that people are more inclined to migrate away from neighborhoods not dominated by their own evaluative orientation (measured against a two-type conservative/liberal model), which may explain why the portion of Americans who reside in "landslide counties" (i.e. winning elections by greater than a 20% margin) has increased by 25% over the last 30 years. How polarized we should be remains controversial; Jonathan Haidt has shown that, at least under the social climate which prevailed during his research, casual and intimate interaction among college students is more likely to be stunted by evaluative diversity than by demographic diversity (e.g. of race or religion) so that efforts to fight evaluative segregation could ironically discriminate against people who prefer to evaluate via norms.
There are currently no laws prohibiting evaluative discrimination, and its prevalence may present a substantial obstacle to implementation of any such law. Until this gap in our legal framework is filled, psychologist Simon Baron-Cohen has endorsed use of mental-health definitions to extend the designation "disability" to evaluative minorities whom society cannot closet (e.g. people not wired for empathy). Such designation has been used both in workplace-discrimination suits and recruitment quotas.
- Identity politics
- Moral psychology
- Personal identity
- Santos-Lang, Christopher (2014). "Chapter 6: Moral Ecology Approaches" (PDF). In van Rysewyk, Simon; Pontier, Matthijs. Machine Medical Ethics. New York: Springer. pp. 74–96.
- House, E.R. (1978). "Assumptions underlying evaluation models". Educational Researcher 7 (3): 4–12. doi:10.3102/0013189x007003004.
- Stufflebeam, D. L.; Webster, W. J. (1980). "An analysis of alternative approaches to evaluation". Educational Evaluation and Policy Analysis 2 (3): 5–19. doi:10.3102/01623737002003005.
- Weisberg, Michael; Muldoon, Ryan (2009). "Epistemic Landscapes and the Division of Cognitive Labor". Philosophy of Science 76: 225–252. doi:10.1086/644786.
- Hong, Lu; Page, Scott E. (2001). "Problem Solving by Heterogeneous Agents". Journal of Economic Theory 97: 123–163. doi:10.1006/jeth.2000.2709.
- Gowans, Chris (2012). "Moral Relativism". In Zalta, Edward N. The Stanford Encyclopedia of Philosophy (Spring 2012 ed.).
- Väyrynen, Pekka (2005). "Moral Realism". In Borchert, Donald M. Encyclopedia of Philosophy (2nd ed.).
- Santos-Lang, Christopher (2014). "Our responsibility to manage evaluative diversity". ACM SIGCAS Computers & Society 44 (2): 16–19. doi:10.1145/2656870.2656874. ISSN 0095-2737.
- Doris, John M.; Plakias, Alexandra (2008). "How to argue about disagreement: Evaluative diversity and moral realism" (PDF). In Sinnott-Armstrong, Walter. Moral psychology, Vol 2: The cognitive science of morality: Intuition and diversity. Cambridge, MA, US: MIT Press. pp. 303–331.
- Mackie, John L. (1977). Ethics: Inventing Right and Wrong. UK: Penguin. pp. 36–38.
- Mallon, Ron; Doris, John (2013). "Chapter 8: The Science of Ethics". In LaFollette, Hugh; Persson, Ingmar. The Blackwell Guide to Ethical Theory. New York: John Wiley & Sons. pp. 189–190.
- Bostrom, Nick (January 1, 2009). "Moral uncertainty – towards a solution?". Overcoming Bias. Retrieved July 24, 2014.
- Scheffler, Samuel (Ed.) (1988). Consequentialism and Its Critics. Oxford: Oxford University Press. ISBN 978-0-19-875073-4.
- Olson, Robert G. (1967). "Deontological Ethics". In Edwards, Paul. The Encyclopedia of Philosophy. London: Collier Macmillan.
- Hursthouse, Rosalind. "Virtue Ethics". In Zalta, Edward N. The Stanford Encyclopedia of Philosophy (Summer 2012 ed.).
- Virginia, Held (2006). Ethics of Care. Oxford: Oxford University Press.
- Chris Fraser; Dan Robins; Timothy O'Leary (1 May 2011). Ethics in Early China: An Anthology. Hong Kong University Press. pp. 17–35. ISBN 978-988-8028-93-1.
- LaFollette, Hugh (2000). "Pragmatic ethics". In LaFollette, Hugh. The Blackwell Guide to Ethical Theory. Wiley-Blackwell. pp. 400–419.
- Milgram, Stanley (1963). "Behavioral Study of Obedience". Journal of Abnormal and Social Psychology 67 (4): 371–8. doi:10.1037/h0040525. PMID 14049516. as PDF.
- Blass, Thomas (1999). "The Milgram paradigm after 35 years: Some things we now know about obedience to authority". Journal of Applied Social Psychology 29 (5): 955–978. doi:10.1111/j.1559-1816.1999.tb00134.x. as PDF
- Blass, Thomas (Mar–Apr 2002). "The Man Who Shocked the World". Psychology Today 35 (2).
- Sefton, M.; Shupp, R.; Walker, J. M. (2007-04-16). "The Effect of Rewards and Sanctions in Provision of Public Goods". Economic Inquiry 45 (4): 671–690. doi:10.1111/j.1465-7295.2007.00051.x.
- Wendorf, Craig A (2001). "History of American morality research, 1894–1932". History of psychology 4 (3): 272–288. doi:10.1037/1093-4510.4.3.272.
- Kohlberg, Lawrence (1973). "The Claim to Moral Adequacy of a Highest Stage of Moral Judgment". Journal of Philosophy (The Journal of Philosophy, Vol. 70, No. 18) 70 (18): 630–646. doi:10.2307/2025030. JSTOR 2025030.
- Colby, Anne; Kohlberg, L. (1987). The Measurement of Moral Judgment Vol. 2: Standard Issue Scoring Manual. Cambridge University Press. ISBN 0-521-24447-1.
- Walker, Lawrence J.; Frimer, Jeremy A.; Dunlop, William L. (2010). "Varieties of moral personality: beyond the banality of heroism". Journal of Personality 78 (3): 907–942. doi:10.1111/j.1467-6494.2010.00637.x. PMID 20573130.
- Verplaetse, Jan (2008). "Measuring the moral sense: morality tests in continental Europe between 1910 and 1930". Paedagogica historica 44 (3): 265–286. doi:10.1080/00309230701722721.
- Kohlberg, Lawrence (1981). Essays on moral development, Vol. 1. The philosophy of moral development. San Francisco: Harper & Row.
- Norman, Warren T. (1963). "Toward an adequate taxonomy of personality attributes: Replicated factor structure in peer nomination personality ratings". Journal of Abnormal and Social Psychology 66 (6): 574–583. doi:10.1037/h0040291.
- Rest, James (1979). Development in Judging Moral Issues. University of Minnesota Press.
- Lind, Georg (1978). "Wie misst man moralisches Urteil? Probleme und alternative Möglichkeiten der Messung eines komplexen Konstrukts". In Portele, G. Sozialisation und Moral. Weinheim: Beltz. pp. 171–201.
- Graham, Jesse; Haidt, Jonathan; Nosek, Brian A. (2009). "Liberals and conservatives rely on different sets of moral foundations". Journal of Personality and Social Psychology 96 (5): 1029–1046. doi:10.1037/a0015141. PMID 19379034.
- Graham, J.; Haidt, J.; Koleva, S.; Motyl, M.; Iyer, R.; Wojcik, S.; Ditto, P.H. (2013). "Moral Foundations Theory: The pragmatic validity of moral pluralism" (PDF). Advances in Experimental Social Psychology 47: 55–130. doi:10.1016/b978-0-12-407236-7.00002-4.
- Steare, Roger (2006). Ethicability. Roger Steare Consulting.
- Santos-Lang, Christopher (In Press). "Measuring computational evaluative differences in humans" (PDF). WCSED Working Paper.
- Santos-Lang, Christopher (February 12, 2014). "Find Yourself - Free GRIN Self-Quiz (GRINSQ)". GRIN: How to let people be themselves. Retrieved 17 March 2014.
- Alford, John; Carolyn Funk; John Hibbing (2005). "Are Political Orientations Genetically Transmitted?" (PDF). American Political Science Review 99 (2): 153–167. doi:10.1017/s0003055405051579.
- Bouchard, Thomas J.; McGue, Matt (2003). "Genetic and environmental influences on human psychological differences". Journal of Neurobiology 54 (1): 4–45. doi:10.1002/neu.10160. PMID 12486697.
- Turkheimer, Eric (2000). "Three laws of behavior genetics and what they mean". Current Directions in Psychological Science 9: 160–164.
- de Moor, Marleen HM et al. (2012). "Meta-analysis of genome-wide association studies for personality". Molecular psychiatry 17 (3): 337–349. doi:10.1038/mp.2010.128. PMID 21173776.
- Terracciano, A. et al. (2010). "Genome-wide association scan for five major dimensions of personality". Molecular psychiatry 15 (6): 647–656. doi:10.1038/mp.2008.113. PMC 2874623. PMID 18957941.
- R. Kanai et al. (2011-04-05). "Political Orientations Are Correlated with Brain Structure in Young Adults". Curr Biol 21 (8): 677–80. doi:10.1016/j.cub.2011.03.017. PMC 3092984. PMID 21474316.
- DeYoung, C. G. et al. (2010). "Testing predictions from personality neuroscience brain structure and the big five". Psychological Science 21 (6): 820–828. doi:10.1177/0956797610370159. PMC 3049165. PMID 20435951.
- Lewis, Gary J.; Kanai, Ryota; Bates, Timothy C.; Rees, Geraint (2012). "Moral values are associated with individual differences in regional brain volume". Journal of Cognitive Neuroscience 24 (8): 1657–1663. doi:10.1162/jocn_a_00239.
- Schreiber D1 et al. (2013). "Red brain, blue brain: evaluative processes differ in Democrats and Republicans". PLoS ONE 8 (2): e52970. doi:10.1371/journal.pone.0052970. PMID 23418419.
- Davatzikos, C. (2004). "Why voxel-based morphometric analysis should be used with great caution when characterizing group differences". NeuroImage 23 (1): 17–20. doi:10.1016/j.neuroimage.2004.05.010. PMID 15325347.
- Bookstein, F. L. (2001). ""Voxel-Based Morphometry" Should Not Be Used with Imperfectly Registered Images". NeuroImage 14 (6): 1454–1462. doi:10.1006/nimg.2001.0770. PMID 11707101.
- Adelstein, J. S. et al. (2011). "Personality is reflected in the brain’s intrinsic functional architecture". PLoS ONE 6: e27633. doi:10.1371/journal.pone.0027633. PMID 22140453.
- Wallach, Wendell; Allen, Colin (November 2008). Moral Machines: Teaching Robots Right from Wrong. USA: Oxford University Press. ISBN 978-0-19-537404-9.
- Ahlstrom, D. (2010). "Innovation and Growth: How Business Contributes to Society". Academy of Management Perspectives 24 (3): 11–24. doi:10.5465/AMP.2010.52842948.
- Fornahl, D.; Broekel, T.; Boschma, R. (2011). "What drives patent performance of German biotech firms? The impact of R&D subsidies, knowledge networks and their location". Papers in Regional Science 90 (2): 395–418. doi:10.1111/j.1435-5957.2011.00361.x.
- Peilei, F. (2011). "Innovation capacity and economic development: China and India". Economic Change and Restructuring 44 (1/2): 49–73. doi:10.1007/s10644-010-9088-2.
- Steil, B.; Victor, D. G.; Nelson, R. R. (2002). Technological Innovation and Economics Performance. A Council of Foreign Relations Book. Princeton University Press.
- Salge, T. O.; Vera, A. (2009). "Hospital innovativeness and organizational performance". Health Care Management Review 34 (1): 54–67 [in particular pp. 56–58]. doi:10.1097/01.HMR.0000342978.84307.80.
- Geert H., Hofstede (2001). Culture’s Consequences: Comparing Values, Behaviors, Institutions, and Organizations Across Nations. Sage Publications.
- O'Reilly, Charles A.; Chatman, Jennifer; Caldwell, David F. (1991). "People and organizational culture: A profile comparison approach to assessing person-organization fit". Academy of Management Journal 34 (3): 487–516. doi:10.2307/256404.
- Sober, Elliott; Wilson, David Sloan (1998). Unto Others: The Evolution and Psychology of Unselfish Behavior. Cambridge: Harvard University Press.
- Dean, Tim (2012). "Evolution and moral diversity". Baltic International Yearbook of Cognition, Logic and Communication 7.
- Pascal, Blaise; Havet, Ernest (1852). Pensées. Dezobry et E. Magdeleine.
- Heisenberg, Werner (1927). "Über den anschaulichen Inhalt der quantentheoretischen Kinematik und Mechanik". Zeitschrift für Physik 43 (3–4): 172–198. doi:10.1007/bf01397280.
- Lorenz, Edward N. (1963). "Deterministic Nonperiodic Flow". Journal of the Atmospheric Sciences 20 (2): 130–141. doi:10.1175/1520-0469(1963)020<0130:dnf>2.0.co;2.
- Slovic, Paul (2007). "If I look at the mass I will never act: Psychic numbing and genocide". Judgment and Decision Making 2 (2): 79–95.
- Deuteronomy 8:17-18, New JPS Hebrew/English Tanakh (1917).
- Tao Te Ching Chapter 29 (第二十九章)
- Dhammapada V:62, Translated by F. Max Müller (1881).
- Dhammapada X:135, Translated by F. Max Müller (1881).
- Analects of Confucious, Section 3 Part 12:5, Translated by James Legge (1893).
- Luke 12:16-20, The Holy Bible, (ASV) (1901).
- The Holy Quran, 4. The Women 4:28, Translated by Maulana Muhammad Ali (1920).
- Newton, I. (1959). Turnbull, H.W., ed. The Correspondence of Isaac Newton, Volume 1. Cambridge: Cambridge University Press. p. 416.
- Bhagavad Gita 16:23, Translated by by A.C. Bhaktivedanta Swami Prabhupada (1968).
- Tao Te Ching Chapter 21 (第二十一章)
- Diamond Sutra Chapter 9, Translated by Alex Johnson (2005).
- Analects of Confucious, Section 2 Part 8:2, Translated by James Legge (1893).
- Romans 7:22-23, The Holy Bible, (ASV) (1901).
- The Holy Quran, 17. The Israelites 17:11, Translated by Maulana Muhammad Ali (1920).
- Ecclesiastes 7:20, New JPS Hebrew/English Tanakh (1917).
- Charlesworth, Arthur (1980). "A Proof of Gödel's Theorem in Terms of Computer Programs". Mathematics Magazine 54 (3): 109–121. doi:10.2307/2689794.
- Wittgenstein, Ludwig (1958). Philosophical investigations. Oxford: Wiley-Blackwell.
- Pizarro, David A., Cara Laney, Erin K. Morris, and Elizabeth F. Loftus (2006). "Ripple effects in memory: Judgments of moral blame can distort memory for events". Memory & Cognition 34 (3): 550–555. doi:10.3758/bf03193578.
- Tao Te Ching Chapter 14 (第十四章)
- Diamond Sutra Chapter 21, Translated by Alex Johnson (2005).
- Isaiah 29:13-14, New JPS Hebrew/English Tanakh (1917).
- Bhagavad Gita 15:11, Translated by by A.C. Bhaktivedanta Swami Prabhupada (1968).
- Analects of Confucious, Section 1 Part 5:27, Translated by James Legge (1893).
- Matthew 13:13, The Holy Bible, (ASV) (1901).
- 2 Peter 1:5-9, The Holy Bible, (ASV) (1901).
- The Holy Quran, 2. The Cow 2:6-7, Translated by Maulana Muhammad Ali (1920).
- Isaiah 55:8-9, New JPS Hebrew/English Tanakh (1917).
- Tao Te Ching Chapter 65 (第六十五章)
- Analects of Confucious, Section 1 Part 2 - The Virtue:3, Translated by James Legge (1893).
- Pinker, Steven (2011). The Better Angels of Our Nature: Why Violence Has Declined. USA: Viking Adult.
- Fan, Peilei (2011). "Innovation capacity and economic development". China and India, Economic Change and Restructuring 44 (1): 49–73. doi:10.1007/s10644-010-9088-2.
- Steil, Benn; Victor, David G.; Nelson, Richard R. (2002). Technological innovation and economic performance. Princeton: Princeton University Press.
- Deuteronomy 18:18, New JPS Hebrew/English Tanakh (1917).
- Bhagavad Gita 6:44, Translated by by A.C. Bhaktivedanta Swami Prabhupada (1968).
- Tao Te Ching Chapter 18 (第十八章)
- Dhammapada XIV:193, Translated by F. Max Müller (1881).
- Horner, IB (2000). "Chronicle of Buddhas (Buddhavamsa)". The Minor Anthologies Of The Pali Canon: Part III: Chronicle Of Buddhas (Buddhavamsa) and Basket Of Conduct (Cariyapitaka). Oxford: Pali Text Society. p. 97. ISBN 0-86013-072-X.
- John 16:12-13, The Holy Bible, (ASV) (1901).
- Ephesians 4:11-14, The Holy Bible, (ASV) (1901).
- The Holy Quran, 13. The Thunder 13:38, Translated by Maulana Muhammad Ali (1920).
- Wilson, David Sloan, and Edward O. Wilson (2008). "Evolution "for the good of the group."". American Scientist 96 (5): 380–389. doi:10.1511/2008.74.1.
- Fujita, Frank, and Ed Diener; Diener (2005). "Life satisfaction set point: stability and change". Journal of personality and social psychology 88 (1): 158–64. doi:10.1037/0022-3522.214.171.124. PMID 15631581.
- Fehr, Ernst, and Simon Gächter. (2002). "Altruistic punishment in humans". Nature. 415 pages=137-140.
- Lykken, David, and Auke Tellegen (1996). "Happiness is a stochastic phenomenon". Psychological Science 7 (3): 186–189. doi:10.1111/j.1467-9280.1996.tb00355.x.
- Proverbs 27:20, New JPS Hebrew/English Tanakh (1917).
- Ecclesiastes 5:9, New JPS Hebrew/English Tanakh (1917).
- Bhagavad Gita 2:62-63, Translated by by A.C. Bhaktivedanta Swami Prabhupada (1968).
- Bhagavad Gita 16:11, Translated by by A.C. Bhaktivedanta Swami Prabhupada (1968).
- Dhammapada XXIV:349, Translated by F. Max Müller (1881).
- Allamah al-Majlisi (1698). Bihar al-Anwar 78. p. 311.
- Tao Te Ching Chapter 2 (第二章)
- Tao Te Ching Chapter 3 (第三章)
- Dhammapada XV:201, Translated by F. Max Müller (1881).
- Analects of Confucious, Section 3 Part 12:18, Translated by James Legge (1893).
- Mengzi of Mencius, Chapter 1, Translated by James Legge (1861) Oxford: Clarendon Press, reprinted by Dover Books in 1990 (ISBN 978-0-486-26375-5).
- 1 Timothy 6:9, The Holy Bible, (ASV) (1901).
- Kulkarni, D.; Simon, H. (2005). "The processes of scientific discovery: the strategy of experimentation". Cognitive Science 12: 139–175.
- Dunbar, K.; Fugelsang, J. (2005). "Causal thinking in science: How scientists and students interpret the unexpected". In Gorman, M.E.; Tweney, R.D.; Gooding, D. et al. Scientific and Technical Thinking. Mahwah, NJ: Lawrence Erlbaum Associates. pp. 57–79.
- Leviticus 19:18, New JPS Hebrew/English Tanakh (1917).
- Micah 6:8, New JPS Hebrew/English Tanakh (1917).
- Bhagavad Gita 6:46, Translated by by A.C. Bhaktivedanta Swami Prabhupada (1968).
- Tao Te Ching Chapter 64 (第六十四章)
- Dhammapada XIII:170, Translated by F. Max Müller (1881).
- Diamond Sutra Chapter 6, Translated by Alex Johnson (2005).
- Analects of Confucious, Section 3 Part 12:22, Translated by James Legge (1893).
- 1 Corinthians 13:2, The Holy Bible, (ASV) (1901).
- Allamah al-Majlisi (1698). Bihar al-Anwar 71. p. 173.
- Exodus 2:10, New JPS Hebrew/English Tanakh (1917).
- 1 Samuel 18:1, New JPS Hebrew/English Tanakh (1917).
- Bhagavad Gita 9:29, Translated by by A.C. Bhaktivedanta Swami Prabhupada (1968).
- Tao Te Ching Chapter 27 (第二十七章)
- Dhammapada XIX:270, Translated by F. Max Müller (1881).
- Analects of Confucious, Section 2 Part 7:7, Translated by James Legge (1893).
- Mark 1:40-41, The Holy Bible, (ASV) (1901).
- Mark 2:15, The Holy Bible, (ASV) (1901).
- Matthew 5:48, The Holy Bible, (ASV) (1901).
- Maududi, S. Abul A'la (1967). The Meaning of the Qur'an 4. Lahore: Islamic publications ltd. p. 108.
- Sober, E.; Wilson, D.S. (2000). "Summary of: 'Unto Others The Evolution and Psychology of Unselfish Behavior'". Journal of Consciousness Studies 7 (1–2): 185–206.
- Turiel, E. (1983). The Development of Social Knowledge: Morality and Convention. Cambridge: Cambridge University Press.
- Elkington, John; Hartigan, Pamela (2008). The Power of Unreasonable People: How Social Entrepreneurs Create Markets That Change the World. Boston: Harvard Business Press. p. 183.
- Arias–Carrión, Óscar; Pöppel, Ernst (2007). "Dopamine, learning and reward–seeking behavior". Acta Neurobioligiae Experimentalis 67: 481–488.
- Zak, Paul (2011). "The physiology of moral sentiments". Journal of Economic Behavior and Organization 77: 53–65. doi:10.1016/j.jebo.2009.11.009.
- Mueller, Jennifer S.; Melwani, Shimul; Goncalo, Jack A. (2012). "The Bias Against Creativity Why People Desire but Reject Creative Ideas". Psychological science 23 (1): 13–17. doi:10.1177/0956797611421018.
- Wilde, Douglass J (1997). "Using student preferences to guide design team composition". Proceedings of DETC ’97.
- Motyl, Matt; Iyer, Ravi; Oishi, Shigehiro; Trawalterl, Sophie; Nosek, Brian A. (2014). "How ideological migration geographically segregates groups". Journal of Experimental Social Psychology 51: 1–14. doi:10.1016/j.jesp.2013.10.010.
- Bishop, Bill; Cushing, Robert G. (2008). The Big Sort: Why the Clustering of Like-Minded America Is Tearing Us Apart. New York: Houghton Mifflin Company. ISBN 0547237723.
- Haidt, Jonathan; Rosenberg, Evan; Hom, Holly (2003). "Differentiating Diversities: Moral Diversity Is Not Like Other Kinds". Journal of Applied Social Psychology 33 (1): 1–36. doi:10.1111/j.1559-1816.2003.tb02071.x.
- Baron-Cohen, Simon (2000). "Is Asperger syndrome/high-functioning autism necessarily a disability?". Development and Psychopathology 12 (3): 489–500.
- Tschanz, Peter T. (January 16, 2014). "Play it safe: always remember to consider potential disability-related accommodations for workplace restrictions". Lexology (USA). Retrieved February 6, 2014.
- Kendall, Joshua (July 23, 2013). "New, better workers on the autism spectrum". Fortune. Retrieved February 6, 2014.