{"id":4095,"date":"2017-03-10T10:55:05","date_gmt":"2017-03-10T09:55:05","guid":{"rendered":"http:\/\/cognitionandculture.local\/?p=4095"},"modified":"2023-08-07T15:42:16","modified_gmt":"2023-08-07T13:42:16","slug":"conviction-persuasion-and-manipulation-the-ethical-dimension-of-epistemic-vigilance","status":"publish","type":"post","link":"https:\/\/cognitionandculture.local\/blogs\/johannes-mahr\/conviction-persuasion-and-manipulation-the-ethical-dimension-of-epistemic-vigilance\/","title":{"rendered":"Conviction, persuasion and manipulation: the ethical dimension of epistemic vigilance"},"content":{"rendered":"

In today\u2019s political climate moral outrage about (alleged) propaganda and manipulation of public opinion dominate our discourse. Charges of manipulative information provision have arguably become the most widely used tool to discredit one\u2019s political opponent. Of course, one reason for why such charges have become so prominent is that the way we consume information through online media has made us more vulnerable than ever to such manipulation. Take a recent story<\/a> published by The Guardian, which describes the strategy of information dissemination allegedly used by the British \u2018Leave Campaign\u2019:<\/p>\n

“The strategy involved harvesting data from people\u2019s Facebook and other social media profiles and then using machine learning to \u2018spread\u2019 through their networks. Wigmore admitted the technology and the level of information it gathered from people was \u2018creepy\u2019. He said the campaign used this information, combined with artificial intelligence, to decide who to target with highly individualised advertisements and had built a database of more than a million people.”<\/p><\/blockquote>\n

This might not just strike you as \u201ccreepy\u201d but as simply unethical just as it did one commentator cited in the article who called these tactics \u201cextremely disturbing and quite sinister\u201d. Here, I want to investigate where this intuition comes from.<\/p>\n

We can distinguish different ways one can go about changing someone else\u2019s mind:<\/strong><\/p>\n

(1) by providing arguments,<\/p>\n

(2) by appealing to epistemic trust (i.e. claims to expertise and epistemic authority),<\/p>\n

and<\/p>\n

(3) by exploiting how our cognitive mechanisms have evolved\/developed to process information in general. For example, by directing attention in a certain way or by creating\/triggering semantic associations between different contents (e.g. pairing an image of a happy family with a specific brand of car or by using terms such as \u2018flood\u2019 to describe migratory movements of people).<\/p>\n

While in (1) and (2) one interacts with one\u2019s audience\u2019s cognitive machinery charged with evaluating critically what information to endorse (so-called epistemic vigilance mechanisms) in (3) one bypasses this machinery by exploiting the way that our cognitive system is designed to process information in general. For the purposes of this entry, I want to call (1) conviction, (2) persuasion and (3) manipulation. Put in these terms, the question I want to address here is why manipulation in contrast to conviction and persuasion often strikes us as ethically wrong.<\/p>\n

One thing that bears mentioning right away is that the distinction between (1), (2) and (3) is not simply one between verbally communicated information and non-verbally communicated information. A political speech, say, can be manipulative while still employing arguments and appeals to epistemic trust explicitly. One distinction that is of importance here, however, is that of ostensively vs. non-ostensively communicated information. Manipulation, by definition, can never be ostensive since this would imply that the speaker intends her audience to know about her intention to manipulate. Manipulation is thus by default non-ostensive.<\/p>\n

Why and how is manipulation ethically problematic?<\/strong><\/p>\n

Nonetheless, when I ask the question why manipulation should be ethically problematic, I am talking of course about intentional<\/em> manipulation. In interacting with others, we always rely on their general cognitive capacities and the tendencies through which these capacities have evolved to process information. If we took \u2018manipulation\u2019 in this sense to be unethical, much of our interactions with others would be, too.<\/p>\n

So why do we intuitively take intentional manipulation (i.e. non-ostensive forms of \u2018mind changing\u2019) to be ethically problematic? I want to suggest that this has to do with the kind of commitments that underlie communicative interaction. When I make an ostensive (i.e. explicit) claim, I thereby not only convey information but also take responsibility for its truth: I make myself accountable<\/em>.<\/p>\n

This analysis applies to conviction and persuasion in different ways. In conviction\/argumentation, one provides an argument, which is intended to trigger specific inferences in one\u2019s audience based on what that audience already believes. This minimizes the extent to which the audience has to trust the speaker. Nonetheless argumentation relies on assertions to some extent, which always force the speaker to commit herself to the truth of whatever she is stating.<\/p>\n

Persuasion, on the other hand, works only because of the commitments involved: whenever a speaker claims epistemic authority of some kind, this claim is only effective to the extent to which she makes herself accountable for the truth of her utterances. Crucially, it is rare that conviction and persuasion occur entirely apart from each other: we commonly rely on epistemic authority in our arguments.<\/p>\n

Manipulation differs exactly in that there is neither an explicit claim to be evaluated nor does the manipulator incur any commitment towards her target. When I create an implicit association between immigration and terrorism, for example, by mentioning both words in the same sentence, I have thereby not committed to any such association indeed existing. In this sense, manipulation crucially differs from lying since a lie always consists in an explicit claim, which commits the speaker to its truth. Manipulation intentionally shortcuts those cognitive mechanisms designed to evaluate and keep track of such commitments. The reason we take manipulation to be unethical then is because it comes with some of the benefits of persuasion and conviction without their respective costs.<\/p>\n","protected":false},"excerpt":{"rendered":"

In today\u2019s political climate moral outrage about (alleged) propaganda and manipulation of public opinion dominate our discourse. Charges of manipulative information provision have arguably become the most widely used tool to discredit one\u2019s political opponent. Of course, one reason for why such charges have become so prominent is that the way we consume information through […]<\/p>\n","protected":false},"author":1653,"featured_media":4097,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[269],"tags":[],"acf":[],"yoast_head":"\nConviction, persuasion and manipulation: the ethical dimension of epistemic vigilance - International Cognition and Culture Institute<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"http:\/\/cognitionandculture.local\/blogs\/johannes-mahr\/conviction-persuasion-and-manipulation-the-ethical-dimension-of-epistemic-vigilance\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Conviction, persuasion and manipulation: the ethical dimension of epistemic vigilance - International Cognition and Culture Institute\" \/>\n<meta property=\"og:description\" content=\"In today\u2019s political climate moral outrage about (alleged) propaganda and manipulation of public opinion dominate our discourse. Charges of manipulative information provision have arguably become the most widely used tool to discredit one\u2019s political opponent. Of course, one reason for why such charges have become so prominent is that the way we consume information through […]\" \/>\n<meta property=\"og:url\" content=\"http:\/\/cognitionandculture.local\/blogs\/johannes-mahr\/conviction-persuasion-and-manipulation-the-ethical-dimension-of-epistemic-vigilance\/\" \/>\n<meta property=\"og:site_name\" content=\"International Cognition and Culture Institute\" \/>\n<meta property=\"article:published_time\" content=\"2017-03-10T09:55:05+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-08-07T13:42:16+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/cognitionandculture.local\/wp-content\/uploads\/post-1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"900\" \/>\n\t<meta property=\"og:image:height\" content=\"720\" \/>\n<meta name=\"twitter:card\" content=\"summary\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\">\n\t<meta name=\"twitter:data1\" content=\"Johannes Mahr\">\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\">\n\t<meta name=\"twitter:data2\" content=\"3 minutes\">\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/cognitionandculture.local\/#website\",\"url\":\"https:\/\/cognitionandculture.local\/\",\"name\":\"International Cognition and Culture Institute\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":\"https:\/\/cognitionandculture.local\/?s={search_term_string}\",\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"ImageObject\",\"@id\":\"http:\/\/cognitionandculture.local\/blogs\/johannes-mahr\/conviction-persuasion-and-manipulation-the-ethical-dimension-of-epistemic-vigilance\/#primaryimage\",\"inLanguage\":\"en-GB\",\"url\":\"https:\/\/cognitionandculture.local\/wp-content\/uploads\/post-1.jpg\",\"width\":900,\"height\":720},{\"@type\":\"WebPage\",\"@id\":\"http:\/\/cognitionandculture.local\/blogs\/johannes-mahr\/conviction-persuasion-and-manipulation-the-ethical-dimension-of-epistemic-vigilance\/#webpage\",\"url\":\"http:\/\/cognitionandculture.local\/blogs\/johannes-mahr\/conviction-persuasion-and-manipulation-the-ethical-dimension-of-epistemic-vigilance\/\",\"name\":\"Conviction, persuasion and manipulation: the ethical dimension of epistemic vigilance - International Cognition and Culture Institute\",\"isPartOf\":{\"@id\":\"https:\/\/cognitionandculture.local\/#website\"},\"primaryImageOfPage\":{\"@id\":\"http:\/\/cognitionandculture.local\/blogs\/johannes-mahr\/conviction-persuasion-and-manipulation-the-ethical-dimension-of-epistemic-vigilance\/#primaryimage\"},\"datePublished\":\"2017-03-10T09:55:05+00:00\",\"dateModified\":\"2023-08-07T13:42:16+00:00\",\"author\":{\"@id\":\"https:\/\/cognitionandculture.local\/#\/schema\/person\/e1cfa578d132cee5df0b2cbc10e51d55\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"http:\/\/cognitionandculture.local\/blogs\/johannes-mahr\/conviction-persuasion-and-manipulation-the-ethical-dimension-of-epistemic-vigilance\/\"]}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/cognitionandculture.local\/#\/schema\/person\/e1cfa578d132cee5df0b2cbc10e51d55\",\"name\":\"Johannes Mahr\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/cognitionandculture.local\/#personlogo\",\"inLanguage\":\"en-GB\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/a5968879aa6a8f184bfcddde5aa0eaec?s=96&d=http%3A%2F%2Fcognitionandculture.local%2Fwp-content%2Fthemes%2Fbelle%2Fuser.png&r=g\",\"caption\":\"Johannes Mahr\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"https:\/\/cognitionandculture.local\/wp-json\/wp\/v2\/posts\/4095"}],"collection":[{"href":"https:\/\/cognitionandculture.local\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cognitionandculture.local\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cognitionandculture.local\/wp-json\/wp\/v2\/users\/1653"}],"replies":[{"embeddable":true,"href":"https:\/\/cognitionandculture.local\/wp-json\/wp\/v2\/comments?post=4095"}],"version-history":[{"count":1,"href":"https:\/\/cognitionandculture.local\/wp-json\/wp\/v2\/posts\/4095\/revisions"}],"predecessor-version":[{"id":17801,"href":"https:\/\/cognitionandculture.local\/wp-json\/wp\/v2\/posts\/4095\/revisions\/17801"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cognitionandculture.local\/wp-json\/wp\/v2\/media\/4097"}],"wp:attachment":[{"href":"https:\/\/cognitionandculture.local\/wp-json\/wp\/v2\/media?parent=4095"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cognitionandculture.local\/wp-json\/wp\/v2\/categories?post=4095"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cognitionandculture.local\/wp-json\/wp\/v2\/tags?post=4095"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}