![\"\"](\"https:\/\/esse.ca\/wp-content\/uploads\/2019\/01\/95-DO-IM_Bollmer_deboulogne_2-CMYK-scaled.jpeg\")
<\/strong>Experiments in physiology. Facial expressions.
<\/em>Photo: Wellcome Collection<\/figcaption><\/figure>\n<\/div>\n\n\n\n
![\"\"](\"https:\/\/esse.ca\/wp-content\/uploads\/2019\/01\/95-DO-IM_Bollmer_duchennedeboulogne_CMYK-scaled.jpeg\")
<\/strong>Experiments in physiology. Facial expressions.
<\/em>Photo: Wellcome Collection<\/figcaption><\/figure>\n<\/div>\n<\/div>\n\n\n\n
These technological systems cannot be challenged by dismissing their interpretations as incorrect. \u201cThe invisible world of images isn\u2019t simply an alternative taxonomy of visuality,\u201d Paglen argues. \u201cIt is an active, cunning, exercise of power, one ideally suited to molecular police and market operations\u200a\u2014\u200aone designed to insert its tendrils into ever-\u00adsmaller slices of everyday life.\u201d1<\/sup><\/a><\/span> 1 <\/a> - Trevor Paglen, \u201cInvisible Images (Your Pictures Are Looking at You),\u201d The New Inquiry, December 8, 2016, https:\/\/thenewinquiry.com\/invisible-images-your-pictures-are-looking-at-you\/.<\/span> That computer vision may not classify faces accurately (at least, according to human perception) does little to change how these algorithms are used by social media monopolies, governments, and law enforcement in the service of an impersonal and automatic perpetuation of discrimination built into technology.2<\/sup><\/a><\/span> 2 <\/a> - Cf. Safiya Umoja Noble, Algorithms of Oppression: How Search Engines Reinforce Racism (New York: NYU Press, 2018).<\/span>These automated systems of vision are tasked with the generation of objective truth, as if their indifference to and differentiation from human perception performs their objectivity.3<\/sup><\/a><\/span> 3 <\/a> - For an elaboration of an argument similar to this, see my book Inhuman Networks: Social Media and the Archaeology of Connection (New York: Bloomsbury, 2016).<\/span><\/p>\n\n\n\n Paglen\u2019s concern is with the military and the police, and with how the visual culture of digital media, so pervasively utilized by these agencies of control, has been divorced from human systems of vision\u200a\u2014\u200aa concern similar to that of other artists who engage with digital media, such as James Bridle, Adam Harvey, Zach Blas, and Steyerl herself. But the technologies for emotion recognition that Paglen uses in Machine Readable Hito also point us to how surveillance is bound up with something that may seem completely beyond the politics of state control\u200a\u2014\u200athe psychology of empathy. It\u2019s this link between the automation of vision and empathy that I want to highlight, and this requires that I look at the history of facial emotion in psychology and how this history relates to current psychological research on empathy. <\/p>\n\n\n\n Although a work such as Machine Readable Hito<\/em> speaks to the regime of visuality defined by computational algorithms and how this regime relates to surveillance, it also speaks to how\u200a\u2014\u200aat a time when empathy seems to be in crisis\u200a\u2014\u200acomputational systems that overlap with police control are also used to modulate and manage the possibilities for empathetic understanding.<\/p><\/blockquote><\/figure>\n<\/div>\n\n\n\n Almost all of the emotions identified by machine-vision algorithms are derived from the work of psychologists Paul Ekman and Wallace Friesen\u200a\u2014\u200aspecifically, their Facial Action Coding System. FACS, as it is known, which classifies the face into the movements of individual muscles, called \u201caction units,\u201d and then identifies specific arrangements of action units to determine, from facial expression alone, what someone is feeling or whether or not someone is lying. FACS has long been foundational for technological systems of emotion detection4<\/sup><\/a><\/span> 4 <\/a> - Kelly Gates, Our Biometric Future: Facial Recognition Technology and the Culture of Surveillance (New York: NYU Press, 2011).<\/span> and has been instrumental in perpetuating a questionable model that suggests a range of emotions that is experienced by everyone, interpreted universally, displayed equivalently on the faces of all members of humanity.5<\/sup><\/a><\/span> 5 <\/a> - For a thorough critique of this model of emotion, see Ruth Leys, The Ascent of Affect: Genealogy and Critique (Chicago: University of Chicago Press, 2017).<\/span> These emotions usually include anger, disgust, fear, happiness, sadness, and surprise, which\u200a\u2014\u200abecause of the link between computational systems for recognizing and representing facial emotion\u200a\u2014\u200aare the same emotions in systems like Microsoft\u2019s.<\/p>\n\n\n\n The emotions that FACS categorizes\u200a\u2014\u200aand that are algorithmically identified on Hito Steyerl\u2019s face\u200a\u2014\u200acan be traced back to a textbook by psychologist Robert S. Woodworth, Experimental Psychology, originally published in 1938. Woodworth reviewed a number of studies on the facial expression of emotion and, in repeating studies for quantifiable verifiability, reduced all facial expressions to six categories that may seem to refer to vastly different experiences: Love (which was also Happiness and Mirth), Surprise, Fear (which was also Suffering), Anger (which was also Determination), Disgust, and Contempt. These six categories were chosen because they satisfied requirements for quantitative verifiability, and little else.6<\/sup><\/a><\/span> 6 <\/a> - My comments here are based on the revised version of this textbook that Robert S. Woodworth coauthored with Harold Schlosberg, Experimental Psychology, rev. ed. (London: Methuen & Co. Ltd., 1954), 112\u200a\u2014\u200a19.<\/span><\/p>\n\n\n\n Psychologists such as Woodworth were primarily concerned with an observer\u2019s ability to judge posed emotions correctly, following some claims by Darwin (who relied on the photographs of Duchenne de Boulogne) suggesting that facial expressions are evolutionary mechanisms that allow us to understand the experience of another via external appearance.7<\/sup><\/a><\/span> 7 <\/a> - Charles Darwin, The Expression of the Emotions in Man and Animals (New York: D. Appleton and Company, 1897).<\/span> Sets of images (usually from Germany) created to train artists to accurately represent the passions portrayed by the human face were imported into American psychology to be used as material for experiments that asked if people could accurately determine the emotion signified by a particular facial expression.<\/p>\n\n\n\n Subjects in these experiments rarely agreed on the interpretation of a particular facial expression. But, repeatedly, these psychologists assumed that the inability of observers to agree on emotions represented in photographs was a problem for the observers, not of the photographs, not of the simulation of emotion in the photographs. This follows from a broader cultural shift that occurred in the late 1800s and early 1900s regarding how photographs were understood as evidence.8<\/sup><\/a><\/span> 8 <\/a> - Joel Snyder, \u201cRes Ipsa Loquitur,\u201d in Things that Talk: Object Lessons from Art and Science, ed. Lorraine Daston (New York: Zone Books, 2008), 195\u200a\u2014\u200a221.<\/span> Yet disagreement among observers over interpreting and identifying emotion persisted until subjects were forced into choosing from a limited set of possible affects to classify the expressions that images represented\u200a\u2014\u200athe limited choices identified by Woodworth in Experimental Psychology. The computational analysis of facial expression further removes these problems of subjective judgment. As Paglen suggests, it\u2019s the algorithmic classifications of Machine Readable Hito <\/em>that possess the force of objectivity, not the visual image.<\/p>\n\n\n\n The psychology of emotion was derived from a particular use of photography, one that suggested that standard categories for grouping photographs would reveal how visual interpretations of faces allowed observers access to the emotional states of others. This is, perhaps, one way to define what empathy is. Empathy did not originate as a psychological construct. Rather, it was imported into psychology via German aesthetic theory from the late 1800s and early 1900s and its discussion of Einf\u00fchlung, developed to describe a kind of mirroring or \u201c\u00adfeeling-into\u201d that one experienced when looking at a particularly moving work of art\u200a\u2014\u200aor another human. As Einf\u00fchlung evolved into the psychological concept of empathy, it expanded to describe all human relations, though\u200a\u2014\u200ain part because of challenges within psychology, \u00adwithin philosophy, and within aesthetic debates that opposed naturalistic \u201cfeeling-into\u201d with modernist alienation\u200a\u2014\u200aempathy was often sidelined as a construct until around the 1970s.9<\/sup><\/a><\/span> 9 <\/a> - Grant Bollmer, \u201cGaming Formalism and the Aesthetics of Empathy,\u201d Leonardo Electronic Almanac (forthcoming).<\/span> Although empathy is a difficult concept to properly discuss, as it has so many subtly different definitions, since the 1970s, it has been used to describe a set of psychological disorders defined by an inability to correlate facial expression with the neurological means for experiencing specific emotional states. Autism, psychopathy, and borderline personality disorder\u200a\u2014\u200athe three major psychological conditions defined in this way\u200a\u2014\u200aare all thought to be produced by some disruption in the ability to see another\u2019s facial expression and either mirror it or \u201cknow\u201d in one\u2019s mind what that expression signifies, internally.10<\/sup><\/a><\/span> 10 <\/a> - Grant Bollmer, \u201cPathologies of Affect: The \u2018New Wounded\u2019 and the Politics of Ontology,\u201d Cultural Studies 28, no. 2 (2014): 298\u200a\u2014\u200a326.<\/span> Elsewhere, empathy has been linked to the assumed existence of \u201cmirror neurons\u201d that permit the brain to mirror the emotional states of others\u200a\u2014\u200ain spite of the fact that mirror neurons, while they exist in macaque monkeys, have not been proved to exist as part of the human brain. Regardless, empathy is linked to a psychological mirroring of another, a mirroring articulated most explicitly with the ability to read the expressions on the face of another.<\/p>\n<\/div>\n<\/div>\n\n\n\n <\/p>\n\n\n\n Machine Readable Hito<\/em> demonstrates how this history of psychology and the assumptions that it makes about vision, emotion, and empathetic relation have become part of the visual culture of digital media\u200a\u2014\u200asubject, like other forms of surveillance, to the automated mechanisms of computers. Even disregarding the massive amount of debate surrounding the basic categories of emotion and empathy as operationalized by psychology, works such as Paglen\u2019s ask us to question the \u201cobjectivity\u201d and \u201crationality\u201d of how scientific categories for human relations are built into digital media and automated. And, beyond overtly coercive powers of control, it asks us to question how the automation of emotion, the automation of empathy, will be put into service of the police, the military, and social media monopolies, all of which use computer vision to extract information from images of the face, automating a particular understanding of mirroring, emotion, and empathy in digital culture. It turns us to a renewed phrenology or physiognomy, one used to control by means of \u201cmodulating affect.\u201d11<\/sup><\/a><\/span> 11 <\/a> - See Mark Andrejevic, Infoglut: How Too Much Information Is Changing the Way We Think and Know (New York: Routledge, 2013), 52\u200a\u2014\u200a54, 77\u200a\u2014\u200a110.<\/span> What Machine Readable Hito<\/em> shows, above all, is how technological means for fostering empathy, which tend to defer to algorithmic systems of identifying emotion on the face, may have little to do with human experience and perception, but involve a rationalized system for rigidly ordering visual knowledge. <\/p>\n\n\n\n Traduit de l\u2019anglais par Margot Lacroix<\/strong><\/p>\n\n\n![\"\"](\"https:\/\/esse.ca\/wp-content\/uploads\/2019\/01\/95-DO-IM_Bollmer_Hito_VW_CMYK-C-scaled.jpeg\")
Machine Readable Hito<\/em>, 2017.
Photo: courtesy of the artist & Metro Pictures, New York<\/figcaption><\/figure>\n<\/div>\n\n\n\n