May 212016

As I posted earlier, I am participating in a panel on data natures at the International Symposium on Electronic Art [ISEA] in Hong Kong. My paper is titled Object Hierophanies and the Mode of Anticipation, and discusses the transition of bid data-driven IoT objects such as the Amazon Echo to a mode of operation where they appear as a hierophany – after Mircea Eliade – of a higher modality of being, and render the loci in which they exist into a mode of anticipation.

I start with a brief section on the logistics of the IoT, focusing on the fact that it involves physical objects monitoring their immediate environments through a variety of sensors, transmitting the acquired data to remote networks, and initiating actions based on embedded algorithms and feedback loops. The context data produced in the process is by definition transmitted to and indexed in a remote database, from the perspective of which the contextual data is the object.

The Amazon Echo continuously listens to all sounds in its surroundings, and reacts to the wake word Alexa. It interacts with its interlocutors through a female sounding interface called the Alexa Voice Service [AVS], which Amazon made available to third-party hardware makers. What is more, the core algorithms of AVS, known as the Alexa Skills Kit [ASK] are opened to developers too, making it easy for anyone to teach Alexa a new ‘skill’. The key dynamic in my talk is the fact that human and non-human agencies, translated by the Amazon Echo as data, are transported to the transcendental realm of the Amazon Web Services [AWS] where it is modulated, stored for future reference, and returned as an answering Echo. In effect, the nature of an IoT enabled object appears as the receptacle of an exterior force that differentiates it from its milieu and gives it meaning and value in unpredictable ways.

Objects such as the Echo acquire their value, and in so doing become real for their interlocutors, only insofar as they participate in one way or another in remote data realities transcending the locale of the object. Insofar as the data gleaned by such devices has predictive potential when viewed in aggregate, the enactment of this potential in a local setting is always already a singular act of manifestation of a transcendental data nature with an overriding level of agency.

In his work on non-modern notions of sacred space philosopher of religion Mircea Eliade conceptualized this act of manifestation of another modality of being into a local setting as a hierophany. Hierophanies are not continuous, but wholly singular acts of presence by a different modality. By manifesting that modality, which Eliade termed as the sacred, an object becomes the receptacle for a transcendental presence, yet simultaneously continues to remain inextricably entangled in its surrounding milieu. I argue that there is a strange similarity between non-modern imaginaries of hierophany as a gateway to the sacred, and IoT enabled objects transducing loci into liminal and opaque data taxonomies looping back as a black-boxed echo. The Echo, through the voice of Alexa, is in effect the hierophanic articulator of a wholly non-human modality of being.

Recently, Sally Applin and Michael Fischer have argued that when aggregated within a particular material setting sociable objects form what is in effect an anticipatory materiality acting as a host to human interlocutors. The material setting becomes anticipatory because of the implied sociability of its component objects, allowing them to not only exchange data about their human interlocutor, but also draw on remote data resources, and then actuate based on the parameters of that aggregate social memory.

In effect, humans and non-humans alike are rendered within a flat ontology of anticipation, waiting for the Echo.

Here is the video of my presentation:

And here are the prezi slides:

May 192016

This is a lecture I thoroughly enjoyed preparing, and had great fun delivering to my first year digital media class of 200 students. The prezi slides are below. My intention was to provoke students into thinking in interesting and weird ways about remediation across media platforms, about object animation through digital means, and about the new aesthetics of the glitch and hyper kawaii. I ended up being more successful than I expected, in that the lecture provoked extreme reactions oscillating from strong rejection of the very premises to enthusiastic exploration of the implications and pathways opened by them. I start with a quick overview of the changing meaning of craft in a time of digital mediation, then move on to the aesthetics of remediation between analog and digital forms, and object animation and its effect on experiences of the material.

I constructed the main argument around the transition from industrial culture in which production is determined by the logic of the assembly line, to a post-industrial culture in which production is determined by the logic of mass customization. Arguably, the latter is characterized by rapid prototyping, experimentation, iterative error discovery, and modifications leading to unexpected outcomes. I illustrate this with a beautiful quote by David Pye, from his The Nature and Art of Workmanship, where he argues that while industrial manufacturing is characterized by the production of certainty, craftsmanship is always the production of risk because the quality of the result is an unknown during the process of making.

My favorite part of the lecture is where I managed to integrate into a single narrative phenomena such as glitch aesthetics and hyper kawaii, exemplified by Julie Watai and xMinks, with a cameo by Microsoft’s ill-fated Tay AI bot.

The image I used as canvas for the prezi is a remediation of the Amen Break 6-second loop into a 3-d printed sound wave, crafted by a student of mine last year.

May 192016

Some time ago I was invited to give a lecture on mapping to a crowd of mostly first year digital media students working on locative media projects. Below are the prezi slides. Considering the audience, I made a light theory introduction focusing on the notions or representation and the factual, and then moved to discussing various examples of maps as interfaces to movement and agency. My talk was mostly a simplified version of my paper on mapping theory, with a focus on the dynamics of translation and transportation of immutable mobiles – a fundamental concept in actor network theory. In essence, the lecture is built around a dichotomy between two concepts of mapping: 1] mapping as a representation of a static frame of reference – an actual fact, and 2] mapping as a translation of and an interface to agency and movement – a factual act. The tension between actual facts and factual acts is a nerdy reference to Latour’s from matters of fact to matters of concern, and is intended to illustrate the affordances of digital media in opening and mapping black-boxed settings. Apparently, the lecture was a success, with the Sand Andreas Streaming Deer Cam being a crowd favorite.

Aug 112015

I read Neal Stephenson’s Seveneves over the weekend, all 867 pages of it. After the first 100 pages the only thing that kept me going was the ever-receding hope that it can and will only get better. A vain hope, as it turned out. Midway through I stopped hoping for improvement and simply decided to persevere since I’d gotten so far. The final third simply fell off from whatever standard the novel was trying to uphold until then and so I went through it with perverse fascination, savoring, as it were, its descent into uncharted territory.

The short version of this review would go something like this: this is the worst of Neal Stephenson’s books, by a very large margin. Huge plot holes, no character development whatsoever, multiple poorly developed points of view leading to superficial protagonists, illogical premises, inconsistent story-world. If you are a die-hard Neal Stephenson fan, as I am, this will be on your bookshelf anyway, but wait for the bargain bin copy. If you are into space exploration and/or hard sci-fi spare yourself the time and effort and read Andy Weir’s The Martian. If you are into post-apocalypse and TEOTWAWKI scenarios read everything by Hugh Howey, starting with his Silo Saga [Wool, Shift, Dust].

Now for the longer version [again, SPOILERS]. I can safely be described as a life-long fan of Neal Stephenson’s work, and have read and own all of his books. I re-read Anathem regularly, simply because it is an almost perfect science fiction novel. Such is my dedication. I feel I must say that as a preface to what comes next. Seveneves is by far the worst book written by Neal Stephenson, and that includes the meandering narrative of the Baroque Cycle, and his collaborative Mongoliad effort. Usually fiction of the magnitude of Seveneves, running close to a thousand pages, suffers from some weak points by the sheer nature of its size and complexity as a story. That being the case, it doesn’t mean that the whole book will suffer from these weaknesses, because if the fundamental structural elements of the story are sound then the whole will stand on its own. Unfortunately, Seveneves is a disaster in every respect.

The moon is blown up by a never explained Agent and humanity has 2 years to find a way to survive as a species before the earth is bombarded by a meteorite shower lasting several thousand years and obliterating everything on the surface of the planet. So far so good, but the humans of Seveneves decide that the best solution from this predicament is to focus all their resources into an escape into low earth orbit around the International Space Station [ISS]. If you are technically inclined you will immediately observe that this is by far the most energy inefficient option, as opposed to building deep underground or underwater bases [more on that below]. In effect, the majority of the plot is centered around the desperate efforts of a tiny remnant of humanity to deal with the totally predictable effects of the absurd premise, namely, the fact that their survival plan positioned them right in the middle of a millenia-long meteorite shower and constant solar radiation. Speaking of solar radiation, its plot role is to magically deal with characters Stephenson doesn’t know what to do with. It also turns out that solar radiation, when compounded over millenia,  has zero adverse effects on the human organism. Who could have imagined?

Facing this world-ending event, all world governments, including the Chinese and the Russians, magically delegate all their authorities and resources to the US President [I kid you not] and a totally US-dominated team of scientists and military led by [I kid you not] Neil deGrasse Tyson. The character of Doc Dubois is such an obvious and lazy reference to Tyson that after the first 100 pages I started doubting whether the book was written by Stephenson at all. The plot, while dead serious about pretty much everything, asks us to believe that a TV science presenter is a deus ex machina capable of solving impossible problems on the go, and that real scientists not only take him seriously but always delegate final decision making to him. Eventually this dynamic becomes comical. But wait, there is more! On his journey to Superman-hood and species-saving exploits Neil deGrasse Tyson is accompanied by the internet mogul turned asteroid mining entrepreneur Sean Whatshisname, modeled on the love-child of Jeff Bezos [Amazon] and Elon Musk [PayPal]. Yes.

Absurdly long stretches of the narrative are focused on detailed technical descriptions of contraptions which will never be encountered again in the story, while major moments in the plot such as losing ones family and children are dedicated a paragraph or less. Apparently scientists do not emote much. Characters constantly appear to value trivial technical problems quite more than the ability to speak to their loved ones condemned to die on earth. It takes Neil deGrasse Tyson all of 5 seconds to decide to abandon his children for the benefit of being on the ISS, and this is not presented as a moral issue at all. Why bother building characters and developing a story when you could spend the next twenty pages describing an airlock? Why indeed.

Speaking of the ISS. If you know anything about the ISS you probably know that the only way to get to it right now is on a Russian Soyuz module. The commander of the Soyuz is always a Russian, and, while ISS mission commanders can be from other nations, the commander of the Russian Orbital Segment [ROS] of the ISS is always a Russian too. Now, the ROS is important, because it and only it controls the navigation and guidance systems of the ISS. In other words, the control room of the ISS is and always has been controlled by Russians, who pretty much wrote the book on space station building and maintenance. It would take you less than one hour to learn all of these things from the open internet. Apart from the Russians, the Chinese are the only other nation to currently put people into space independently, with an active space station program of their own, modeled on the Mir and Soyuz programs. Obviously, if you were to write a book whose plot is entirely centered around a quasi-realistic sci-fi scenario involving the ISS, with a target audience of people interested in these sorts of things, this might be an important fact to consider and weave in your plot. Not so with Seveneves, which magically deals with uncomfortable facts by ignoring them altogether. And so, the Russians play a plot role oscillating between space-plumbers and thugs, while the Chinese have no plot role at all. A rag-tag team of US scientists led by Neil deGrasse Tyson is all it takes.

Remember the absurd premise of trying to survive in low earth orbit for 5 thousand years in the middle of a meteorite shower? Apparently someone pointed that out in early draft edits, because there is a secondary plot latched superficially to the main plot, involving throwaway characters who somehow manage to successfully survive 5 thousand years in a mine and on the ocean floor of planet earth. Yes. How did they do that without the major nation-state resources necessary to accomplish it? We are never told. Instead, these characters are superficially tied to the main protagonists through family bonds which conveniently melt into air the moment the meteor shower starts, only to reappear as cherished relics 5 thousand years later [I kid you not]. In Neal Stephenson’s version of historical development, 5 thousand years is basically like 50 years – some people die, some people change a bit, some people get a little bit weird, but basically everyone still speaks the same language [naturally – English], and everyone understands each other’s jokes. After 5 thousand years of solitary development all it takes to immediately reestablish connection between 3 cultures is taking out the family heirlooms from 5 millenia ago, which includes pictures. Let that sink in. This is not even high-school level of absurd, so I don’t really know what to say about it. Even 50 years in a shared cultural space generates more variety than what Stephenson wants us to believe was generated over 5000 years in communities completely cut off from each other. Imagine bumping into a Sumerian and immediately starting to discuss life, politics and economics, in English. This is the major plot moment of Seveneves. It repeats twice, in case you did not get the message the first time.

Characters make randomly absurd decisions with infuriating consistency. Protagonists who are clearly dangerous for the survival of the species [cannibals] are not only allowed to live, but others regularly sacrifice themselves on their behalf. A protagonist who continuously endangers the lives of everyone is allowed to continue to do so, in a situation where what is at stake is the survival of the species – something which, we are told, is constantly on everyone’s mind. Characters do not undergo any dramatic development, they just appear, are given a two page treatment reading like a Wired advertorial for a tech stock, and then go on their business to die for other characters without an explanation why. The final part of the book introduces a new main protagonist who, and I have to admit this is an achievement of sorts, has no personality whatsoever. Points of view between protagonists shift so often that the reader cannot begin to empathize with the poorly written characters because there is no time.

Coming to think of it, the only redeeming element of the book are the space propulsion ideas. If Stephenson had written a short story collection playing with each idea in turn, it would have been honest, and great. Instead, we have this monolith of bad writing and worse characterization, which, in solidarity with its plot, should be shot into low earth orbit and kept there indefinitely.

Aug 102015

Here is a video of what, if there were only humans involved, would be considered a case of serious abuse and be met with counselling for all parties involved. The video is of a robot trying to evade a group of children abusing it. It is part of two projects titled “Escaping from Children’s Abuse of Social Robots,” by Dražen Brščić, Hiroyuki Kidokoro, Yoshitaka Suehiro, and Takayuki Kanda from ATR Intelligent Robotics and Communication Laboratories and Osaka University, and “Why Do Children Abuse Robots?”, by Tatsuya Nomura, Takayuki Uratani, Kazutaka Matsumoto, Takayuki Kanda, Hiroyoshi Kidokoro, Yoshitaka Suehiro, and Sachie Yamada from Ryukoku University, ATR Intelligent Robotics and Communication Laboratories, and Tokai University, presented at the 2015 ACM/IEEE International Conference on Human-Robot Interaction.

Contrary to the moral panic surrounding intelligent robots and violence, symbolized by the Terminator trope, the challenge is not how to avoid an apocalypse spearheaded by AI killer-robots, but how to protect robots from being brutalized by humans, and particularly by children. This is such an obvious issue once you start thinking about it. You have a confluence of ludism [rage against the machines] in all its technophobia varieties – from economic [robots are taking our jobs], to quasi-religious [robots are inhuman and alien], with the conviction that ‘this is just a machine’ and therefore violence against it is not immoral. The thing about robots, and all machines, is that they are tropic – instead of intent they could be said to have tropisms, which is to say purpose-driven sets of reactions to stimuli. AI infused robots would naturally eclipse the tropic limitation by virtue of being able to produce seemingly random reactions to stimuli, which is a quality particular to conscious organisms.

The moral panic is produced by this transgresison of the machinic into the human. Metaphorically, it can be illustrated by the horror of discovering that a machine has human organs, or human feelings, which is the premise of the Ghost in Shell films. So far so good, but the problem is that the other side of this vector goes full steam ahead as the human transgresses into the machinic. As humans become more and more enmeshed and entangled in close-body digital augmentation-nets [think FitBit], they naturally start reifying their humanity with the language of machines [think the quantified self movement]. If that is the case, then why not do the same for the other side, and start reifying machines with the language of humans – i.e. anthropomorphise and animate them?

Aug 082015

I think that the Internet of Things [IoT] for the masses will first manifest itself, paradoxically, through branded and high-end objects, because that is the usual vector for popularizing a new technical affordance. The entire nascent industry of trackers, from the Nest line of ambient ‘see everything’s’, and the FitBit ecology of wearable trackers, to the SenSe Mother household tracking hubs, the trajectory is to appeal to the aspiring [and lately shrinking] middle class and above. Enter Remy Martin IoT bottles for the Chinese market, positioned around the notion of authenticity. How do you get authenticity in this age of fakes? You connect to the internet of course, and personally register your bottle for that extra bit of authentic stamp of approval that someone somewhere has recognized your conspicuous consumption.

I think the two big trajectories along which we will be experiencing the IoT are nicely illustrated by this ad. The lumpen-proletariat gets the surveillance end, the middle class and everyone above gets the authenticity and personalization.

Jul 202015

To understand the effects, affordances, and contextual implications of cars one has to imagine not a single car, but the mindbogglingly dull commute in a suburban traffic jam. Similarly, to understand the affordances of drones and UAVs [unmanned aerial vehicles – a terrible term] one has to imagine the sky-air permeated by networked machines; from micro-drones suitable as toys and message relay, to massive permanent-hover drones suitable for advertising, surveillance, and – inevitably – policing. Enter The Drone Aviary – an R&D project from The Superflux Lab.

The Drone Aviary reveals fleeting glimpses of the city from the perspective of drones. It explores a world where the ‘network’ begins to gain physical autonomy. Drones become protagonists, moving through the city, making decisions about the world and influencing our lives in often opaque yet profound ways.