Category Archives: Technology

When the map edits the territory

By Stefan Kühn – Own work, CC BY-SA 3.0, Link

“A map is not the territory,” goes the famous dictum. In other words, a representation is different from the object it represents. It’s obvious, right? And yet I’m not so sure anymore.

Lately I’ve been wondering about the relationship between a document and object it documents. As Michael Buckland has written, some documents are made as documents, wherein the object precedes the document (e.g., a database record describing a movie); while others are considered as documents, where the document precedes the object (e.g., the Liberty Bell as a sign of Abolition). And the link between the document and its object may be a matter of physical resemblance, socially controlled, or idiosyncratic.

All this suggests a one-way relationship between document and object—most typically, an arrow going from territory to map. But things seem to be getting more complicated. Or maybe things were always more complicated, but new kinds of documents are revealing complications that have long been hidden.

What I see happening in the digital world are three related trends:

  1. We are increasing the size of the map.
  2. We are becoming more interested in the map than the territory.
  3. The map is redrawing the territory.

Let’s consider each in turn.

The first is fairly obvious. We are documenting more, and in more detail, than ever before. If we look at maps narrowly defined, it’s clear that any web-based map packs in more information than any paper map could. You can zoom in or out quite far, you can navigate the whole world, you can see construction and traffic, businesses and buildings of all stripes are labeled, and on and on.

In a recent Wired article, Kevin Kelly discusses our growing map. Mirrorworld, he says, is the next major digital platform (after the web itself). “Someday soon, every place and thing in the real world—every street, lamppost, building, and room—will have its full-size digital twin in the mirrorworld.” When a map becomes sufficiently detailed, after all, it is essentially a mirrorworld. Kelly points to our AR technologies at present—from Pokémon Go to camera-based Google Translate, as a mere figment of what is to come. Google Maps is crude in comparison.

Second, in the age of the growing map, we are becoming more enthralled with the map than ever before. Susan Sontag was an early observer of this. In her essay “The Image-World” (part of her excellent On Photography), Sontag wrote that, whereas Plato taught us to look at reality rather than images, nowadays we seem to embrace images over and above the real. “An image-world is replacing the real one.” In other words, we prefer the map to the territory. For example, if we see images of a person or place before seeing that person or place in the flesh, the real thing often disappoints.

Prescient, Sontag wrote, “Cameras define reality in the two ways essential to the workings of an advanced industrial society: as a spectacle (for masses) and as an object of surveillance (for rulers).” Walking down the street of any city today, one is struck by how many people are looking down at their smartphones, rapt by the growing mirrorworld—a spectacle indeed. Meanwhile, as Shoshana Zuboff has made clear in her The Age of Surveillance Capitalism, the mirrorworld thrives on surveillance and the sale of behavioral futures.

But we don’t live in the mirrorworld (a la Wall-E) just yet; we still flit between the image and the real. And so the map changes our understanding of the territory. It shows us our world in a different light. Seeing a map could show a shorter route from A to B, to give a simple example. And another favorite example of mine was given by Nicholas Mirzoeff: Once the image “The Blue Marble,” a photograph of the whole earth from space, was published, people experienced what’s called the overview effect, a different sense of what it means to be an inhabitant of the earth. This leads into the final trend.

Third, and maybe most interestingly, the map is redrawing the territory. Luciano Floridi has coined the term re-ontologization, which refers to how the digital changes the physical. For example, the digital has borne new concepts, such as trolling, doxxing and revenge porn; and it has decoupled concepts that have historically always come together, such as responsibility and accountability. With re-ontologization, what is happening to the relationship between the map and the territory? One example that comes to mind is the way that smartphone maps, which navigate based on real-time traffic, actually change the traffic that they represent. Once-sleepy residential streets are now bumper-to-bumper because they offer a shortcut to the highway.

But we should not make the mistake of defining “map” too narrowly, lest we miss the forest for the trees. Alfred Korzybski, who coined the map–territory dictum, used the word map only as an analogy; what he was talking about was semantic representation writ large, encompassing human language and all symbolic thought.

So when we think about the map rewriting the territory, we should think about all documentary phenomena, and the links between documents and their objects. What is the relationship between a person and their online persona(s), for instance, and how does one form the other? Korzybski wrote that “the ideal map would contain the map of the map, the map of the map of the map… endlessly.” If a mirrorworld is on the horizon, we need to map the map.

I’m reminded of a vignette from Lewis Carroll’s last novel, Sylvie and Bruno Concluded, written in 1893:

“That’s another thing we’ve learned from your Nation,” said Mein Herr, “map-making. But we’ve carried it much further than you. What do you consider the largest map that would be really useful?”

“About six inches to the mile.”

“Only six inches!” exclaimed Mein Herr. “We very soon got to six yards to the mile. Then we tried a hundred yards to the mile. And then came the grandest idea of all! We actually made a map of the country, on the scale of a mile to the mile”

“Have you used it much?” I enquired.

“It has never been spread out, yet,” said Mein Herr: “the farmers objected: they said it would cover the whole country, and shut out the sunlight! So we now use the country itself, as its own map, and I assure you it does nearly as well.”

Indeed, a mile-for-mile map would swallow us up. The only way for it to be “really useful” would be for us to live inside it, wherein the map is less a map than part of the territory itself.

I’m especially struck by the last line. When the map is so big that it swallows us up, will we not find that we’re simply better off without it?

Pictures of food

I recently made bigos, a hearty Polish stew, using the recipe I got from my friend’s mother. I’ve loved bigos ever since I first had it at her house, back when I was studying abroad. The recipe has three ingredients: sauerkraut, ham hocks, and dried mushrooms. But bigos is a kind of kitchen-sink dish; you can add whatever you’ve got wilting in the fridge that you need to use up. Bigos really hits the spot for me, especially on cold winter days. But I wouldn’t call it pretty. 

As the bigos was cooking, I texted Sukrit. We talk about food a lot. He’d never heard of bigos. “My mouth is watering just looking at the recipe on Bon Appetit,” he said. Out of curiosity, I pulled up their recipe. Their photo looked nothing like my bigos, nor like any bigos I’d ever seen.

This got me thinking about photos of food. It’s beyond cliché that people of a certain age are wont to take photos of their food before eating it. (I wonder if there are more meals or selfies on Instagram.) We’re surrounded by photos and videos of beautiful food. 

Nowadays we hear a lot about how social media is making us more insecure about our faces and bodies. But what about our food? What is it doing to me to see, day after day, that so-and-so is always eating meals apparently plated by a Japanese Zen-master-cum-chef? And that this same chef works for all my friends?

I recently heard an interview on the Guardian Books podcast with Josh Cohen, whose book Not Working was just released. As an aside in the conversation, he mentioned this phenomenon of seeing amazing pictures of food on Instagram. He doesn’t like these pictures, he said, and he finds the phenomenon troubling. We can’t feel the texture or inhabit the lived quality of that food, thus digitized. All we can do is fetishize it and click the heart button. 

Years back, there was plenty of hubbub about the photo-manipulation techniques that McDonald’s et alia use to nip-tuck their food for advertising. I haven’t heard anything about this for the past several years, but the gulf between the Big Mac on the ad and in real life is just as wide as ever. Maybe we’re not outraged about this anymore because we’re all doing it. Now, I don’t think (m)any of us are photoshopping our food pictures, but we certainly do think about angles, lighting and filters, all of which are stops on Photoshop Road. And, to be sure, there are apps for on-phone photo editing specific to food.

But even beyond photo-manipulation, restaurants seem to be paying more attention to their plating and presentation these days, what with services like Instagram and Yelp in the cultural fabric. You just never know which customer is going to post a picture. Maybe that’s a good thing. Beautiful food certainly adds to the experience. And if the food also tastes great, then why not? One of my most memorable dining experiences was at Studio in Copenhagen, where every plate that came my way was consummately Instagrammable. Yes, I even posted a photo collage. (Importantly, the food had the taste to back it up.)

 

View this post on Instagram

 

A post shared by Tim Gorichanaz (@timgorichanaz) on

But we humble home cooks are feeling the pressure, too, in these days of social-media perfectionism. If we spend the time to make some tasty and beautiful food, we seem to feel the need to document it. We want the photos to exude all the things we’re feeling about the food, so we worry about the lighting and backgrounds and plating and all that. 

I was with a friend once, and we were cooking an elaborate, multipart meal. If we’d planned better, perhaps everything would have been ready to serve at the same time. But as it was, it took a full hour between the first thing’s finishing and the last’s. Our plates looked wonderful in the photos. And don’t get me wrong: the food tasted fine. It’s just that everything was cold. We’re surrounded by these glorious pictures of food. And what sacrifices we make to contribute to furthering that glory—ad majorem cibi gloriam.

There’s a handful of cookbooks in my kitchen. They, too, are for the most part adorned with luscious photographs. When I peruse them, looking for a weekend project or something to cook for company, I even find myself skipping over the pages with no photos. Other times, the photos are intimidating. I might see a photo and think to myself, “That looks way too involved for me right now,” or, “I could never make it look like that,” which likewise makes me turn the page. It’s probably a familiar feeling. Like that pitiable and brave soul who tried to make Cookie Monster cupcakes, perhaps it makes you not want to try again. 

Last month I finally got the book Salt Fat Acid Heat, by Samin Nosrat, and immediately it struck me. There’s not a single photo in the book. But there’s plenty of imagery—illustrations, that is. They’re quirky, whimsical doodlings done by Wendy MacNaughton.

Caeser Salad, detail, © Samin Nosrat and Wendy MacNaughton

As you turn the pages, you’re met with drawing after drawing. Macerated red onions, dried beans in various states of rehydration, lifesize cuttings, hand-colored charts… There is something about the art in this book that is approachable and inspiring. Returning to Josh Cohen’s comment, illustration seems to show the lived quality of the food, even though it’s—by all appearances—much further from the food than is a photograph. Or is it?

From “Understanding Comics,” © Scott McCloud

This reminds me of something in the book Understanding Comics, by Scott McCloud. Good comic book characters are visually ambiguous, he says, which allows the reader to insert themselves into the story. If there’s too much detail, the character comes across as defiantly other. We can’t identify with such characters. Perhaps pictures of food are similar: Too fanciful a photograph, and you can’t enter in; but with heart and ambiguity, you can. 

Poetics of electronic writing

An executable code poem by GreyLau

One of the questions that motivated me while I was working on my master’s degree was the differences between handwriting, printing and digital writing. Dennis Tenen’s new book, Plain Text: The Poetics of Computation, contributes to to that discussion.

Tenen points out that the major change between electronic writing and previous forms is that in electronic writing there is a separation between the act of writing and the support (i.e., what the writing is written on).

This becomes evident when we ask ourselves, while looking at a screen, “Where is the text?” Of course on one hand the text is on the screen; but on the other, it exists in electromagnetic storage somewhere we cannot directly see. In some sense, the writing is in both places. Tenen writes, “One must be translated, transformed into the other.”

This transformation occurs in what Tenen calls the formatting layer of electronic texts, which is where we may find censorship, DRM, ads and even spyware. Thus what we see on the screen is only the tip of the iceberg. Tenen:

At the maximally blunt limit of its capabilities, format governs access. Commands render some words and sentences visible on-screen while suppressing others. … The formatting layer specifies the affordances of electronic text. More than passive conduits of meaning, electronic texts thus carry within them rules for engagement between authors, readers, and devices. … Whatever literary-theoretic framework the reader brings to the process of interpretation must therefore meet the affordances encoded into the electronic text itself.

Tenen focuses on developing theoretical acuity for interpreting digital texts. This is vital, because if we do not develop such thinking, we’ll be quickly be strung along by forces beyond our understanding. We’re already at the point where some algorithm-generated texts are indistinguishable from human-generated ones, for instance.

And when it comes to social media (how we spend more and more of our time), if we do not learn to critically analyze the texts around us, we will miss out on what’s going on. John Lanchester writes poignantly on this in the London Review of Books:

For all the talk about connecting people, building community, and believing in people, Facebook is an advertising company. … [But] even more than it is in the advertising business, Facebook is in the surveillance business. Facebook, in fact, is the biggest surveillance-based enterprise in the history of mankind. It knows far, far more about you than the most intrusive government has ever known about its citizens. It’s amazing that people haven’t really understood this about the company. … I’m not sure there has ever been a more complete disconnect between what a company says it does – ‘connect’, ‘build communities’ – and the commercial reality. Note that the company’s knowledge about its users isn’t used merely to target ads but to shape the flow of news to them. Since there is so much content posted on the site, the algorithms used to filter and direct that content are the thing that determines what you see: people think their news feed is largely to do with their friends and interests, and it sort of is, with the crucial proviso that it is their friends and interests as mediated by the commercial interests of Facebook. Your eyes are directed towards the place where they are most valuable for Facebook.

Separation between the act of writing and its support, indeed.