Two pizzas sitting on top of a stove top oven

Google’s machine learning algorithms are now capable of understanding scenes in images (object detection, classification, labeling and understanding) and can translate them automatically and accurately into natural language. Their goal:

This kind of system could eventually help visually impaired people understand pictures, provide alternate text for images in parts of the world where mobile connections are slow, and make it easier for everyone to search on Google for images.

However, these are only a few use cases that have a great need for visual intelligence. Each observation, security & surveillance company (for better or worse) will be pleased.

And Google is not alone. A team in Stanford is also working on neural networks for visual recognition, titled “Deep Visual-Semantic Alignments for Generating Image Descriptions”:

External image

Interesting simultaneity: I’m currently reading Kill Decision by Daniel Suarez, where a team - at the vision lab in Stanford - develops a visual intelligence. It allows machines (drones in the course of the book) to identify objects in video feeds and gives them the cognitive ability to discern what’s occurring in a scence: “concept detection, integrated cognition, interpolation - prediction.”

Worth a read, if you’re interested in robocalypse stories and (distopic) use cases for computer vision & autonomous systems.

[read more] [paper] [h/t for the stanford link to iamdanw]


The Manual for Civilization is a crowd-curated collection of the 3500 books you would most want to sustain or rebuild civilization. It is also the library at The Interval, with about 1000 books on shelves floor-to-ceiling throughout the space. We are about a third of the way done with compiling the list and acquiring selected the titles.

We have a set of four categories to guide selections:

  • Cultural Canon: Great works of literature, nonfiction, poetry, philosophy, etc
  • Mechanics of Civilization: Technical knowledge, to build and understand things
  • Rigorous Science Fiction: Speculative stories about potential futures
  • Long-term Thinking, Futurism, and relevant history (Books on how to think about the future that may include surveys of the past)

Our list comes from suggestions by Interval donors, Long Now members, and a some specially-invited guests with particular expertise. All the book lists we’ve published so far are shown here including lists from Brian EnoStewart BrandMaria Popova, andNeal Stephenson. Interval donors will be the first to get the full list when it is complete.

Today we add selections from science fiction authors Bruce SterlingDavid Brin, and Daniel Suarez. All three are known for using contemporary science and technology as a starting point from which to speculate on the future. And that type of practice is exactly why Science Fiction is one of our core categories….

successful parasites
                                        kill us;

                                                               they become P̗̜̠̄̋̅̃ͯA͖̠͉̥̝͔̜̲̽̓̃ͯ̓̂̏Ṟ͈̋͛ͬ͋͂̅̒̽T͈̺̗͉̪̥̤͂̃̃ͫ̾ͩ̚̚ ̤̦̲̹̪̱̟̃ͨ̈́ͦͮ͂ͤͬͅǑ͖̻̖ͣ̊̾F̱͓͔̩͈̠͗ ̖͈̠ͧ͋̽͒Û͔̼͉͕̬̖̬͋͌ͥͯ̂̓S͚̓ͩͫ͋ͫ́

Machines Of Loving Grace

Yesterday, I was doing a dress rehearsal for a webinar that will be live tomorrow. I was talking with Fred McClimans, Geoffrey Colon, and Alan Dickenson about the future of cloud computing and how that intersects with big data. This morning something occurred to me regarding the application of social data in the future.

Imagine that the workings of human social networks are finally figured out by crunching real data from really large social networks. And at the same time, the the deep forces of social influence are revealed, and the mathematics lurking below our interactions is cracked. And in parallel, imagine that continued research into cognitive science has led to more understanding of how social interaction is linked to brain chemistry, and for the first time, effective techniques are developed to make the sad happy, and the lonely loved.

Ok, I know, but let me finish the thought experiment.

So, imagine that researchers are able to create algorithms that can actually – with real success – influence our behaviors. Through a society-spanning combination of content marketing, social media, and targeted social network strategies, researchers are able to decrease cigarette smoking, or increase bike riding. And the unscrupulous or avaricious would be able to get people to chew one kind of gum, or watch a particular TV series.

Alright, let me add the last ‘what if’ to the scenario, although it is starting to sound like a chapter of Daniel Suarez’s Daemon. So, imagine that some global non-profit, like the Gates Foundation, builds a software system that leverages all this new-found knowledge about social influence and social cognition, and sets about changing us.

This system – let’s call it Grace – has access to the world’s major datasets, which contain millions of petabytes of social data in this hypothetical future. Grace would work surreptitiously and guardedly, applying social math to each of our private social contexts, convincing us to brush more often, to read to our kids, to help others in need. Grace would reward us at the physiological level, by convincing one person to touch another, unleashing oxytocin and building trust where none existed before. Teams would work more efficiently. Friends would make that extra effort, families would settle old differences. Politicians would reach out to their opponents to find common cause and to put aside partisan division. Warring factions in dusty far-away lands would lay down their AK-47s and make peace where there had been decades or millennia of war.

Cue the harps.

And the reason I called this system Grace is a nod to Richard Brautigan’s All Watched Over By Machines Of Loving Grace:

I'd like to think (and
the sooner the better!)
of a cybernetic meadow
where mammals and computers
live together in mutually
programming harmony
like pure water
touching clear sky.

I like to think
   (right now, please!)
of a cybernetic forest
filled with pines and electronics
where deer stroll peacefully
past computers
as if they were flowers
with spinning blossoms.

I like to think
   (it has to be!)
of a cybernetic ecology
where we are free of our labors
and joined back to nature,
returned to our mammal brothers and sisters,
and all watched over
by machines of loving grace.

In my version, Grace is operating behind the scenes, without our knowledge, nudging us to do good and make nice, an animatronic Jimminy Cricket, the invisible conscience we need to become more humane.

And the question is, if we could make such a thing happen, should we? There is no doubt that marketers will attempt to take our growing knowledge of social connection and neuroeconomics to try to sell baby food and sports cars. And dictators might use such mechanisms as mind control and hyper-efficient propaganda engines. But what if such tools could be used to make the world a better place?

Should we? Is it immoral to surreptitiously influence humanity, even if the result is a better place? Ultimately, the question becomes who gets to decide what better means, and so in my it-could-almost-be-a-novel scenario, it would likely be the choice of a solitary genius, as in Daemon, following personal convictions rather than some plebiscite.

What if it would only work if it was secret? What if the world could be bettered, famines averted, wars ended, climate change reversed, but only if the mechanism to do so was completely unknown to the world?

In my early morning musing, in the twilight stage between sleeping and waking, I envisioned Grace moving the world from exploitative, growth-at-all-costs hyper-capitalism toward a steady-state, sustainable economy and social compact, where we’d ramp down the population to a few billions over the next few decades, provide meaningful and interesting work rewilding the planet, building livable and beautiful cities, and growing healthy food and a smaller number of better-loved and better-fed babies. 

But I was dreaming, obviously.