I run 'facial recognition' on buildings to unlock architectural secrets

About a decade ago, a modest update to Apple’s iPhoto software showed me a new way to study architectural history. The February 2009 update added facial recognition^[1], allowing users to tag friends and loved ones in their photos. After a few faces were tagged, the software would begin to offer suggestions.

But it wasn’t always accurate. Though Apple’s algorithm continues to improve, it had a tendency to find faces in objects – not just statues or sculptures of people, but even cats or Christmas trees. For me, the possibilities became clearest when iPhoto confused a human friend of mine – I’ll call him Mike – with a building called the Great Mosque of Cordoba^[2].

The ceiling of the mosque’s forecourt supposedly resembled Mike’s brown hair. The layering of two Visigothic archways supposedly resembled the area between Mike’s hairline and the edge of his brow. Finally, the related alignment of the Moorish cusped arches with their striped stonework resembled Mike’s eyes and nose just enough that the software thought a 10th-century mosque was the face of a 21st-century human.

Rather than viewing this as a failure, I realized I had found a new insight: Just as people’s faces have features that can be recognized by algorithms, so do buildings. That began my effort to perform facial recognition on buildings – or, more formally, “architectural biometrics^[5].” Buildings, like people, may just have biometric identities too.

Facing the building

In the late 19th century, railway stations were built across Canada^[6] and the Ottoman Empire^[7], as both countries sough to expand control of their territory and regional influence. In each country, a centralized team of architects was charged with designing dozens of similar-looking buildings to be constructed throughout a vast frontier landscape. Most of the designers had never been to the places their buildings would go, so they had no idea whether there were steep slopes, large rock outcroppings or other terrain variations that might have led to design changes.

In both Canada and the Ottoman Empire, construction supervisors on the actual sites had to do their best to reconcile the official blueprints with what was possible on the ground. With communications slow and difficult, they often had to make their own changes to the buildings’ designs to accommodate local topography, among other variable conditions.

What’s more, the people who actually did the building came from an ever-changing multinational labor force. In Canada, workers were Ukrainian, Chinese, Scandinavian and Native American; in the Ottoman Empire, workers were Arab, Greek and Kurdish. They had to follow directions given in languages they didn’t speak and understand blueprints and drawings labeled in languages they didn’t read.

As a result, the engineers and workers’ own cultural notions of what a building should look like and how it should be constructed left their figurative fingerprints on what was built, and how it looked. In each place, there are subtle differences. Some stations’ wooden window frames are beveled, some roofs have finials, and some rounded arches are replaced with ever-so-slightly pointed arches.

Other design changes may have happened more recently, with renovations and restorations. Meanwhile, time has worn down materials, weather has damaged structures and, in some cases, animals have added their own elements – like birds’ nests.

The people behind the facades

In the Canadian and Ottoman case studies, many people had opportunities to influence the final building. The variations are quite like differences between people’s faces – most people have two eyes, a nose, a mouth and two ears, but exactly how those features are shaped and where they’re placed can vary.

Thinking about buildings as objects with biometric identities, I began to use analysis similar to facial recognition to find the subtle differences in each building. My team and I used laser scanners to take detailed 3-D measurements of railway stations in Turkey and Canada. We processed the raw data to create computerized models of those measurements.

That, in turn, revealed the hands of the builders, highlighting the geographic and multicultural influences^[10] that shaped the resulting buildings.

This evidence called into question previous assumptions that buildings, like a sculpture or a painting, are primarily influenced by just one person^[11]. Our work has shown that buildings really only begin with drawings, but then invite the input of a vast number of creators, most of whom never achieve the heroic status of architect or designer.

To date, there are no good methods to even try to identify these people and highlight their artistic choices. The absence of their voices has only tended to prop up the idea that architecture is made only by brilliant individuals.

As 3-D scanners become increasingly common^[12], perhaps even elements of smartphones^[13], our method will be available to almost anyone. People will use this technology on large objects like buildings, but small ones too. At present, our group is working with Paleoindian points, more commonly known as “arrowheads,” to explore a very different history, geography and set of circumstances than we did with the railway stations.

References

1. ^{^} added facial recognition (www.macworld.com)
2. ^{^} Great Mosque of Cordoba (www.mezquitadecordoba.org)
3. ^{^} Erinc Salor (commons.wikimedia.org)
4. ^{^} CC BY-SA (creativecommons.org)
5. ^{^} architectural biometrics (architecturalbiometrics.com)
6. ^{^} across Canada (www.viarail.ca)
7. ^{^} the Ottoman Empire (yalebooks.yale.edu)
8. ^{^} CC BY-ND (creativecommons.org)
9. ^{^} CC BY-ND (creativecommons.org)
10. ^{^} highlighting the geographic and multicultural influences (architecturalbiometrics.com)
11. ^{^} influenced by just one person (theconversation.com)
12. ^{^} 3-D scanners become increasingly common (arstechnica.com)
13. ^{^} elements of smartphones (www.inf.ethz.ch)