Human Generated Data

Title

Gropius with Béla Bartók, and Paul Klee in Dessau
Date

c. 1927
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Ati Johanssen, BRGA.1.17

Human Generated Data

Title

Gropius with Béla Bartók, and Paul Klee in Dessau

People

Artist: Unidentified Artist,

Date

c. 1927

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-26

Clothing 99.6
Apparel 99.6
Human 98
Person 98
Overcoat 97.4
Coat 97.4
Person 92.8
Person 92.6
People 81
Suit 80.5
Tuxedo 77.5
Face 66.6
Photography 62.9
Photo 62.9
Text 61.5
Jacket 56.9
Blazer 56.8
Standing 56.5
Man 56.3

Clarifai
created on 2019-03-26

people 100
group 99.4
group together 99.4
administration 98.6
leader 98.2
adult 98.1
man 96.4
four 96.4
three 96.4
wear 95.2
five 94.4
several 94.1
many 93.9
portrait 93.7
two 87.1
outfit 87
facial expression 85.6
woman 85.6
home 85.4
chair 84.5

Imagga
created on 2019-03-26

businessman 60.9
business 51
man 49.7
male 47.5
corporate 36.1
office 34.7
person 34.3
executive 33.3
suit 33
people 32.3
handsome 27.6
professional 27.6
work 27.5
adult 27.2
portrait 25.2
success 23.3
men 23.2
tie 22.8
manager 22.3
confident 20.9
businesspeople 20.9
looking 20.8
happy 20.7
smiling 20.2
baron 19.2
face 19.2
smile 18.5
communication 18.5
successful 18.3
meeting 17.9
job 17.7
senior 16.9
mature 16.7
group 16.1
computer 15.2
team 15.2
career 15.1
sitting 14.6
businesswoman 14.5
clothing 14.4
working 14.1
hand 13.7
laptop 13.7
modern 13.3
standing 13
spectator 12.9
expression 12.8
businessmen 12.7
busy 12.5
metropolitan 12.2
company 12.1
teamwork 12
glasses 12
worker 11.7
elderly 11.5
boss 11.5
serious 11.4
talking 11.4
guy 11.3
table 11.2
building 11.2
old 11.1
40s 10.7
colleagues 10.7
indoors 10.5
one person 10.4
jacket 10.2
indoor 10
cheerful 9.7
technology 9.6
leader 9.6
leadership 9.6
confidence 9.6
formal 9.5
color 9.5
lifestyle 9.4
mortarboard 9.3
occupation 9.2
friendly 9.1
alone 9.1
attractive 9.1
entrepreneur 8.9
employee 8.8
look 8.8
corporation 8.7
diversity 8.6
notebook 8.5
black 8.5
inside 8.3
holding 8.2
one 8.2
aged 8.1
40 45 years 7.9
happiness 7.8
good looking 7.8
businessperson 7.8
conversation 7.8
1 7.7
project 7.7
partnership 7.7
casual 7.6
workplace 7.6
thinking 7.6
desk 7.6
shirt 7.5
outdoors 7.5
environment 7.4
gray 7.2
cap 7.1
day 7.1
together 7

Google
created on 2019-03-26

Photograph 97.5
People 93.4
Snapshot 86.7
Gentleman 72.7
Photography 72.5
Black-and-white 68.3
Family 61.6
History 60.4
Stock photography 59.4

Microsoft
created on 2019-03-26

person 99.4
posing 92.5
standing 90.8
black 75
white 64.8
old 60.8
retro 14

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-63
Gender Male, 88.4%
Confused 0.6%
Happy 0.2%
Surprised 0.7%
Sad 0.7%
Calm 96.1%
Angry 0.8%
Disgusted 1%

AWS Rekognition

Age 48-68
Gender Male, 99.7%
Calm 86.8%
Confused 4.1%
Happy 3.1%
Sad 3.9%
Angry 1.4%
Surprised 0.5%
Disgusted 0.2%

AWS Rekognition

Age 48-68
Gender Male, 99.1%
Disgusted 4.1%
Angry 17%
Surprised 1.5%
Calm 64.6%
Happy 3.6%
Sad 7%
Confused 2.2%

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 55
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98%
Suit 80.5%

Captions

Microsoft

Walter Gropius, Bela Bartok, Paul Klee posing for a photo 97.7%
a black and white photo of Walter Gropius, Bela Bartok, Paul Klee posing for the camera 96.3%
Walter Gropius, Bela Bartok, Paul Klee posing for the camera 96.2%