Human Generated Data

Title

Untitled (Dr. Herman M. Juergens standing with nurse in hallway)

Date

1964-67

People

Artist: Gordon W. Gahan, American 1945 - 1984

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.1.104

Human Generated Data

Title

Untitled (Dr. Herman M. Juergens standing with nurse in hallway)

People

Artist: Gordon W. Gahan, American 1945 - 1984

Date

1964-67

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-22

Person 99.2
Human 99.2
Person 98.8
Apparel 98.1
Clothing 98.1
Shoe 98
Footwear 98
Sleeve 88
Accessory 71.5
Sunglasses 71.5
Accessories 71.5
Finger 70.5
Overcoat 65.2
Coat 65.2
Female 61.6
Long Sleeve 61
Sunglasses 52.9

Clarifai
created on 2019-03-22

people 99.8
man 98.3
two 96.7
adult 96.1
woman 95.6
group together 95.5
monochrome 94.4
group 93.6
handshake 93.2
three 92.7
leader 89.5
administration 89.1
street 86.3
wear 85
four 84.1
portrait 83.1
actor 82.1
indoors 75
music 72.9
partnership 70.8

Imagga
created on 2019-03-22

sword 47.6
weapon 40
male 33.3
man 30.9
business 29.1
adult 28.8
people 27.9
corporate 24.9
men 24.9
businessman 24.7
suit 23
building 22.3
professional 22.2
person 20.1
black 19.2
happy 17.5
attractive 17.5
office 17.2
fashion 16.6
work 16.5
executive 16.4
women 15.8
success 15.3
clothing 15.1
job 15
city 15
portrait 14.9
human 13.5
urban 13.1
looking 12.8
businesswoman 12.7
pretty 12.6
life 12.4
mask 12.4
standing 12.2
group 12.1
architecture 11.8
worker 11.6
handsome 11.6
adults 11.4
youth 11.1
day 11
team 10.7
modern 10.5
outdoors 10.4
lifestyle 10.1
covering 10.1
successful 10.1
garment 9.8
indoors 9.7
robe 9.6
window 9.4
manager 9.3
elegance 9.2
street 9.2
inside 9.2
20s 9.2
dress 9
couple 8.7
hands 8.7
happiness 8.6
model 8.6
businesspeople 8.5
career 8.5
casual 8.5
two 8.5
clothes 8.4
protective covering 8.4
company 8.4
occupation 8.2
smiling 8
love 7.9
smile 7.8
workplace 7.6
hand 7.6
fashionable 7.6
walking 7.6
church 7.4
light 7.3
indoor 7.3
confident 7.3
religion 7.2
shop 7
jacket 7
travel 7
briefcase 7

Google
created on 2019-03-22

Microsoft
created on 2019-03-22

person 99.8
man 90.9
standing 89.1
outdoor 85.1
silhouette 28.4
street 16.1
black and white 7.8
monochrome 3.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Male, 99.3%
Confused 9.9%
Calm 72.7%
Disgusted 1%
Surprised 3.9%
Sad 2.5%
Angry 5.6%
Happy 4.5%

AWS Rekognition

Age 23-38
Gender Male, 86.3%
Sad 3.7%
Confused 16.3%
Calm 61.5%
Disgusted 4.7%
Happy 2.7%
Surprised 7.7%
Angry 3.4%

Microsoft Cognitive Services

Age 67
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Shoe 98%
Sunglasses 71.5%

Captions

Microsoft

a man standing next to a building 91.4%
a man standing in front of a building 91.3%
a man standing on a sidewalk 89.4%