Human Generated Data

Title

Untitled (recovering soldiers in hospital ward playing with Vietnamese child, Vietnam)

Date

1967-68

People

Artist: Gordon W. Gahan, American 1945 - 1984

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.1.152

Human Generated Data

Title

Untitled (recovering soldiers in hospital ward playing with Vietnamese child, Vietnam)

People

Artist: Gordon W. Gahan, American 1945 - 1984

Date

1967-68

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-22

Human 98.4
Person 98.4
Person 97.6
Furniture 96.7
Bed 96.7
Person 96
Person 93.1
Indoors 88.6
Room 88.6
People 86.1
Person 85.4
Clinic 85
Hospital 75.3
Person 70.1
Person 65.4
Family 61.4
Sitting 57.6
Operating Theatre 57

Clarifai
created on 2019-03-22

group 99.2
people 99.2
furniture 98.2
four 98.2
adult 97.9
child 97.7
five 97.3
man 97
education 96.9
administration 96.8
woman 96.4
room 96
group together 95
several 93.7
three 92.4
war 92.1
family 90.5
offspring 87.1
reclining 85.2
sit 83.9

Imagga
created on 2019-03-22

patient 67.9
person 62.7
case 45.5
sick person 45.4
man 35.6
people 32.9
male 31.9
home 29.5
uniform 28
adult 26.9
military uniform 25.3
senior 23.4
family 21.3
indoors 21.1
happiness 20.4
happy 20
mature 19.5
clothing 19.2
women 19
men 18.9
couple 18.3
together 17.5
smiling 17.4
elderly 17.2
nurse 17.2
care 16.4
sitting 16.3
room 15.7
mother 15.1
professional 15.1
smile 15
bed 14.2
hospital 14.2
casual 13.5
medical 13.2
meeting 13.2
lifestyle 13
cheerful 13
love 12.6
retired 12.6
old 12.5
talking 12.3
indoor 11.9
portrait 11.6
group 11.3
covering 11.1
business 10.9
team 10.7
discussion 10.7
husband 10.6
kin 10.4
health 10.4
table 10.4
grandfather 10.2
surgeon 10.2
consumer goods 10.1
medical officer 9.9
to 9.7
40s 9.7
colleagues 9.7
older 9.7
businessman 9.7
office 9.6
retirement 9.6
adults 9.5
doctor 9.4
help 9.3
horizontal 9.2
20s 9.2
businesswoman 9.1
aged 9
worker 8.9
working 8.8
medicine 8.8
casual clothing 8.8
two people 8.7
child 8.7
work 8.6
daughter 8.6
illness 8.6
wife 8.5
face 8.5
photographer 8.5
house 8.3
color 8.3
holding 8.2
occupation 8.2
relaxing 8.2
interior 8
70s 7.9
discussing 7.9
stretcher 7.8
father 7.7
pensioner 7.7
two 7.6
resting 7.6
reading 7.6
parent 7.6
businesspeople 7.6
females 7.6
joy 7.5
relationship 7.5
fun 7.5
leisure 7.5
engineer 7.4
book 7.3
playing 7.3
looking 7.2

Google
created on 2019-03-22

Microsoft
created on 2019-03-22

person 99.7
sitting 96.2
people 58.1
group 58
military 46.7
navy 11.9
competition 11.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-5
Gender Female, 88.8%
Happy 1.3%
Sad 12%
Calm 81.9%
Confused 0.7%
Angry 1.5%
Disgusted 1.2%
Surprised 1.5%

AWS Rekognition

Age 23-38
Gender Male, 99.2%
Sad 9.1%
Confused 2.4%
Surprised 4.2%
Calm 70.9%
Disgusted 0.2%
Happy 3.8%
Angry 9.4%

AWS Rekognition

Age 26-44
Gender Male, 58.4%
Sad 0.7%
Disgusted 0.1%
Angry 0.3%
Calm 98.4%
Happy 0.2%
Confused 0.2%
Surprised 0.2%

AWS Rekognition

Age 26-43
Gender Male, 98.7%
Disgusted 0.5%
Calm 87.8%
Surprised 1.6%
Happy 1.1%
Sad 5.5%
Confused 1.6%
Angry 1.8%

AWS Rekognition

Age 26-43
Gender Male, 98.9%
Surprised 1.6%
Angry 2.1%
Confused 1.6%
Calm 88.2%
Sad 4%
Happy 0.2%
Disgusted 2.2%

AWS Rekognition

Age 35-52
Gender Male, 54.1%
Surprised 45.7%
Disgusted 46.3%
Angry 47.1%
Sad 48.4%
Happy 45.6%
Confused 45.5%
Calm 46.5%

AWS Rekognition

Age 26-43
Gender Male, 53.5%
Sad 46.4%
Angry 45.6%
Calm 46.3%
Disgusted 45.2%
Surprised 50.3%
Happy 45.8%
Confused 45.4%

Microsoft Cognitive Services

Age 2
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Bed 96.7%

Captions

Microsoft

a group of people sitting around a table 97.6%
a group of people sitting at a table 97.3%
a group of people sitting on a table 95.7%

Text analysis

Amazon

MONOPOLYI