Human Generated Data

Title

Untitled (soldier talking to children outside school room, Vietnam)

Date

1967, printed later

People

Artist: Gordon W. Gahan, American 1945 - 1984

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3837

Human Generated Data

Title

Untitled (soldier talking to children outside school room, Vietnam)

People

Artist: Gordon W. Gahan, American 1945 - 1984

Date

1967, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-03

Classroom 99.7
Room 99.7
Indoors 99.7
School 99.7
Person 99.6
Human 99.6
Person 99.5
Person 99.4
Person 99.3
Person 98.3
Person 98
Person 95.5
Person 94.8
Person 92.6
Person 92
Person 89.6
Person 83.9
Person 78.2
Person 75.4
Person 74
Person 69.7
Person 67.3
Person 67.1

Imagga
created on 2022-06-03

room 50.5
classroom 42.5
man 30.2
people 27.9
indoors 27.2
person 26.4
table 23.4
work 22.8
male 22.7
hospital 21.8
office 21.1
smiling 20.3
business 20
adult 18
nurse 17.7
group 17.7
corporate 16.3
patient 16.3
barbershop 16.1
meeting 16
shop 15.9
interior 15.9
businessman 15.9
women 15.8
chair 15.8
sitting 15.5
men 15.5
lifestyle 15.2
happy 15
working 15
teacher 14.8
modern 14.7
professional 14.2
desk 14.2
education 13.9
occupation 13.7
restaurant 13.6
center 13.5
worker 13.5
hairdresser 13.2
teamwork 13
computer 12
businesswoman 11.8
board 11.8
team 11.6
job 11.5
together 11.4
executive 11.3
senior 11.2
communication 10.9
surgeon 10.9
adults only 10.8
two people 10.7
colleagues 10.7
talking 10.5
home 10.4
inside 10.1
indoor 10
medical 9.7
success 9.7
mercantile establishment 9.6
couple 9.6
standing 9.6
student 9.5
equipment 9.5
industry 9.4
strength 9.4
school 9.2
training 9.2
health 9
case 9
suit 9
color 8.9
20 24 years 8.9
healthy lifestyle 8.8
exercising 8.7
salon 8.7
happiness 8.6
fitness 8.1
to 8
furniture 7.9
conference 7.8
students 7.8
discussion 7.8
portrait 7.8
exam 7.7
businesspeople 7.6
adults 7.6
doctor 7.5
mature 7.4
clinic 7.4
technology 7.4
service 7.4
cheerful 7.3
specialist 7.3
smile 7.1
medicine 7

Google
created on 2022-06-03

Microsoft
created on 2022-06-03

person 99.9
indoor 98.2
wall 95
black and white 82.2
clothing 80.1
human face 78.2
man 68.3
crowd 3.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-22
Gender Female, 58.7%
Happy 94.1%
Surprised 6.6%
Fear 5.9%
Calm 3.4%
Sad 2.3%
Confused 0.5%
Disgusted 0.4%
Angry 0.3%

AWS Rekognition

Age 24-34
Gender Male, 67.7%
Calm 51.9%
Disgusted 20.4%
Surprised 14.1%
Angry 8%
Fear 6.3%
Happy 5.3%
Sad 2.6%
Confused 1.7%

AWS Rekognition

Age 0-4
Gender Male, 94.3%
Confused 95%
Surprised 6.3%
Fear 6%
Calm 3.3%
Sad 2.3%
Disgusted 0.7%
Happy 0.1%
Angry 0%

AWS Rekognition

Age 21-29
Gender Male, 77.4%
Calm 98.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 1%
Confused 0.1%
Disgusted 0.1%
Angry 0%

AWS Rekognition

Age 0-4
Gender Female, 98.8%
Sad 98.4%
Calm 36.5%
Fear 8.4%
Surprised 6.4%
Angry 0.6%
Confused 0.5%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 14-22
Gender Female, 89.8%
Calm 75.3%
Sad 9.3%
Fear 8.1%
Surprised 6.7%
Happy 3.7%
Disgusted 2.2%
Angry 1.2%
Confused 0.8%

AWS Rekognition

Age 4-10
Gender Male, 62.3%
Happy 33.3%
Calm 27.5%
Fear 14.7%
Surprised 7.8%
Disgusted 7.2%
Angry 5.3%
Confused 4.6%
Sad 3.9%

AWS Rekognition

Age 13-21
Gender Male, 93%
Calm 97.4%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Confused 0.6%
Disgusted 0.2%
Angry 0.2%
Happy 0.2%

AWS Rekognition

Age 20-28
Gender Female, 66.5%
Angry 66.4%
Surprised 20.5%
Sad 7.7%
Fear 6.8%
Calm 2.5%
Confused 1.6%
Disgusted 1.1%
Happy 1.1%

AWS Rekognition

Age 12-20
Gender Female, 93.6%
Calm 87.5%
Surprised 6.8%
Fear 6.1%
Angry 4.6%
Sad 2.7%
Happy 2.5%
Confused 1.4%
Disgusted 0.6%

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 13
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people standing in front of a mirror 84.7%
a group of people standing in front of a mirror posing for the camera 75.9%
a group of people in front of a mirror 75.8%