Human Generated Data

Title

Che

Date

1959, printed later

People

Artist: Lester Cole, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.520

Human Generated Data

Title

Che

People

Artist: Lester Cole, American

Date

1959, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Clothing 99.8
Apparel 99.8
Human 99.6
Person 99.6
Person 99.2
Hat 98.9
Person 97.8
Person 81.2
Face 71.7
Overcoat 69.2
Coat 69.2
Sun Hat 66.6
Suit 63.7
Crowd 62.9
Leisure Activities 60.2
Pub 58.5
Bar Counter 58.5
Performer 58.4
Officer 56.2
Military Uniform 56.2
Military 56.2
Sailor Suit 55.7

Imagga
created on 2021-12-14

television camera 48
man 42.3
television equipment 38.4
gun 31
equipment 30.5
electronic equipment 29.5
photographer 28.8
device 28.7
male 26.9
camera 23.5
oxygen mask 23.2
weapon 21.4
person 21.3
professional 21.1
lens 21.1
mask 19.7
people 19.5
breathing device 19.4
protection 18.2
military 17.4
adult 16.8
soldier 16.6
rifle 16.4
war 15.8
work 15.7
brass 15.3
black 14.4
uniform 14.4
portrait 13.6
shoot 13.6
danger 12.7
pistol 12.4
human 12
looking 12
zoom 11.7
firearm 11.6
wind instrument 11.6
digital 11.3
men 11.2
cornet 11
occupation 11
camouflage 10.8
army 10.7
photography 10.4
technology 10.4
business 10.3
safety 10.1
hand 9.9
shooting 9.8
job 9.7
revolver 9.4
binoculars 9.2
hold 9.2
industrial 9.1
instrument 8.9
worker 8.9
armed 8.8
working 8.8
warrior 8.8
video 8.7
gas 8.7
industry 8.5
face 8.5
action 8.4
color 8.3
focus 8.3
entertainment 8.3
holding 8.3
sport 8.2
musical instrument 7.9
camcorder 7.9
radiation 7.8
toxic 7.8
protective 7.8
laboratory 7.7
profession 7.7
one 7.5
security 7.3
microphone 7.2
look 7

Google
created on 2021-12-14

Photograph 94.2
Hat 93
Gesture 85.3
Sun hat 83.8
Fedora 82.7
Snapshot 74.3
Cap 73.8
Monochrome 72.6
Monochrome photography 71.3
Event 70.2
Stock photography 66.8
Crew 65.4
Suit 64.9
Belt 63.3
Art 61
Room 60.8
Font 58.9
Photo caption 53.7
History 52.7
Vintage clothing 51.8

Microsoft
created on 2021-12-14

person 99.9
text 92.3
brass 81.9
clothing 79.4
old 76.4
people 75.2
man 73.1
hat 69.6
group 66.2
family 15.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-45
Gender Male, 98.9%
Calm 92.3%
Sad 2.6%
Angry 2.4%
Confused 1.3%
Surprised 0.5%
Happy 0.5%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 22-34
Gender Male, 98.9%
Calm 96.2%
Surprised 1%
Angry 0.8%
Happy 0.7%
Sad 0.4%
Fear 0.3%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 22-34
Gender Male, 71.8%
Calm 33.6%
Angry 23%
Happy 14.6%
Surprised 11.3%
Sad 4.9%
Disgusted 4.8%
Confused 4.1%
Fear 3.7%

AWS Rekognition

Age 36-54
Gender Female, 50.4%
Calm 55%
Sad 19.3%
Happy 17.5%
Angry 3.2%
Fear 2.2%
Confused 1.5%
Surprised 0.6%
Disgusted 0.6%

AWS Rekognition

Age 13-23
Gender Male, 87.7%
Sad 94.2%
Calm 2.3%
Angry 1.1%
Fear 0.9%
Surprised 0.5%
Confused 0.5%
Happy 0.3%
Disgusted 0.1%

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Hat 98.9%

Captions

Microsoft

a group of people in an old photo of a man 94.3%
a group of people sitting in a chair 93.6%
a group of people sitting in chairs 93.5%