Human Generated Data

Title

Untitled (group of soldiers in the lobby of the Havana Hilton, Cuba)
Date

1959, printed later
People

Artist: Lester Cole, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.501

Human Generated Data

Title

Untitled (group of soldiers in the lobby of the Havana Hilton, Cuba)

People

Artist: Lester Cole, American

Date

1959, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.501

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.6
Human 99.6
Person 99.4
Person 98.6
Crowd 97.6
Person 97.5
Person 96.9
Person 95.8
Audience 94.9
Person 88.9
Person 88.5
Person 88.1
Person 86.3
Person 86.1
Person 80.8
Person 80
Person 76.4
Person 76.2
People 74.5
Person 74.2
Person 73.5
Person 71.1
Person 68.7
Person 66.9
Person 66.8
Person 65.8
Person 63.8
Person 60.5
Person 58.2
Person 54.1
Person 52.8

Clarifai
created on 2023-10-25

people 100
many 99.9
group together 99.6
group 99
crowd 97.4
man 97.2
adult 96.9
woman 94.5
administration 94.3
leader 93.5
street 93
spectator 87.1
audience 85.8
boy 83.1
uniform 80.4
outfit 80.1
military 80.1
chair 79.7
music 79.4
war 78.6

Imagga
created on 2021-12-14

pedestrian 25.2
uniform 20.8
man 19.5
city 18.3
people 17.8
clothing 17.5
military uniform 16
brass 14.3
helmet 13.7
protection 13.6
danger 13.6
military 13.5
transportation 13.4
sport 13
equipment 12.9
adult 12.3
person 12.2
vehicle 12
soldier 11.7
photographer 11.7
travel 11.3
street 11
industrial 10.9
war 10.6
crowd 10.6
urban 10.5
wind instrument 10.4
gun 10.3
motion 10.3
speed 10.1
power 10.1
covering 9.9
destruction 9.8
business 9.7
men 9.4
winter 9.4
male 9.2
football helmet 9.2
transport 9.1
snow 9
black 9
consumer goods 8.9
metal 8.8
accident 8.8
gas 8.7
train 8.6
walking 8.5
safety 8.3
station 8.1
activity 8.1
life 8
working 7.9
day 7.8
army 7.8
musical instrument 7.8
nuclear 7.7
industry 7.7
mask 7.7
hockey stick 7.7
dangerous 7.6
world 7.5
action 7.4
weapon 7.4
building 7.3
new 7.3
dirty 7.2
to 7.1

Google
created on 2021-12-14

Black-and-white 85.4
Style 84
Monochrome 74.9
Monochrome photography 74.6
Crew 73.8
Event 73.4
Crowd 73.2
Suit 67.7
Team 66.7
Stock photography 65.1
City 64.1
Street 63.4
History 63.1
Audience 59.5
Room 58.5
Government 54.4
Public event 52.5
Vintage clothing 52.2
Military person 50.1

Microsoft
created on 2021-12-14

person 99.6
group 97.2
outdoor 93.8
clothing 93.8
text 91.4
people 91.3
man 86.1
black and white 86
posing 62.1
crowd 55.9
watching 55.1
old 46.1
line 25

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-31
Gender Male, 99.1%
Calm 97.1%
Confused 1.1%
Sad 0.9%
Angry 0.4%
Fear 0.2%
Surprised 0.2%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 20-32
Gender Male, 98.6%
Calm 93%
Sad 4.2%
Angry 1.1%
Happy 0.5%
Confused 0.4%
Surprised 0.3%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 27-43
Gender Male, 97.3%
Calm 72.9%
Surprised 17.9%
Angry 6.3%
Confused 0.9%
Sad 0.7%
Fear 0.6%
Happy 0.5%
Disgusted 0.3%

AWS Rekognition

Age 17-29
Gender Male, 75.1%
Calm 95.1%
Sad 2.4%
Angry 1.2%
Surprised 0.5%
Fear 0.3%
Confused 0.2%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 25-39
Gender Male, 62.4%
Calm 63.4%
Happy 24.7%
Angry 3.8%
Disgusted 2.7%
Surprised 1.7%
Sad 1.3%
Confused 1.2%
Fear 1.1%

AWS Rekognition

Age 19-31
Gender Female, 84.9%
Calm 75.8%
Sad 9.2%
Fear 5%
Surprised 4.4%
Angry 3.4%
Confused 1.6%
Happy 0.4%
Disgusted 0.3%

AWS Rekognition

Age 32-48
Gender Male, 98.5%
Calm 95.7%
Sad 1%
Surprised 0.7%
Confused 0.7%
Happy 0.7%
Angry 0.5%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 20-32
Gender Male, 97.3%
Calm 94.4%
Surprised 1.7%
Angry 1.4%
Fear 0.7%
Happy 0.6%
Confused 0.4%
Sad 0.4%
Disgusted 0.2%

AWS Rekognition

Age 28-44
Gender Male, 98.3%
Calm 92.4%
Angry 3.5%
Sad 2.6%
Confused 0.5%
Fear 0.3%
Surprised 0.2%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 28-44
Gender Male, 99.1%
Calm 43.1%
Sad 37.8%
Confused 13.2%
Angry 2.1%
Fear 1.9%
Surprised 1%
Happy 0.7%
Disgusted 0.2%

AWS Rekognition

Age 20-32
Gender Male, 99.7%
Calm 98.7%
Surprised 0.4%
Confused 0.3%
Angry 0.3%
Sad 0.2%
Happy 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 33-49
Gender Male, 99.4%
Happy 90.4%
Calm 4.6%
Surprised 2.6%
Confused 0.7%
Fear 0.5%
Sad 0.5%
Disgusted 0.3%
Angry 0.3%

AWS Rekognition

Age 23-35
Gender Male, 99.9%
Calm 99.4%
Sad 0.4%
Confused 0.1%
Angry 0%
Surprised 0%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 26-40
Gender Female, 73.4%
Calm 56.4%
Angry 14.4%
Fear 7.5%
Sad 5.5%
Surprised 5.1%
Happy 4.3%
Confused 3.6%
Disgusted 3.2%

AWS Rekognition

Age 23-35
Gender Male, 98%
Calm 62.4%
Sad 19.6%
Confused 16.8%
Angry 0.4%
Surprised 0.4%
Fear 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 24-38
Gender Male, 98.2%
Calm 93.4%
Sad 3%
Happy 1.9%
Angry 0.6%
Surprised 0.5%
Confused 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 27-43
Gender Male, 99.6%
Happy 82.3%
Calm 5.2%
Confused 3.8%
Disgusted 3.2%
Angry 3.1%
Surprised 0.9%
Sad 0.9%
Fear 0.7%

AWS Rekognition

Age 20-32
Gender Male, 99.2%
Calm 55.8%
Angry 27.7%
Confused 10.8%
Sad 2.7%
Surprised 2%
Disgusted 0.5%
Fear 0.3%
Happy 0.1%

AWS Rekognition

Age 31-47
Gender Male, 96.8%
Calm 82.4%
Angry 5.9%
Sad 5.7%
Confused 2.6%
Fear 1.5%
Surprised 1.3%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 25-39
Gender Female, 97.1%
Calm 98%
Sad 0.8%
Surprised 0.4%
Confused 0.2%
Angry 0.2%
Happy 0.2%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 32-48
Gender Male, 94.2%
Calm 39.3%
Confused 25.3%
Surprised 12.4%
Sad 9.6%
Angry 6.6%
Fear 2.8%
Disgusted 2.7%
Happy 1.2%

AWS Rekognition

Age 19-31
Gender Male, 99.5%
Calm 43.5%
Fear 29%
Sad 8.8%
Angry 7.5%
Surprised 5.2%
Happy 3.2%
Confused 1.9%
Disgusted 1%

AWS Rekognition

Age 23-37
Gender Male, 68.9%
Calm 48.6%
Sad 37.2%
Angry 5.3%
Happy 3.6%
Confused 2.1%
Fear 1.4%
Surprised 0.9%
Disgusted 0.8%

AWS Rekognition

Age 21-33
Gender Female, 50.2%
Angry 72.4%
Sad 11.5%
Calm 7.2%
Happy 5.8%
Fear 1.1%
Surprised 0.7%
Confused 0.7%
Disgusted 0.5%

AWS Rekognition

Age 31-47
Gender Male, 96.4%
Happy 99.3%
Calm 0.5%
Sad 0.1%
Angry 0%
Surprised 0%
Fear 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 22-34
Gender Male, 96.5%
Calm 98.1%
Sad 0.8%
Happy 0.3%
Angry 0.3%
Confused 0.2%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 22-34
Gender Male, 65.8%
Calm 67.6%
Confused 23.9%
Sad 4.2%
Angry 1.8%
Surprised 1.1%
Happy 0.7%
Fear 0.5%
Disgusted 0.3%

AWS Rekognition

Age 21-33
Gender Male, 97.4%
Calm 91.7%
Surprised 4.4%
Angry 1.8%
Sad 0.7%
Fear 0.7%
Confused 0.4%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 20-32
Gender Male, 96.9%
Calm 88.4%
Angry 7.6%
Sad 1.8%
Confused 1.2%
Surprised 0.5%
Fear 0.3%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 36-54
Gender Male, 63.9%
Calm 98.5%
Angry 0.3%
Happy 0.3%
Sad 0.3%
Surprised 0.3%
Disgusted 0.2%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 30-46
Gender Male, 88.8%
Calm 98.8%
Sad 0.9%
Happy 0.1%
Angry 0.1%
Surprised 0%
Fear 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 20-32
Gender Male, 97.3%
Calm 87.2%
Surprised 3.5%
Sad 3.4%
Confused 2.3%
Angry 2.2%
Disgusted 0.5%
Fear 0.5%
Happy 0.3%

AWS Rekognition

Age 21-33
Gender Male, 98.7%
Calm 96.6%
Sad 1%
Confused 0.9%
Happy 0.5%
Surprised 0.5%
Disgusted 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 23-35
Gender Male, 76.2%
Calm 95.5%
Sad 1.6%
Disgusted 0.7%
Happy 0.6%
Surprised 0.5%
Confused 0.5%
Angry 0.3%
Fear 0.3%

AWS Rekognition

Age 23-35
Gender Male, 89%
Calm 94.4%
Confused 1.4%
Happy 1.2%
Sad 1%
Angry 0.8%
Surprised 0.7%
Disgusted 0.4%
Fear 0.1%

AWS Rekognition

Age 21-33
Gender Male, 90.1%
Calm 92.1%
Happy 3.2%
Angry 1.3%
Sad 1.2%
Surprised 0.7%
Confused 0.6%
Disgusted 0.5%
Fear 0.4%

AWS Rekognition

Age 27-43
Gender Male, 66.5%
Calm 77.5%
Angry 14.5%
Surprised 3.8%
Confused 3.4%
Sad 0.4%
Disgusted 0.2%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 28-44
Gender Male, 98.9%
Sad 39.5%
Fear 26.6%
Calm 13.8%
Angry 8%
Confused 5.3%
Surprised 2.5%
Happy 2.5%
Disgusted 1.8%

AWS Rekognition

Age 37-55
Gender Male, 85.2%
Calm 87%
Sad 5.2%
Surprised 2.8%
Confused 1.7%
Angry 1.3%
Fear 0.9%
Happy 0.6%
Disgusted 0.4%

AWS Rekognition

Age 24-38
Gender Male, 90.7%
Calm 74.3%
Sad 11.6%
Confused 10.3%
Surprised 2%
Angry 0.6%
Fear 0.6%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 23-37
Gender Male, 70.7%
Angry 38.1%
Sad 34.7%
Calm 24.5%
Confused 1.3%
Fear 0.5%
Disgusted 0.4%
Surprised 0.4%
Happy 0.2%

AWS Rekognition

Age 16-28
Gender Male, 89.4%
Calm 66.7%
Sad 20.3%
Confused 6.6%
Angry 3.6%
Surprised 0.9%
Disgusted 0.7%
Happy 0.7%
Fear 0.6%

AWS Rekognition

Age 21-33
Gender Female, 92.1%
Calm 77.8%
Sad 7.9%
Confused 4.1%
Happy 3.4%
Surprised 2.6%
Angry 2%
Fear 1.3%
Disgusted 0.9%

AWS Rekognition

Age 20-32
Gender Male, 84.3%
Sad 65.5%
Calm 25.7%
Angry 4%
Happy 1.9%
Surprised 0.8%
Confused 0.8%
Fear 0.8%
Disgusted 0.5%

AWS Rekognition

Age 26-42
Gender Male, 78.7%
Calm 84.7%
Sad 4.3%
Confused 3.2%
Happy 1.8%
Angry 1.6%
Surprised 1.5%
Disgusted 1.5%
Fear 1.4%

AWS Rekognition

Age 32-48
Gender Male, 98.5%
Calm 44.2%
Sad 39%
Angry 7.4%
Happy 6.7%
Fear 1.1%
Confused 0.9%
Surprised 0.5%
Disgusted 0.2%

AWS Rekognition

Age 31-47
Gender Female, 54.3%
Sad 57.4%
Angry 14.5%
Fear 9.7%
Calm 8.1%
Confused 7.2%
Surprised 2.1%
Disgusted 0.7%
Happy 0.3%

AWS Rekognition

Age 23-35
Gender Male, 52.2%
Sad 61.9%
Calm 20.4%
Angry 8%
Fear 3.5%
Confused 3.1%
Surprised 1.5%
Happy 1.1%
Disgusted 0.7%

AWS Rekognition

Age 29-45
Gender Female, 89.9%
Calm 63%
Surprised 20.4%
Happy 5.7%
Disgusted 4.4%
Sad 2.9%
Angry 2%
Confused 1%
Fear 0.7%

AWS Rekognition

Age 39-57
Gender Male, 89%
Sad 65%
Calm 34.3%
Angry 0.3%
Happy 0.2%
Confused 0.1%
Fear 0.1%
Surprised 0%
Disgusted 0%

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%