Human Generated Data

Title

Untitled (men at luncheon advertising for Green's Appleole)

Date

c. 1938, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5748

Human Generated Data

Title

Untitled (men at luncheon advertising for Green's Appleole)

People

Artist: Durette Studio, American 20th century

Date

c. 1938, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 99.1
Human 99.1
Person 97.6
Person 94.6
Accessories 93.5
Tie 93.5
Accessory 93.5
Crowd 93
Person 92.4
Person 89.7
Person 82.7
Suit 81.3
Coat 81.3
Apparel 81.3
Clothing 81.3
Overcoat 81.3
Person 80.8
Indoors 80.5
Room 78.4
Person 75.6
Person 75.4
Furniture 70.9
Person 68.9
Suit 65.9
People 60.3
Press Conference 59.2
Table 57.7
Bar Counter 57.5
Pub 57.5
Person 57.4
Tie 57.4
Audience 55.5
Person 53

Clarifai
created on 2019-11-16

people 99.7
group 99
many 98.9
group together 98.4
leader 94.9
adult 93.9
man 93.9
administration 92.1
several 90.4
woman 87.5
chair 87.3
outfit 83.5
military 80.6
room 78.3
war 75.7
wear 75.2
journalist 73.8
five 73.6
crowd 72.8
meeting 71.3

Imagga
created on 2019-11-16

cornet 32.6
people 32.3
man 31.6
brass 31.3
wind instrument 28.6
person 26.1
musical instrument 25.8
male 25.5
adult 22.1
business 21.2
group 19.3
couple 18.3
silhouette 18.2
men 16.3
teacher 16
party 15.5
black 15.1
businessman 15
room 14.6
music 14.5
women 14.2
fashion 12.8
office 12.2
fun 12
happiness 11.7
professional 11.7
handsome 11.6
window 11.4
club 11.3
hands 11.3
dance 11.2
youth 11.1
love 11
indoor 10.9
disco 10.9
nightclub 10.7
night 10.6
happy 10.6
crowd 10.5
meeting 10.4
suit 10.3
entertainment 10.1
communication 10.1
light 10
dress 9.9
concert 9.7
indoors 9.7
dancing 9.6
show 9.6
photographer 9.6
education 9.5
gesture 9.5
corporate 9.4
lifestyle 9.4
classroom 9.3
elegance 9.2
teenager 9.1
stage 9.1
style 8.9
clothing 8.9
performer 8.7
stringed instrument 8.7
chair 8.5
adults 8.5
two 8.5
modern 8.4
educator 8.4
attractive 8.4
event 8.3
teen 8.3
outfit 8.2
dancer 8.1
celebration 8
job 8
work 7.8
boy 7.8
standing 7.8
rock 7.8
pretty 7.7
performance 7.7
hand 7.6
relationship 7.5
sound 7.5
manager 7.4
guitar 7.3
musician 7.3
board 7.2
case 7.2
romance 7.1
romantic 7.1
portrait 7.1
interior 7.1
working 7.1
world 7
singer 7
together 7

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

person 98.6
text 97.7
posing 96
clothing 93.9
man 92.2
group 87.8
black and white 82.5
bottle 82
people 81.2
old 62.4
suit 61.7
crowd 0.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 32-48
Gender Male, 94.1%
Sad 0.3%
Disgusted 0.7%
Confused 0.3%
Surprised 0.3%
Happy 96.9%
Fear 0.1%
Angry 0.3%
Calm 1.2%

AWS Rekognition

Age 24-38
Gender Male, 54.3%
Calm 45.8%
Disgusted 45%
Surprised 45%
Fear 45%
Happy 45%
Angry 45.1%
Confused 45.1%
Sad 54%

AWS Rekognition

Age 36-52
Gender Male, 99.5%
Calm 95.9%
Confused 1.4%
Fear 0.1%
Sad 1.1%
Angry 0.4%
Surprised 0.6%
Disgusted 0.4%
Happy 0.1%

AWS Rekognition

Age 40-58
Gender Male, 53.6%
Fear 45.3%
Surprised 45.1%
Angry 45.5%
Calm 47.2%
Sad 49.9%
Happy 45.9%
Disgusted 45.7%
Confused 45.4%

AWS Rekognition

Age 23-35
Gender Male, 54.1%
Sad 53.5%
Angry 45.1%
Happy 45%
Calm 46.3%
Fear 45%
Disgusted 45%
Confused 45%
Surprised 45%

AWS Rekognition

Age 28-44
Gender Male, 54.1%
Sad 54%
Fear 45.2%
Angry 45.1%
Surprised 45%
Confused 45.1%
Calm 45.3%
Happy 45.2%
Disgusted 45.1%

AWS Rekognition

Age 29-45
Gender Male, 53.8%
Surprised 45%
Confused 45.2%
Sad 53.2%
Disgusted 45.3%
Angry 45.1%
Calm 45.7%
Fear 45.2%
Happy 45.2%

AWS Rekognition

Age 32-48
Gender Male, 54.9%
Fear 45.1%
Calm 45.5%
Sad 45.3%
Surprised 45.2%
Disgusted 45.2%
Angry 45.1%
Happy 45.5%
Confused 53%

AWS Rekognition

Age 33-49
Gender Male, 51.9%
Fear 48.9%
Sad 45.3%
Disgusted 48.6%
Surprised 45.3%
Calm 45.2%
Happy 45.3%
Angry 46.3%
Confused 45.2%

AWS Rekognition

Age 32-48
Gender Male, 54.8%
Surprised 45.1%
Sad 45.7%
Confused 45.2%
Happy 51.5%
Disgusted 46.2%
Fear 45.1%
Angry 45.2%
Calm 45.9%

AWS Rekognition

Age 30-46
Gender Male, 54.5%
Surprised 45.1%
Fear 45.3%
Angry 45.3%
Disgusted 45.3%
Sad 52.1%
Calm 45.6%
Happy 46.3%
Confused 45.1%

AWS Rekognition

Age 30-46
Gender Male, 54.3%
Happy 54.9%
Disgusted 45%
Fear 45%
Calm 45.1%
Angry 45%
Confused 45%
Sad 45%
Surprised 45%

AWS Rekognition

Age 49-67
Gender Male, 54.5%
Surprised 45%
Sad 45%
Disgusted 45%
Calm 45.2%
Fear 45%
Angry 45%
Happy 54.8%
Confused 45%

AWS Rekognition

Age 39-57
Gender Male, 52.9%
Sad 45.2%
Calm 45.1%
Angry 45.2%
Fear 45%
Happy 45.5%
Surprised 45%
Disgusted 54%
Confused 45%

AWS Rekognition

Age 51-69
Gender Male, 54.5%
Happy 46.9%
Fear 45.2%
Sad 45.8%
Confused 45.2%
Disgusted 46.3%
Angry 46.8%
Calm 48.5%
Surprised 45.3%

AWS Rekognition

Age 32-48
Gender Male, 54.1%
Angry 45.1%
Happy 45.3%
Disgusted 45.1%
Confused 45.1%
Surprised 45%
Calm 50%
Fear 45%
Sad 49.3%

AWS Rekognition

Age 32-48
Gender Male, 54.8%
Happy 46.9%
Fear 45.8%
Sad 46.7%
Confused 46.8%
Disgusted 45.4%
Angry 46.2%
Calm 46.6%
Surprised 45.5%

AWS Rekognition

Age 33-49
Gender Male, 54%
Surprised 45.1%
Angry 45.1%
Sad 45%
Fear 45%
Disgusted 45%
Happy 54.6%
Calm 45.1%
Confused 45%

AWS Rekognition

Age 36-54
Gender Male, 54.6%
Confused 45.2%
Calm 52.4%
Surprised 45.6%
Fear 45.1%
Happy 45.7%
Angry 45.2%
Sad 45.7%
Disgusted 45%

AWS Rekognition

Age 35-51
Gender Male, 54%
Disgusted 45.2%
Fear 45%
Calm 52.1%
Surprised 45.1%
Angry 45.2%
Confused 45.1%
Happy 45.4%
Sad 47%

AWS Rekognition

Age 36-52
Gender Male, 54.6%
Happy 45%
Confused 45%
Calm 53.9%
Fear 45%
Angry 45.8%
Sad 45%
Surprised 45.1%
Disgusted 45%

AWS Rekognition

Age 25-39
Gender Male, 54.3%
Confused 45.1%
Calm 45.1%
Sad 45.5%
Surprised 45.2%
Happy 52.9%
Disgusted 45.7%
Fear 45.2%
Angry 45.3%

AWS Rekognition

Age 38-56
Gender Male, 53.8%
Angry 45.6%
Sad 50.2%
Confused 45.2%
Calm 47.6%
Surprised 45.2%
Happy 45%
Disgusted 45.1%
Fear 46.2%

AWS Rekognition

Age 51-69
Gender Male, 54.8%
Angry 45.3%
Sad 45.5%
Happy 45.1%
Disgusted 45.1%
Calm 53.9%
Confused 45.1%
Surprised 45.1%
Fear 45.1%

AWS Rekognition

Age 48-66
Gender Male, 54.7%
Fear 45%
Happy 47.8%
Calm 51.9%
Sad 45%
Angry 45.1%
Surprised 45.2%
Disgusted 45%
Confused 45%

Microsoft Cognitive Services

Age 52
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 47
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 40
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Tie 93.5%
Suit 81.3%

Captions

Microsoft

a group of people posing for a photo 98.3%
a group of people posing for the camera 98.2%
a group of people posing for a picture 98.1%

Text analysis

Amazon

CHAMPAGNE
CHAMPACNE
Ppleol

Google

AMPAGNE
CHAMPAGNS AMPAGNE pple
CHAMPAGNS
pple