Human Generated Data

Title

Untitled (banquet with people in corner dressed in costumes)
Date

c. 1935, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5797

Human Generated Data

Title

Untitled (banquet with people in corner dressed in costumes)

People

Artist: Durette Studio, American 20th century

Date

c. 1935, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Meal 99.4
Food 99.4
Human 99.2
Person 99.2
Person 98.5
Restaurant 97.6
Person 97.2
Person 97
Person 96
Person 92.5
Person 88.2
Cafeteria 87.9
Buffet 84.8
Person 84.7
Person 83.3
Person 82
Person 81.2
Dish 79.6
Supper 77.7
Dinner 77.7
Person 77.4
Crowd 74.3
Furniture 73.7
People 71.1
Person 66.2
Person 64.3
Pub 63.2
Bar Counter 60.2
Table 59
Party 55.1
Person 48.6

Clarifai
created on 2019-11-16

people 99.8
group 99.3
group together 98.8
many 98.5
adult 97.1
woman 96.7
man 93.4
wear 91.8
military 90.8
furniture 90
administration 88.2
room 88
child 87.8
education 87.6
war 87.4
sit 86.2
recreation 84.6
monochrome 84.5
crowd 83.2
outfit 82.7

Imagga
created on 2019-11-16

shop 31.9
people 27.9
barbershop 27.8
window 23.9
interior 23
man 21.5
mercantile establishment 20.9
salon 20.1
indoors 17.6
person 16.9
building 16.3
room 16.2
business 15.8
urban 15.7
city 15
place of business 14.9
chair 14.3
office 14
men 13.7
adult 13.6
male 13.5
restaurant 13.4
light 12.7
women 12.6
life 12.3
table 12.1
modern 11.9
inside 11
indoor 10.9
architecture 10.9
working 9.7
couple 9.6
love 9.5
work 9.4
lifestyle 9.4
glass 9.3
occupation 9.2
furniture 9.1
dress 9
businessman 8.8
motion 8.6
clothing 8.3
fashion 8.3
employee 8.3
night 8
design 7.9
sitting 7.7
establishment 7.7
waiter 7.7
elegance 7.5
silhouette 7.4
style 7.4
black 7.4
street 7.4
group 7.2
worker 7.2
boutique 7.2
home 7.2
professional 7.2
transportation 7.2
holiday 7.2

Google
created on 2019-11-16

Photograph 96.6
Black-and-white 87.2
Snapshot 85.6
Crowd 75
Photography 72.5
Room 71.4
Stock photography 70.4
Monochrome 70.2
Event 69.4
Art 62.5
Banquet 59.1
Monochrome photography 57.8
Style 51

Microsoft
created on 2019-11-16

person 99.2
clothing 95.9
text 95.4
group 90.3
people 86.3
woman 86.3
table 82.6
man 79
black and white 63
old 60.9
posing 52.8
clothes 15.9
dining room 7.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-51
Gender Female, 54.9%
Happy 54.6%
Angry 45.1%
Disgusted 45.1%
Surprised 45%
Calm 45.1%
Sad 45%
Fear 45%
Confused 45.1%

AWS Rekognition

Age 26-42
Gender Female, 55%
Confused 45.2%
Angry 45.6%
Surprised 45.1%
Calm 45.2%
Disgusted 45.3%
Fear 46.7%
Sad 51.3%
Happy 45.8%

AWS Rekognition

Age 22-34
Gender Female, 54.9%
Angry 45%
Surprised 45.2%
Sad 45%
Happy 54.8%
Disgusted 45%
Confused 45%
Calm 45%
Fear 45%

AWS Rekognition

Age 21-33
Gender Female, 54.9%
Calm 45%
Angry 45%
Disgusted 45%
Happy 54.9%
Sad 45%
Confused 45%
Fear 45%
Surprised 45%

AWS Rekognition

Age 22-34
Gender Male, 54.1%
Confused 45.4%
Happy 45.2%
Fear 45.2%
Sad 51.3%
Surprised 45.2%
Angry 45.3%
Disgusted 45.2%
Calm 47.4%

AWS Rekognition

Age 33-49
Gender Female, 54.3%
Happy 48.9%
Sad 45.4%
Disgusted 45.2%
Fear 45.9%
Calm 46%
Angry 47.6%
Confused 45.4%
Surprised 45.6%

AWS Rekognition

Age 24-38
Gender Female, 54.9%
Fear 45.1%
Calm 45.2%
Happy 45.2%
Surprised 45.1%
Angry 48.9%
Sad 45.1%
Disgusted 49.8%
Confused 45.6%

AWS Rekognition

Age 47-65
Gender Female, 55%
Happy 48.6%
Fear 45.6%
Sad 47.8%
Confused 45.7%
Disgusted 45.7%
Surprised 45.3%
Calm 46%
Angry 45.4%

AWS Rekognition

Age 21-33
Gender Female, 54.7%
Angry 45%
Happy 54.7%
Disgusted 45%
Confused 45%
Surprised 45.1%
Calm 45%
Fear 45.1%
Sad 45%

AWS Rekognition

Age 46-64
Gender Female, 54.8%
Angry 45%
Happy 54.8%
Disgusted 45%
Calm 45%
Fear 45%
Surprised 45%
Sad 45.1%
Confused 45%

AWS Rekognition

Age 31-47
Gender Female, 52.9%
Sad 45%
Angry 45.1%
Calm 45%
Happy 45.1%
Surprised 45.1%
Confused 45%
Disgusted 45%
Fear 54.5%

AWS Rekognition

Age 22-34
Gender Female, 54.8%
Angry 45.5%
Fear 45.7%
Confused 46%
Calm 48.8%
Sad 46.2%
Disgusted 46%
Surprised 45.5%
Happy 46.3%

AWS Rekognition

Age 51-69
Gender Male, 51.9%
Disgusted 45%
Happy 49.7%
Angry 45.1%
Fear 45.2%
Sad 46.7%
Surprised 45.1%
Confused 45.1%
Calm 48%

AWS Rekognition

Age 51-69
Gender Male, 54.7%
Sad 47.7%
Fear 50%
Angry 45.8%
Surprised 45.2%
Confused 45.1%
Calm 45.5%
Happy 45.4%
Disgusted 45.3%

AWS Rekognition

Age 31-47
Gender Female, 55%
Sad 45.8%
Disgusted 45.2%
Fear 45.9%
Angry 45.4%
Happy 52.1%
Surprised 45.2%
Calm 45.1%
Confused 45.2%

AWS Rekognition

Age 26-42
Gender Male, 54.8%
Disgusted 45%
Fear 45%
Surprised 45.1%
Angry 45%
Calm 45%
Happy 54.8%
Confused 45%
Sad 45%

AWS Rekognition

Age 28-44
Gender Female, 52.3%
Disgusted 45%
Sad 48.8%
Happy 45%
Surprised 45.1%
Calm 50.9%
Fear 45%
Confused 45.1%
Angry 45.1%

AWS Rekognition

Age 22-34
Gender Male, 54.6%
Sad 51.5%
Confused 45.1%
Fear 45.1%
Happy 45%
Surprised 45.1%
Angry 45.1%
Calm 48%
Disgusted 45.1%

AWS Rekognition

Age 21-33
Gender Male, 54.4%
Angry 45.2%
Confused 45.1%
Disgusted 45%
Happy 45%
Sad 54.3%
Fear 45%
Calm 45.3%
Surprised 45%

AWS Rekognition

Age 30-46
Gender Female, 51.4%
Confused 45.6%
Surprised 45.3%
Sad 50.5%
Calm 47.4%
Disgusted 45.2%
Happy 45.5%
Fear 45.3%
Angry 45.3%

AWS Rekognition

Age 22-34
Gender Male, 50.3%
Disgusted 49.5%
Calm 50.1%
Confused 49.5%
Sad 49.6%
Happy 49.6%
Angry 49.5%
Fear 49.6%
Surprised 49.6%

AWS Rekognition

Age 22-34
Gender Male, 50.4%
Confused 49.5%
Happy 49.5%
Disgusted 49.5%
Calm 49.6%
Angry 49.5%
Sad 50.3%
Surprised 49.5%
Fear 49.6%

AWS Rekognition

Age 13-25
Gender Female, 50.5%
Angry 49.6%
Surprised 49.5%
Disgusted 49.6%
Confused 49.6%
Fear 49.6%
Calm 49.6%
Happy 49.7%
Sad 49.8%

AWS Rekognition

Age 26-42
Gender Female, 50.1%
Surprised 49.5%
Fear 49.6%
Disgusted 49.5%
Calm 49.6%
Angry 49.6%
Confused 49.5%
Happy 49.5%
Sad 50.2%

AWS Rekognition

Age 5-15
Gender Male, 50.2%
Fear 50.3%
Surprised 49.6%
Angry 49.5%
Sad 49.5%
Disgusted 49.5%
Happy 49.5%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 46-64
Gender Female, 53.1%
Fear 45.1%
Angry 45.1%
Happy 53.8%
Disgusted 45.1%
Confused 45.1%
Calm 45.3%
Sad 45.6%
Surprised 45.1%

AWS Rekognition

Age 17-29
Gender Female, 50.5%
Happy 49.9%
Sad 49.9%
Confused 49.5%
Disgusted 49.5%
Angry 49.5%
Surprised 49.5%
Calm 49.5%
Fear 49.6%

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 60
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a group of people posing for a photo 97%
a vintage photo of a group of people posing for the camera 95.4%
a vintage photo of a group of people standing in front of a crowd 94.7%