Human Generated Data

Title

Untitled (banquet hall dinner with adults and boy scouts)
Date

1938
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4051

Human Generated Data

Title

Untitled (banquet hall dinner with adults and boy scouts)

People

Artist: Durette Studio, American 20th century

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Person 99.6
Human 99.6
Person 99.3
Person 97.6
Person 96.7
Person 95.1
Person 93.7
Person 93.3
Person 92.3
Person 92.1
Person 91.5
Clothing 90
Apparel 90
Person 88
Person 86.2
Person 86
Accessories 83.9
Sunglasses 83.9
Accessory 83.9
Clinic 83
People 82.9
Person 81.8
Building 80.3
Person 72.5
Crowd 68.4
Coat 68.2
Indoors 63.6
Factory 61.8
Scientist 56.4
Hospital 55.5
Suit 55
Overcoat 55
Person 47.9

Clarifai
created on 2019-06-01

people 99.8
man 96.5
group together 96.2
group 96.1
crowd 93.6
many 93.3
audience 92.6
adult 92.2
indoors 88.9
woman 86.6
monochrome 83.3
uniform 75.1
music 69.6
sit 69.1
wear 68
war 67.3
military 64.4
education 63.7
motion 59.9
room 59.8

Imagga
created on 2019-06-01

boutique 29.8
stall 23
people 17.8
hall 16.7
ice 15.6
chandelier 15.5
business 14
human 13.5
crowd 12.5
lighting fixture 12.4
design 12.4
group 12.1
glass 12.1
art 11.3
party 11.2
modern 10.5
urban 10.5
men 10.3
life 10.3
light 10
water 10
music 9.9
celebration 9.6
women 9.5
fixture 9.3
city 9.1
hand 9.1
texture 9
medical 8.8
graphic 8.8
symbol 8.7
concert 8.7
man 8.7
love 8.7
work 8.6
day 8.6
walking 8.5
flag 8.4
event 8.3
negative 8.3
silhouette 8.3
development 8.1
science 8
night 8
chemical 7.9
couple 7.8
adult 7.8
scene 7.8
chemistry 7.7
professional 7.7
motion 7.7
grunge 7.7
instrument 7.4
technology 7.4
decoration 7.4
stage 7.4
wedding 7.4
person 7.3
backgrounds 7.3
black 7.2
world 7.2
groom 7.2
male 7.1
medicine 7
architecture 7

Google
created on 2019-06-01

Photograph 97.4
White 95.5
Snapshot 84.1
Black-and-white 82.7
Stock photography 79.1
Monochrome photography 73.3
Photography 72.5
Room 71.4
Event 71.1
Monochrome 67.6
Style 51
Crowd 50.7

Microsoft
created on 2019-06-01

person 89
wedding dress 88.2
clothing 87.2
man 86.3
table 73.6
wedding 73.4
bride 72.4
woman 63.8
group 62.1
clothes 34.1
crowd 22.9

Face analysis

Amazon

AWS Rekognition

Age 35-52
Gender Female, 50.1%
Confused 45.2%
Surprised 45.1%
Angry 45.2%
Calm 49.9%
Disgusted 45.2%
Sad 49.1%
Happy 45.3%

AWS Rekognition

Age 20-38
Gender Female, 58.1%
Happy 12%
Sad 6.7%
Surprised 4.3%
Confused 3%
Disgusted 2%
Calm 69.3%
Angry 2.5%

AWS Rekognition

Age 20-38
Gender Male, 54.4%
Surprised 45.5%
Disgusted 45.3%
Calm 45.7%
Happy 50.4%
Sad 47.2%
Angry 45.7%
Confused 45.4%

AWS Rekognition

Age 26-43
Gender Male, 54.1%
Disgusted 45.5%
Angry 45.6%
Confused 45.8%
Sad 48.2%
Happy 47.9%
Calm 46.3%
Surprised 45.7%

AWS Rekognition

Age 23-38
Gender Male, 51.8%
Confused 45.4%
Disgusted 45.2%
Happy 45.7%
Surprised 45.4%
Calm 49.1%
Sad 48.8%
Angry 45.4%

AWS Rekognition

Age 23-38
Gender Male, 51.6%
Angry 46%
Happy 45.8%
Confused 45.3%
Sad 45.8%
Calm 51.6%
Surprised 45.3%
Disgusted 45.2%

AWS Rekognition

Age 26-43
Gender Male, 54.4%
Calm 47.1%
Disgusted 45.2%
Sad 46.4%
Surprised 45.8%
Happy 48.4%
Confused 45.4%
Angry 46.7%

AWS Rekognition

Age 26-43
Gender Male, 54%
Disgusted 45.5%
Sad 46.1%
Calm 49.8%
Confused 45.9%
Surprised 45.8%
Happy 46.2%
Angry 45.7%

AWS Rekognition

Age 26-43
Gender Male, 53.7%
Happy 46.4%
Confused 45.8%
Angry 45.8%
Sad 46.8%
Calm 46.8%
Surprised 46.5%
Disgusted 47%

AWS Rekognition

Age 26-43
Gender Female, 52%
Happy 45.3%
Surprised 45.6%
Calm 49.8%
Sad 47.1%
Disgusted 45.4%
Angry 46.2%
Confused 45.6%

AWS Rekognition

Age 35-52
Gender Male, 51.4%
Disgusted 46.4%
Calm 46.7%
Surprised 45.8%
Angry 45.6%
Happy 46.4%
Sad 48.6%
Confused 45.5%

AWS Rekognition

Age 20-38
Gender Female, 50.7%
Calm 47.5%
Surprised 45.4%
Sad 49.2%
Confused 45.6%
Disgusted 45.4%
Happy 46.3%
Angry 45.6%

AWS Rekognition

Age 26-43
Gender Female, 54.7%
Sad 51.5%
Surprised 45.5%
Happy 46%
Angry 45.4%
Calm 45.6%
Confused 45.4%
Disgusted 45.6%

AWS Rekognition

Age 23-38
Gender Male, 51.4%
Angry 45.4%
Surprised 45.5%
Calm 51.2%
Sad 47%
Confused 45.3%
Disgusted 45.3%
Happy 45.3%

AWS Rekognition

Age 30-47
Gender Male, 53.7%
Sad 53.9%
Surprised 45.1%
Disgusted 45.1%
Angry 45.3%
Calm 45.5%
Happy 45.1%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Female, 53.7%
Angry 45.4%
Calm 48.9%
Sad 47.7%
Surprised 45.3%
Disgusted 45.3%
Happy 47.1%
Confused 45.3%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Surprised 49.5%
Disgusted 49.5%
Calm 49.6%
Happy 49.5%
Sad 50.2%
Angry 49.6%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Sad 49.5%
Angry 49.6%
Surprised 49.6%
Calm 49.6%
Disgusted 49.6%
Happy 50.1%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.6%
Happy 46.3%
Disgusted 45.5%
Sad 47.6%
Surprised 45.4%
Angry 48.1%
Calm 46.6%
Confused 45.4%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Disgusted 49.5%
Confused 49.6%
Angry 49.6%
Calm 49.6%
Surprised 49.7%
Happy 49.5%
Sad 49.8%

AWS Rekognition

Age 23-38
Gender Female, 53.5%
Angry 47.4%
Happy 47.8%
Confused 45.6%
Sad 46.7%
Calm 45.6%
Surprised 45.9%
Disgusted 46%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Surprised 49.6%
Calm 49.6%
Disgusted 49.6%
Confused 49.6%
Sad 49.7%
Happy 49.7%
Angry 49.7%

AWS Rekognition

Age 26-43
Gender Female, 54.6%
Confused 45.6%
Angry 46.1%
Sad 48.6%
Calm 46.2%
Disgusted 46.2%
Happy 46.9%
Surprised 45.6%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Disgusted 49.5%
Happy 49.6%
Sad 49.8%
Calm 49.8%
Angry 49.6%
Surprised 49.6%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Happy 49.7%
Calm 49.7%
Angry 49.6%
Surprised 49.5%
Disgusted 49.6%
Confused 49.6%
Sad 49.8%

AWS Rekognition

Age 26-43
Gender Male, 50.3%
Confused 45.3%
Happy 45.1%
Calm 46.5%
Disgusted 45.2%
Sad 46%
Angry 51.8%
Surprised 45.2%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Surprised 49.6%
Sad 49.6%
Angry 49.8%
Disgusted 49.6%
Calm 49.7%
Happy 49.6%
Confused 49.6%

AWS Rekognition

Age 35-52
Gender Female, 50%
Confused 49.5%
Sad 50.3%
Calm 49.5%
Happy 49.6%
Surprised 49.5%
Disgusted 49.5%
Angry 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Calm 49.6%
Surprised 49.5%
Disgusted 49.6%
Happy 49.6%
Sad 50.1%
Confused 49.5%
Angry 49.5%

AWS Rekognition

Age 29-45
Gender Male, 50.1%
Confused 49.5%
Surprised 49.5%
Happy 49.5%
Calm 50.2%
Sad 49.6%
Disgusted 49.5%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Angry 49.5%
Sad 49.7%
Happy 49.7%
Calm 49.8%
Confused 49.6%
Disgusted 49.5%
Surprised 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Calm 50.3%
Disgusted 49.5%
Confused 49.6%
Surprised 49.5%
Happy 49.6%
Sad 49.6%
Angry 49.5%

AWS Rekognition

Age 14-25
Gender Female, 50.3%
Sad 49.7%
Surprised 49.6%
Happy 49.5%
Angry 49.6%
Calm 49.5%
Confused 49.5%
Disgusted 50%

AWS Rekognition

Age 15-25
Gender Female, 50.3%
Disgusted 49.5%
Happy 49.5%
Surprised 49.5%
Sad 50.4%
Angry 49.5%
Confused 49.5%
Calm 49.5%

AWS Rekognition

Age 15-25
Gender Male, 50%
Confused 49.5%
Surprised 49.5%
Calm 49.6%
Sad 50.2%
Happy 49.5%
Disgusted 49.6%
Angry 49.6%

Feature analysis

Amazon

Person 99.6%
Sunglasses 83.9%

Captions

Microsoft

a group of people standing in front of a crowd 80.6%
a group of people standing in front of a crowd of people 79.3%
a group of people that are standing in front of a crowd 71.7%