Human Generated Data

Title

Untitled (children wearing hats around table at birthday party)

Date

1931

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4261

Human Generated Data

Title

Untitled (children wearing hats around table at birthday party)

People

Artist: Durette Studio, American 20th century

Date

1931

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Human 99.6
Person 99.6
Person 98.3
Person 96.5
Person 95.6
Person 94.2
Person 92.7
Person 92.5
Person 92
Person 92
Person 84.1
People 78.8
Drawing 76.5
Art 76.5
Person 75.9
Person 74.7
Person 73.3
Crowd 71.4
Person 69.9
Indoors 68.7
Room 67.7
Face 62.5
Person 62
Person 61.2
Building 57.4

Clarifai
created on 2019-06-01

people 99.9
many 97.6
group 97.4
man 96.2
adult 94.9
group together 94.5
child 92.9
music 91.7
woman 91.1
military 88.7
crowd 87.3
wear 85.5
monochrome 82.4
war 79.6
recreation 78.2
administration 77
musician 76
audience 75.7
boy 75.7
uniform 75.3

Imagga
created on 2019-06-01

glass 30.6
sketch 24.6
drawing 22.9
chandelier 17.8
ice 17.7
art 16.1
design 15.7
cold 14.6
party 14.6
lighting fixture 14.2
grunge 13.6
water 13.3
representation 13.3
decoration 13.2
winter 12.8
pattern 12.3
snow 11.8
black 11.4
shape 11.2
style 11.1
graphic 10.9
reflection 10.8
fixture 10.7
frozen 10.5
drink 10
silhouette 9.9
transparent 9.8
texture 9.7
wineglass 9.7
negative 9.7
backgrounds 8.9
cool 8.9
film 8.8
splash 8.7
liquid 8.7
holiday 8.6
architecture 8.6
close 8.6
people 8.4
clean 8.3
backdrop 8.2
drop 8.2
group 8.1
wine 8
celebration 8
bright 7.9
table 7.8
color 7.8
wave 7.8
modern 7.7
ripple 7.6
hand 7.6
decorative 7.5
event 7.4
purity 7.4
retro 7.4
light 7.3
paint 7.2
male 7.1
decor 7.1
surface 7.1
season 7

Google
created on 2019-06-01

Photograph 96.6
Snapshot 86.7
Stock photography 80.3
Photography 74.8
Black-and-white 74.4
Room 71.4
History 62.6
Art 58.1
Team 52.3
Illustration 50.4

Microsoft
created on 2019-06-01

window 98.4
text 95.8
person 90.9
sketch 87.6
drawing 84.1
clothing 82.5
old 82.4
man 81.4
people 63.1
posing 60.1

Face analysis

Amazon

AWS Rekognition

Age 26-44
Gender Female, 50.3%
Angry 45.5%
Happy 46%
Sad 51.4%
Disgusted 45.5%
Confused 45.5%
Calm 45.8%
Surprised 45.4%

AWS Rekognition

Age 15-25
Gender Female, 53.7%
Angry 45.4%
Happy 45.3%
Calm 46.4%
Surprised 45.5%
Sad 51.2%
Confused 45.7%
Disgusted 45.5%

AWS Rekognition

Age 20-38
Gender Female, 54.3%
Confused 45.7%
Happy 49.1%
Surprised 45.7%
Angry 45.6%
Disgusted 46.5%
Calm 46.1%
Sad 46.4%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Angry 46.3%
Disgusted 46.5%
Confused 46%
Calm 47.8%
Sad 46.2%
Surprised 46%
Happy 46.2%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Sad 46.3%
Angry 45.8%
Disgusted 45.4%
Surprised 45.4%
Happy 46%
Calm 50.5%
Confused 45.6%

AWS Rekognition

Age 15-25
Gender Female, 54.2%
Confused 45.7%
Surprised 45.7%
Sad 48.4%
Angry 45.9%
Happy 46.1%
Calm 46.9%
Disgusted 46.4%

AWS Rekognition

Age 23-38
Gender Male, 54%
Happy 45.4%
Confused 45.3%
Angry 45.2%
Sad 48.8%
Calm 50%
Surprised 45.2%
Disgusted 45.2%

AWS Rekognition

Age 19-36
Gender Female, 51.7%
Calm 45.7%
Surprised 45.6%
Sad 46.6%
Confused 47.2%
Disgusted 45.4%
Happy 47.4%
Angry 47.1%

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people posing for a photo 86.1%
an old photo of a group of people posing for the camera 84.7%
an old photo of a group of people posing for a picture 84.6%