Human Generated Data

Title

Untitled (two photographs: group gathered around piano, blurred; large family portrait in studio)
Date

c. 1935, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6066

Human Generated Data

Title

Untitled (two photographs: group gathered around piano, blurred; large family portrait in studio)

People

Artist: Durette Studio, American 20th century

Date

c. 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6066

Machine Generated Data

Tags

Amazon
created on 2019-05-30

Interior Design 99.8
Indoors 99.8
Musician 99.5
Human 99.5
Musical Instrument 99.5
Person 97.4
Person 96.8
Room 95.9
Music Band 94.9
Person 94.5
Person 93.8
Person 93.1
Theater 91.7
Person 90.7
Leisure Activities 88.5
Person 88.4
Person 88
Person 83.4
Crowd 83
People 80.7
Helmet 74.5
Clothing 74.5
Apparel 74.5
Person 73.2
Person 69.9
Person 64.8
Person 62.1
Person 59.7
Concert 59.1
Person 56.9
Person 53.3

Clarifai
created on 2019-05-30

people 99.9
group 98.8
many 98.2
adult 97.2
man 96.3
woman 94.8
child 92.6
wear 92
portrait 90.1
music 87.1
one 86
group together 81.3
indoors 81.1
musician 79.9
snapshot 79.7
sit 78.7
leader 77.5
furniture 76.8
outfit 76.7
facial expression 74.5

Imagga
created on 2019-05-30

black 27
silhouette 25.6
grunge 23
design 16.3
art 16.3
people 15.6
person 14.5
sexy 14.4
dark 13.4
man 13
event 12.9
symbol 12.8
vintage 12.6
frame 12.3
world 12.2
fashion 12.1
night 11.5
adult 11.2
dress 10.8
team 10.7
sport 10.7
retro 10.6
male 10.6
decoration 10.5
party 10.3
negative 9.6
couple 9.6
pattern 9.6
window 9.5
icon 9.5
poster 9.4
global 9.1
player 9.1
old 9.1
paint 9
dirty 9
antique 8.8
celebration 8.8
graphic 8.7
ball 8.7
light 8.7
football 8.6
model 8.5
culture 8.5
card 8.5
competition 8.2
dance 8.2
style 8.2
lady 8.1
religion 8.1
love 7.9
kick 7.8
film 7.8
portrait 7.8
play 7.7
modern 7.7
ink 7.7
crowd 7.7
texture 7.6
group 7.2
office 7.2
collection 7.2
face 7.1
boy 7.1

Google
created on 2019-05-30

Photograph 96.3
Black-and-white 68.3
Photography 67.8
Room 65.7
Art 65.5
Picture frame 51.9

Microsoft
created on 2019-05-30

person 98.4
clothing 93.4
man 81.8
black 68.4
old 66.1
human face 63.1
posing 59.5
black and white 58.7
music 50.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-38
Gender Male, 55%
Disgusted 45.2%
Sad 45.9%
Angry 45.6%
Surprised 45.3%
Calm 52.2%
Happy 45.2%
Confused 45.6%

AWS Rekognition

Age 23-38
Gender Female, 54%
Happy 45%
Surprised 45.1%
Confused 45%
Angry 45.1%
Sad 45.3%
Calm 54.3%
Disgusted 45%

AWS Rekognition

Age 23-38
Gender Male, 54.9%
Surprised 45.1%
Disgusted 45%
Angry 45.1%
Sad 45.1%
Confused 45.1%
Calm 54.6%
Happy 45%

AWS Rekognition

Age 16-27
Gender Male, 53.9%
Calm 54%
Sad 45.3%
Angry 45.3%
Confused 45.1%
Disgusted 45.1%
Surprised 45.2%
Happy 45.1%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Disgusted 45.2%
Calm 53.8%
Surprised 45.2%
Sad 45.2%
Angry 45.4%
Confused 45.2%
Happy 45%

AWS Rekognition

Age 26-43
Gender Female, 51.8%
Confused 45.2%
Happy 45%
Angry 46.1%
Sad 51.1%
Surprised 45.8%
Calm 46.4%
Disgusted 45.3%

AWS Rekognition

Age 19-36
Gender Male, 52.9%
Disgusted 45%
Surprised 45.1%
Sad 45.2%
Happy 45%
Calm 54.4%
Confused 45%
Angry 45.2%

AWS Rekognition

Age 20-38
Gender Female, 50.7%
Confused 45%
Happy 45%
Angry 45%
Sad 45%
Surprised 45%
Calm 55%
Disgusted 45%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Happy 45%
Confused 45%
Calm 54.6%
Angry 45.1%
Sad 45.2%
Disgusted 45%
Surprised 45.1%

AWS Rekognition

Age 4-9
Gender Female, 54.3%
Angry 49.1%
Confused 45.1%
Disgusted 45.1%
Surprised 45.2%
Happy 45%
Calm 50.4%
Sad 45.1%

AWS Rekognition

Age 23-38
Gender Male, 54.9%
Happy 45%
Confused 45%
Angry 45%
Calm 54.8%
Disgusted 45%
Sad 45.1%
Surprised 45%

AWS Rekognition

Age 11-18
Gender Female, 52.7%
Sad 48.5%
Calm 49.3%
Angry 45.6%
Happy 45%
Disgusted 45.1%
Confused 45.5%
Surprised 45.8%

AWS Rekognition

Age 26-43
Gender Male, 54.3%
Confused 45.1%
Sad 45.2%
Happy 45%
Disgusted 45%
Calm 54.1%
Surprised 45.2%
Angry 45.3%

AWS Rekognition

Age 23-38
Gender Male, 52%
Sad 46.4%
Surprised 45.2%
Disgusted 45.1%
Confused 45.3%
Angry 45.8%
Happy 45%
Calm 52.2%

AWS Rekognition

Age 30-47
Gender Female, 50.1%
Disgusted 45.1%
Sad 45.5%
Angry 45.1%
Surprised 45.1%
Calm 54.1%
Happy 45.1%
Confused 45.1%

AWS Rekognition

Age 35-52
Gender Female, 50.9%
Sad 51.9%
Happy 45%
Angry 45.1%
Confused 45%
Surprised 45%
Disgusted 45%
Calm 47.9%

AWS Rekognition

Age 20-38
Gender Male, 51.5%
Confused 45.3%
Surprised 45.2%
Disgusted 45%
Angry 45.4%
Calm 53.5%
Sad 45.6%
Happy 45%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Happy 45%
Surprised 45.2%
Disgusted 45.2%
Confused 45.1%
Angry 48.7%
Calm 50.4%
Sad 45.4%

AWS Rekognition

Age 26-43
Gender Male, 53.7%
Sad 45.3%
Angry 45.1%
Disgusted 45%
Confused 45.1%
Happy 45%
Calm 54.4%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Female, 53.7%
Happy 45.1%
Confused 45.1%
Disgusted 45.3%
Calm 50.6%
Sad 48.5%
Angry 45.2%
Surprised 45.2%

AWS Rekognition

Age 26-43
Gender Male, 54.2%
Confused 45%
Sad 45.3%
Calm 54.3%
Surprised 45.1%
Disgusted 45%
Angry 45.1%
Happy 45%

AWS Rekognition

Age 38-59
Gender Female, 52.4%
Sad 47.8%
Disgusted 45.4%
Surprised 45.3%
Calm 49.9%
Angry 45.9%
Confused 45.3%
Happy 45.3%

AWS Rekognition

Age 4-7
Gender Female, 54.9%
Calm 51.3%
Sad 46.4%
Angry 45.5%
Confused 45.2%
Disgusted 45.4%
Surprised 45.8%
Happy 45.3%

AWS Rekognition

Age 1-5
Gender Male, 52.2%
Sad 45.6%
Happy 45%
Angry 45.1%
Surprised 45.1%
Calm 54.1%
Disgusted 45%
Confused 45.1%

AWS Rekognition

Age 15-25
Gender Male, 53.8%
Surprised 45.3%
Angry 46.5%
Confused 46%
Happy 45.2%
Calm 48.4%
Disgusted 46.1%
Sad 47.5%

AWS Rekognition

Age 10-15
Gender Female, 53.7%
Calm 47.6%
Disgusted 46.2%
Angry 45.4%
Happy 45.7%
Surprised 46.4%
Sad 48.1%
Confused 45.6%

AWS Rekognition

Age 16-27
Gender Female, 52.6%
Sad 51.1%
Angry 45.6%
Disgusted 45.3%
Confused 45.3%
Happy 45.6%
Calm 46.7%
Surprised 45.3%

AWS Rekognition

Age 26-43
Gender Male, 51.7%
Disgusted 45.2%
Confused 45.3%
Surprised 45.4%
Calm 52.5%
Happy 45.3%
Angry 45.5%
Sad 45.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.4%
Helmet 74.5%