Human Generated Data

Title

Untitled (group in dining room with two children on table)
Date

1937
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4164

Human Generated Data

Title

Untitled (group in dining room with two children on table)

People

Artist: Durette Studio, American 20th century

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Human 99.6
Person 99.6
Person 99.5
Person 99.3
Person 99.1
Apparel 99
Dress 99
Clothing 99
Person 97.9
Person 96.5
Person 96.2
Person 95.2
Person 94.6
Person 92.3
Person 91.4
Female 88.9
Furniture 85.9
Chair 85.9
Overcoat 76.6
Coat 76.6
Suit 76.6
Creme 75.7
Food 75.7
Icing 75.7
Dessert 75.7
Cake 75.7
Cream 75.7
People 73.7
Face 73.5
Person 72
Meal 71.8
Girl 70.9
Woman 70.8
Plant 65.3
Petal 65.3
Flower 65.3
Blossom 65.3
Kid 65.2
Child 65.2
Indoors 62.5
Room 62.5
Footwear 59.1
Shoe 59.1
Robe 58.7
Fashion 58.7
Gown 58.7
Evening Dress 58.7
Photography 58.5
Photo 58.5

Clarifai
created on 2019-06-01

people 99.6
group 99.5
group together 98.8
child 97.3
man 94.8
many 94.1
adult 93
woman 91.4
several 89.9
five 88.9
wear 85.1
family 84.9
portrait 82.7
facial expression 81.9
leader 81.8
music 81.4
enjoyment 80
education 77.9
boy 77.4
four 77

Imagga
created on 2019-06-01

person 30.5
people 25.1
adult 21.8
man 19.5
happy 19.4
clothing 19.1
cap 18.6
male 17.8
teacher 17.5
portrait 17.5
sexy 16.8
attractive 16.1
shower cap 15.9
fashion 15.8
women 15.8
couple 14.8
dress 14.4
pretty 14
headdress 13.8
indoors 13.2
senior 13.1
men 12.9
love 12.6
happiness 12.5
kin 12.2
model 11.7
smiling 11.6
lifestyle 11.6
blackboard 11.4
cheerful 11.4
room 11.3
educator 11.2
party 11.2
child 11.1
elegance 10.9
black 10.8
holiday 10.7
lady 10.5
blond 10.4
hair 10.3
casual 10.2
hand 9.9
fun 9.7
professional 9.7
style 9.6
sibling 9.6
home 9.6
smile 9.3
face 9.2
human 9
posing 8.9
night 8.9
education 8.6
sitting 8.6
business 8.5
friends 8.4
friendship 8.4
drink 8.3
leisure 8.3
patient 8
looking 8
celebration 8
businessman 7.9
medical 7.9
stage 7.9
nightlife 7.8
nightclub 7.8
60s 7.8
hands 7.8
dancing 7.7
bride 7.7
elderly 7.7
enjoying 7.6
laughing 7.6
holding 7.4
wine 7.4
hospital 7.3
light 7.3
occupation 7.3
sensual 7.3
make 7.3
gorgeous 7.2
nurse 7.1
modern 7
together 7

Google
created on 2019-06-01

Photograph 96.8
Snapshot 86.6
Black-and-white 78.1
Stock photography 75
Photography 67.8
Room 65.7
Monochrome photography 57.8
Monochrome 54.4
Family 54.3

Microsoft
created on 2019-06-01

person 99
clothing 95.4
indoor 93.4
standing 78.9
posing 69.5
old 41.8

Face analysis

Amazon

AWS Rekognition

Age 23-38
Gender Female, 54.1%
Disgusted 45.1%
Calm 50%
Surprised 45.5%
Angry 45.2%
Happy 47.5%
Sad 46.5%
Confused 45.2%

AWS Rekognition

Age 48-68
Gender Male, 55%
Sad 48%
Happy 46.5%
Surprised 45.5%
Calm 48.4%
Disgusted 45.1%
Confused 45.8%
Angry 45.7%

AWS Rekognition

Age 23-38
Gender Female, 53.7%
Angry 45.2%
Disgusted 45.1%
Happy 49.1%
Sad 45.3%
Surprised 45.6%
Calm 49.6%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Male, 54.9%
Disgusted 45.1%
Angry 45.8%
Confused 45.3%
Sad 45.9%
Happy 47.6%
Calm 49.7%
Surprised 45.5%

AWS Rekognition

Age 27-44
Gender Male, 99.3%
Happy 15.2%
Confused 3.5%
Disgusted 1.9%
Sad 9%
Calm 63.4%
Angry 4.9%
Surprised 2.2%

AWS Rekognition

Age 26-43
Gender Male, 50.3%
Disgusted 45.1%
Sad 45.2%
Surprised 46.6%
Happy 51.4%
Angry 45.4%
Calm 46%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Male, 54%
Confused 45.5%
Happy 46.6%
Surprised 47.8%
Angry 45.9%
Disgusted 45.1%
Calm 47.1%
Sad 47%

AWS Rekognition

Age 26-43
Gender Female, 63.7%
Surprised 3.1%
Calm 89.5%
Disgusted 0.7%
Confused 1.5%
Sad 1.5%
Happy 2.5%
Angry 1.3%

AWS Rekognition

Age 26-43
Gender Female, 92.7%
Disgusted 1.4%
Sad 1.4%
Confused 2.5%
Happy 78.6%
Angry 3.2%
Surprised 7%
Calm 6.1%

AWS Rekognition

Age 23-38
Gender Male, 54.8%
Happy 46.2%
Disgusted 45.2%
Angry 45.7%
Surprised 45.5%
Sad 45.5%
Calm 51.7%
Confused 45.3%

AWS Rekognition

Age 20-38
Gender Male, 53.2%
Calm 47.5%
Surprised 46.2%
Sad 46.6%
Confused 45.9%
Disgusted 45.4%
Happy 47.9%
Angry 45.4%

AWS Rekognition

Age 23-38
Gender Female, 84.9%
Angry 11.8%
Disgusted 2.6%
Confused 3.5%
Calm 19.7%
Sad 7.7%
Surprised 6.1%
Happy 48.5%

Feature analysis

Amazon

Person 99.6%
Chair 85.9%
Shoe 59.1%

Captions

Microsoft

a group of people posing for a photo 87.9%
a group of people posing for the camera 87.8%
a group of people posing for a picture 87.7%