Human Generated Data

Title

Untitled (studio photograph of two girls standing with coats and hats)

Date

c. 1910-1920

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3698

Human Generated Data

Title

Untitled (studio photograph of two girls standing with coats and hats)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Apparel 100
Clothing 100
Coat 100
Hat 100
Bonnet 100
Person 96.9
Human 96.9
Person 96.7
Footwear 90.4
Boot 61.6
Shoe 60.7
Shoe 57.5

Clarifai
created on 2019-06-01

people 99.9
adult 98.1
portrait 98.1
two 97.1
wear 96.3
one 95.1
child 94.6
administration 93
man 93
monochrome 91.8
woman 91.5
group 90.9
three 88.5
outfit 85.3
facial expression 85.3
group together 84.8
leader 84.5
medical practitioner 83.9
actor 78.5
music 77.2

Imagga
created on 2019-06-01

nurse 78.2
people 21.8
statue 21.6
adult 21.3
person 19.6
clothing 18.4
sculpture 16.7
portrait 16.2
man 16.1
dress 14.4
attractive 14
old 13.9
fashion 13.6
male 12.8
model 12.4
lady 12.2
monument 12.1
coat 11.9
bride 11.7
religion 11.6
smile 11.4
brunette 11.3
historical 11.3
sexy 11.2
pretty 11.2
women 11.1
love 11
vintage 10.8
face 10.6
art 10.6
hair 10.3
stone 10.1
tourism 9.9
history 9.8
posing 9.8
human 9.7
looking 9.6
standing 9.6
ancient 9.5
happiness 9.4
wedding 9.2
historic 9.2
holding 9.1
black 9
garment 8.8
indoors 8.8
home 8.8
happy 8.8
couple 8.7
smiling 8.7
antique 8.7
god 8.6
men 8.6
negative 8.6
lab coat 8.5
casual 8.5
elegance 8.4
hat 8.3
family 8
body 8
lifestyle 7.9
business 7.9
day 7.8
travel 7.7
groom 7.6
room 7.5
clothes 7.5
city 7.5
world 7.5
style 7.4
light 7.4
pose 7.2
mother 7.2
marble 7.1
architecture 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

wall 99.2
clothing 98.5
coat 98
posing 96.4
standing 95.9
human face 91.9
dress 91.3
person 88.1
fashion accessory 86
smile 83.8
old 83.2
black and white 77.4
black 70.7
white 68.2
footwear 62.7
vintage clothing 57.7
skirt 56.1

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 93.5%
Disgusted 1.1%
Calm 79.2%
Sad 9.4%
Confused 1.9%
Angry 1.8%
Surprised 2.3%
Happy 4.3%

AWS Rekognition

Age 26-44
Gender Male, 55.5%
Disgusted 0.8%
Surprised 1.6%
Angry 1.6%
Confused 1.9%
Sad 82.2%
Calm 9.7%
Happy 2.1%

Feature analysis

Amazon

Coat 100%
Person 96.9%
Shoe 60.7%

Captions

Microsoft

a vintage photo of a man and woman posing for a picture 88.4%
a vintage photo of a man and a woman posing for a picture 88.3%
a man and a woman posing for a photo 86.7%