Human Generated Data

Title

Untitled (formal portrait of seated woman and standing boy, both with decorative fobs)

Date

c. 1910-1920

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3732

Human Generated Data

Title

Untitled (formal portrait of seated woman and standing boy, both with decorative fobs)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Apparel 99.5
Clothing 99.5
Furniture 97.7
Chair 97.7
Human 96
Person 95.7
Female 87.5
Face 82.4
Sleeve 75.3
Overcoat 73.7
Suit 73.7
Coat 73.7
Portrait 70.1
Photography 70.1
Photo 70.1
Woman 69.1
Dress 63.9
People 61.8
Girl 61.1
Fashion 60.7
Gown 60.7
Long Sleeve 56.2

Clarifai
created on 2019-06-01

people 100
adult 99
two 97.6
wear 97.4
man 96.7
portrait 95.8
leader 94.9
one 94
administration 93.9
woman 91.9
group 88.6
retro 85.8
chair 85.3
three 83.6
furniture 79.3
actor 79.2
music 78.8
outfit 78.7
medical practitioner 76.7
actress 75.7

Imagga
created on 2019-06-01

nurse 42.7
groom 28.4
couple 27.9
bride 27
people 25.1
love 24.5
dress 23.5
wedding 22.1
portrait 21.4
happiness 19.6
person 19.2
adult 18.9
happy 18.2
man 18.1
mother 17
family 16.9
male 16
coat 15.5
two 15.2
bouquet 14.4
married 14.4
home 14.4
lab coat 14
women 13.4
romantic 13.4
clothing 13.3
old 13.2
gown 13
smiling 13
bridal 12.6
sexy 12
celebration 12
husband 11.6
smile 11.4
marriage 11.4
attractive 11.2
men 11.2
veil 10.8
care 10.7
cheerful 10.6
garment 10.5
wife 10.4
patient 10.1
face 9.9
parent 9.9
child 9.8
wed 9.8
fashion 9.8
human 9.7
indoors 9.7
flowers 9.6
decoration 9.5
historic 9.2
pretty 9.1
kin 9
lady 8.9
romance 8.9
ceremony 8.7
brunette 8.7
ancient 8.7
cute 8.6
elegance 8.4
tradition 8.3
religion 8.1
hospital 7.9
standing 7.8
art 7.8
health 7.6
life 7.6
room 7.5
traditional 7.5
new 7.3
hair 7.1
posing 7.1
interior 7.1
medical 7.1
together 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

wall 99.6
person 97.9
posing 95.9
man 95.9
clothing 93.3
human face 91.9
smile 85.6
dress 73.7
old 68
white 65.6
dressed 30.1

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 63.4%
Angry 2.5%
Sad 17.3%
Surprised 4.6%
Happy 5%
Calm 66%
Disgusted 1.5%
Confused 3.1%

AWS Rekognition

Age 26-43
Gender Female, 77.8%
Sad 26.9%
Angry 4.4%
Disgusted 2.7%
Surprised 3%
Happy 4.8%
Calm 56.6%
Confused 1.7%

Feature analysis

Amazon

Person 95.7%

Captions

Microsoft

a black and white photo of a man 91.5%
a man posing for a photo 91.4%
a man and a woman posing for a photo 80.7%