Human Generated Data

Title

Untitled (studio portrait of family with parents and children)

Date

c. 1930

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4359

Human Generated Data

Title

Untitled (studio portrait of family with parents and children)

People

Artist: Durette Studio, American 20th century

Date

c. 1930

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Apparel 99.7
Clothing 99.7
Human 99.2
Person 99.2
Person 99.1
Person 99
Accessories 98.1
Tie 98.1
Accessory 98.1
Person 97.4
People 92.3
Person 88.3
Person 88.3
Shorts 81.3
Gown 78
Fashion 78
Robe 76.1
Shoe 75.3
Footwear 75.3
Wedding 72.2
Wedding Gown 64.9
Family 64.8
Poster 64
Advertisement 64
Female 56.5
Dress 56.2

Clarifai
created on 2019-06-01

people 99.9
group 98.5
child 98.2
woman 97.2
adult 96.1
man 96
group together 93.9
wear 89.1
several 88.6
portrait 88.3
veil 86.6
family 86.6
monochrome 86
four 86
vertical 86
indoors 85.6
medical practitioner 85.5
wedding 82.7
administration 82.6
five 81.9

Imagga
created on 2019-06-01

negative 66.7
film 54.5
photographic paper 40.6
fountain 31.3
photographic equipment 27.1
statue 22.3
structure 21.8
bride 20.8
dress 20.8
sculpture 20.2
people 19
kin 18.4
portrait 18.1
art 17.7
fashion 15.1
wedding 14.7
face 14.2
love 13.4
lady 13
person 11.8
marble 11.7
architecture 11.7
history 11.6
historical 11.3
monument 11.2
old 11.1
adult 11.1
happiness 11
stone 11
model 10.9
mother 10.8
pretty 10.5
head 10.1
tourism 9.9
religion 9.9
travel 9.9
attractive 9.8
posing 9.8
human 9.7
bouquet 9.7
groom 9.6
decoration 9.5
hair 9.5
culture 9.4
church 9.2
black 9
sexy 8.8
body 8.8
bridal 8.7
ancient 8.6
god 8.6
elegance 8.4
clothing 8.3
makeup 8.2
style 8.2
celebration 8
lifestyle 7.9
women 7.9
gown 7.9
cute 7.9
look 7.9
male 7.8
couple 7.8
veil 7.8
party 7.7
married 7.7
costume 7.6
column 7.6
city 7.5
child 7.4
historic 7.3
detail 7.2
bright 7.1
romantic 7.1
family 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

clothing 97.2
person 96.2
window 92.3
posing 86
human face 84.9
smile 79.7
baby 78.2
standing 76.6
dress 62.8
child 57.2
old 54.1
picture frame 10.2

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 97%
Surprised 7.7%
Sad 32.2%
Happy 18%
Angry 7.3%
Disgusted 4.1%
Confused 5.5%
Calm 25.2%

AWS Rekognition

Age 23-38
Gender Male, 94.6%
Angry 11.5%
Surprised 10.4%
Disgusted 5.2%
Sad 6.3%
Calm 34.7%
Happy 14.1%
Confused 17.8%

AWS Rekognition

Age 23-38
Gender Male, 52.3%
Angry 45.2%
Sad 45.2%
Disgusted 45.1%
Happy 45.3%
Calm 53.6%
Surprised 45.5%
Confused 45.2%

AWS Rekognition

Age 35-52
Gender Female, 54.4%
Happy 45.5%
Sad 46.6%
Surprised 47.9%
Confused 45.7%
Disgusted 45.3%
Calm 48.6%
Angry 45.3%

AWS Rekognition

Age 26-43
Gender Male, 54%
Confused 45.2%
Angry 45.3%
Sad 45.7%
Calm 52.8%
Disgusted 45.2%
Happy 45.6%
Surprised 45.3%

Feature analysis

Amazon

Person 99.2%
Tie 98.1%
Shoe 75.3%
Poster 64%

Captions

Microsoft

a group of people posing for a photo 91.1%
a group of people posing for a photo in front of a window 87%
a group of people standing in front of a window posing for the camera 81%