Human Generated Data

Title

Untitled (composite of family studio portrait from three separate photographs)

Date

c. 1910-1920

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3751

Human Generated Data

Title

Untitled (composite of family studio portrait from three separate photographs)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Clothing 99.9
Apparel 99.9
Human 99
Person 99
Person 98.9
Person 98.9
Person 98.8
Person 98.3
Face 92.8
Fashion 91.8
Gown 91.8
Robe 90.6
Person 89.3
People 85.2
Wedding 84.9
Female 84.5
Wedding Gown 76.1
Painting 72.2
Art 72.2
Child 67.2
Kid 67.2
Girl 66.9
Woman 65.9
Bridegroom 63.3
Photography 62.5
Photo 62.5
Portrait 61.4
Bride 59.8
Dress 58.1

Clarifai
created on 2019-06-01

people 99.9
group 99.5
adult 98.7
group together 97.5
wear 97
child 96.4
several 95.8
four 94.8
man 93.8
portrait 92.5
five 91.9
three 91.8
woman 91.6
facial expression 90.9
music 90.7
offspring 89.8
many 89.5
leader 85.4
administration 84.7
outfit 84.5

Imagga
created on 2019-06-01

groom 42.4
kin 38.9
bride 38.3
love 36.3
wedding 34.9
dress 31.6
people 29
happiness 29
nurse 28.8
happy 27.6
couple 27
person 26.9
married 26.8
portrait 25.9
adult 25.3
smiling 22.4
veil 21.5
male 19.9
fashion 19.6
man 19.5
celebration 18.3
marriage 18
wife 18
family 17.8
cute 17.2
child 17
together 16.6
human 16.5
smile 16.4
pretty 16.1
fun 15.7
face 15.6
cheerful 15.4
two 15.2
women 15
husband 14.5
mother 14.4
romantic 14.2
day 14.1
sibling 14.1
model 14
attractive 14
kiss 13.7
holiday 12.9
world 12.9
looking 12.8
gown 12.7
hair 12.7
romance 12.5
men 12
outdoors 11.2
joy 10.9
lifestyle 10.8
wed 10.8
bridal 10.7
life 10.6
sexy 10.4
summer 10.3
parent 10.3
joyful 10.1
elegance 10.1
traditional 10
ceremony 9.7
bouquet 9.4
passion 9.4
outdoor 9.2
blond 9.1
park 9.1
lady 8.9
their 8.8
brunette 8.7
eyes 8.6
females 8.5
grandma 8.3
event 8.3
one 8.2
girls 8.2
sensuality 8.2
new 8.1
posing 8
elderly 7.7
skin 7.6
head 7.6
pleasure 7.5
senior 7.5
closeup 7.4
daughter 7.3

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

human face 98.7
person 97.9
text 97.5
clothing 96.8
smile 92.3
baby 92.3
posing 89.9
toddler 80.3
old 73.4
woman 71.9
black and white 66.9

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 54.1%
Sad 45.1%
Confused 3.3%
Disgusted 10%
Surprised 3.8%
Angry 4.3%
Happy 8.9%
Calm 24.6%

AWS Rekognition

Age 6-13
Gender Male, 58%
Happy 6.5%
Disgusted 3.7%
Angry 4.9%
Surprised 3%
Sad 11%
Calm 67.3%
Confused 3.6%

AWS Rekognition

Age 20-38
Gender Female, 92.6%
Angry 9%
Calm 45.7%
Sad 16.4%
Surprised 4.5%
Disgusted 4%
Happy 18.1%
Confused 2.2%

AWS Rekognition

Age 26-43
Gender Male, 70.3%
Happy 2.1%
Disgusted 1.5%
Angry 0.9%
Calm 91.1%
Surprised 1.6%
Confused 1.4%
Sad 1.4%

AWS Rekognition

Age 19-36
Gender Female, 70.9%
Confused 7.2%
Angry 2.8%
Sad 30%
Calm 27.9%
Disgusted 1.9%
Happy 24.6%
Surprised 5.6%

AWS Rekognition

Age 20-38
Gender Male, 50%
Disgusted 49.5%
Calm 49.6%
Surprised 49.6%
Angry 49.6%
Happy 49.6%
Sad 50%
Confused 49.5%

Feature analysis

Amazon

Person 99%
Painting 72.2%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 84.7%
a vintage photo of a group of people posing for a picture 84.6%
a group of people posing for a photo 84.5%