Human Generated Data

Title

Untitled (nine member family photograph taken inside home)

Date

c. 1910-1920

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3685

Human Generated Data

Title

Untitled (nine member family photograph taken inside home)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Clothing 99.7
Apparel 99.7
Person 99.1
Human 99.1
Person 98.9
Person 98.5
Person 98.2
Person 97.1
Person 95.7
Person 95.1
Dress 88.2
Art 78.4
Outdoors 77.1
Nature 77
Female 75.1
People 72.1
Fashion 68.4
Snow 66.8
Gown 65.7
Robe 64.7
Photo 63
Photography 63
Drawing 60.3
Costume 58.9
Face 57.8
Woman 56.6

Clarifai
created on 2019-06-01

people 100
group 99.7
child 98.9
adult 98.6
group together 98.6
many 96.9
man 94.9
administration 92.8
woman 92.8
leader 92.3
wear 90.1
outfit 89
several 88.7
boy 87.2
war 85
military 83.4
education 79
home 78.5
veil 78.4
room 73.5

Imagga
created on 2019-06-01

kin 100
people 27.9
bride 22.3
man 22.2
dress 21.7
happy 20
couple 20
groom 19.9
person 18.8
portrait 18.1
winter 17.9
wedding 17.5
adult 16.7
love 16.6
happiness 16.4
snow 16.4
child 16.2
male 15.6
marriage 14.2
women 14.2
mother 14
together 14
smiling 13.7
human 13.5
cold 12.9
men 12.9
two 12.7
family 12.4
church 12
married 11.5
holiday 11.5
fashion 11.3
old 11.1
joy 10.9
religion 10.7
outdoor 10.7
group 10.5
gown 9.8
life 9.7
bridal 9.7
outdoors 9.7
bouquet 9.4
day 9.4
art 9.4
youth 9.4
smile 9.3
scene 8.6
wall 8.5
clothing 8.5
nurse 8.4
friends 8.4
religious 8.4
girls 8.2
new 8.1
posing 8
lifestyle 7.9
flowers 7.8
angel 7.8
sepia 7.8
father 7.7
sky 7.6
walking 7.6
elegance 7.6
world 7.5
holding 7.4
decoration 7.2
looking 7.2
celebration 7.2
romantic 7.1
face 7.1
travel 7
season 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

person 95.8
clothing 94.4
old 86.7
standing 82.9
posing 71.3
group 68.5
snow 64.2
white 63.2
human face 58.6
dressed 35.7
clothes 32.1

Face analysis

Amazon

AWS Rekognition

Age 35-52
Gender Male, 52.2%
Angry 45.5%
Sad 46.7%
Disgusted 45.2%
Surprised 45.3%
Happy 45.2%
Calm 51.3%
Confused 45.8%

AWS Rekognition

Age 26-44
Gender Male, 92.3%
Surprised 3.4%
Sad 13.1%
Angry 5.2%
Disgusted 2%
Calm 67.3%
Happy 2.7%
Confused 6.2%

AWS Rekognition

Age 20-38
Gender Female, 60.6%
Surprised 6.5%
Happy 5.4%
Disgusted 1.9%
Calm 64.6%
Sad 6.9%
Confused 11%
Angry 3.7%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Angry 46.2%
Sad 48.6%
Disgusted 45.4%
Happy 45.5%
Calm 48.2%
Surprised 45.6%
Confused 45.6%

AWS Rekognition

Age 30-47
Gender Female, 51.7%
Confused 45.5%
Disgusted 45.1%
Calm 50.6%
Angry 45.4%
Sad 46.1%
Happy 47%
Surprised 45.3%

AWS Rekognition

Age 23-38
Gender Male, 86.8%
Surprised 4.8%
Sad 9.8%
Happy 1.3%
Angry 5.6%
Disgusted 2.1%
Confused 3.4%
Calm 73.1%

AWS Rekognition

Age 35-53
Gender Male, 51.8%
Sad 46.8%
Angry 45.6%
Calm 50.9%
Confused 45.5%
Disgusted 45.5%
Happy 45.4%
Surprised 45.4%

AWS Rekognition

Age 26-43
Gender Female, 60.1%
Angry 4.9%
Happy 3%
Confused 4.1%
Calm 49.9%
Disgusted 3.3%
Sad 32.3%
Surprised 2.5%

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a group of people posing for a photo 94.5%
an old photo of a group of people posing for the camera 94%
an old photo of a group of people posing for a picture 93.9%