Human Generated Data

Title

Untitled (family portrait in studio)

Date

c. 1940

People

Artist: John Deusing, American active 1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1567

Human Generated Data

Title

Untitled (family portrait in studio)

People

Artist: John Deusing, American active 1940s

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 99.2
Person 99.2
Person 99.1
Person 98.7
Person 98.2
Person 97.4
Person 96.5
People 95
Clothing 91.3
Apparel 91.3
Accessories 89.8
Accessory 89.8
Tie 89.8
Face 89.6
Family 81.7
Shoe 76.8
Footwear 76.8
Female 66.7
Photography 65.6
Photo 65.6
Portrait 65.4
Girl 63.5
Text 60

Imagga
created on 2021-12-14

negative 78.1
film 62.5
photographic paper 47.5
photographic equipment 31.7
bride 27.1
kin 24.4
portrait 23.3
people 22.9
dress 22.6
happiness 20.4
wedding 20.2
mother 19.1
adult 18.1
love 18.1
person 18
couple 17.4
groom 16.9
fashion 16.6
pretty 14
lady 13.8
statue 13.6
parent 13.2
bouquet 12.5
happy 12.5
sculpture 12.4
art 12.4
face 12.1
sexy 12
romantic 11.6
family 11.6
married 11.5
attractive 11.2
celebration 11.2
man 10.7
bridal 10.7
marriage 10.4
wife 10.4
male 9.9
religion 9.9
veil 9.8
ceremony 9.7
marble 9.7
look 9.6
day 9.4
two 9.3
old 9.1
style 8.9
husband 8.8
hair 8.7
engagement 8.7
holiday 8.6
party 8.6
model 8.6
black 8.4
human 8.2
history 8
romance 8
posing 8
women 7.9
smile 7.8
flowers 7.8
gown 7.8
tenderness 7.8
culture 7.7
stone 7.6
child 7.6
elegance 7.6
rose 7.5
monument 7.5
decoration 7.4
makeup 7.3
cheerful 7.3
pose 7.2
smiling 7.2
home 7.2
cute 7.2
summer 7.1
architecture 7

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

posing 99.3
text 98.8
old 96.3
drawing 95.8
sketch 94.8
clothing 93.6
person 93
window 91.3
human face 82.8
standing 82.8
smile 61.1
woman 60
painting 59.5
vintage 43
picture frame 21.1

Face analysis

Amazon

Google

AWS Rekognition

Age 43-61
Gender Male, 98.1%
Calm 86.9%
Sad 4.1%
Happy 2.8%
Surprised 2.4%
Confused 1.5%
Angry 1%
Fear 0.9%
Disgusted 0.3%

AWS Rekognition

Age 23-35
Gender Male, 94%
Calm 57.2%
Sad 15.1%
Surprised 11.3%
Confused 10.7%
Angry 2.2%
Fear 1.5%
Happy 1.2%
Disgusted 0.8%

AWS Rekognition

Age 23-35
Gender Female, 60.7%
Calm 74.4%
Happy 14.2%
Sad 6%
Fear 1.5%
Surprised 1.4%
Confused 1%
Angry 0.8%
Disgusted 0.6%

AWS Rekognition

Age 0-4
Gender Female, 78.5%
Calm 87%
Sad 4.8%
Surprised 3.8%
Confused 2%
Fear 1.3%
Disgusted 0.5%
Happy 0.4%
Angry 0.2%

AWS Rekognition

Age 23-35
Gender Male, 96.9%
Calm 92%
Sad 4.6%
Confused 2%
Surprised 0.6%
Happy 0.4%
Angry 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 13-25
Gender Male, 69.3%
Calm 35.4%
Happy 35%
Surprised 16.3%
Angry 9.4%
Confused 1.2%
Sad 1.1%
Fear 0.9%
Disgusted 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Tie 89.8%
Shoe 76.8%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 96.7%
a vintage photo of a group of people posing for a picture 96.6%
a group of people posing for a photo 96.5%