Human Generated Data

Title

Untitled (two women with man dressed as Santa Claus)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15628.2

Human Generated Data

Title

Untitled (two women with man dressed as Santa Claus)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Apparel 98.8
Clothing 98.8
Person 98.2
Human 98.2
Person 97.8
Person 93.9
Evening Dress 91.3
Robe 91.3
Fashion 91.3
Gown 91.3
Sitting 78.8
Furniture 78.5
Female 75.9
Indoors 72.2
Living Room 72.2
Room 72.2
Couch 70.5
Leisure Activities 67
Wood 63.6
People 61.4
Girl 60.6
Costume 59.6
Woman 59.6
Dress 59.3
Stage 59
Art 58.1
Painting 58.1
Monitor 57
LCD Screen 57
Electronics 57
Display 57
Screen 57
Person 42.4

Imagga
created on 2022-02-05

home 35.1
sofa 33.4
adult 26.4
room 24.9
sitting 24.1
person 22.5
seat 22.5
couch 22.2
interior 22.1
people 20.6
indoors 20.2
studio couch 19.7
happy 19.4
man 18.8
smiling 18.8
furniture 18.6
couple 17.4
love 17.4
lifestyle 17.3
child 17.3
chair 16.9
male 16.5
attractive 16.1
convertible 15.7
happiness 14.9
cheerful 14.6
armchair 14.6
fashion 14.3
fun 14.2
relaxing 13.6
smile 13.5
comfortable 13.4
family 13.3
indoor 12.8
women 12.7
pretty 12.6
bed 12.5
resting 12.4
mother 12.3
sexy 12
house 11.7
living 11.4
casual 11
portrait 11
cup 10.9
television 10.7
one 10.5
adults 10.4
looking 10.4
20s 10.1
cute 10
clothing 10
bedroom 9.9
brunette 9.6
holiday 9.3
relax 9.3
posing 8.9
living room 8.8
together 8.8
hair 8.7
jeans 8.6
model 8.6
book 8.4
blond 8.2
lady 8.1
childhood 8.1
romance 8
daughter 8
body 8
little 7.9
face 7.8
kin 7.7
telecommunication system 7.7
father 7.7
wife 7.6
females 7.6
togetherness 7.6
passion 7.5
joy 7.5
ottoman 7.5
holding 7.4
style 7.4
dress 7.2
rest 7.1
cushion 7.1
pillow 7

Google
created on 2022-02-05

Rectangle 83.5
Couch 83.1
Art 81.4
Red 80.3
Comfort 80
Adaptation 79.4
Font 78.6
Magenta 78.6
Beauty 75.3
Snapshot 74.3
Event 72.9
Classic 72.7
Room 70.2
Design 68.4
Picture frame 66.6
Vintage clothing 66.2
Visual arts 65.8
Sitting 65.6
Lap 62.1
Stock photography 62.1

Microsoft
created on 2022-02-05

furniture 97.7
text 94
couch 92.9
indoor 91.6
chair 85.8
person 85.2
clothing 84.8
red 82.2
woman 71.3
table 60.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 50-58
Gender Female, 99.8%
Happy 62.6%
Calm 33.4%
Confused 1.2%
Sad 1.1%
Angry 0.5%
Fear 0.5%
Surprised 0.4%
Disgusted 0.3%

AWS Rekognition

Age 22-30
Gender Female, 97.6%
Calm 97.4%
Confused 0.9%
Sad 0.7%
Angry 0.3%
Happy 0.3%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 52-60
Gender Male, 99.5%
Calm 88.6%
Happy 5.6%
Confused 1.6%
Fear 1.5%
Sad 1.2%
Disgusted 0.6%
Angry 0.6%
Surprised 0.3%

Microsoft Cognitive Services

Age 51
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Painting 58.1%

Captions

Microsoft

a group of people sitting on a bed 82.5%
a man and a woman sitting on a bed 63.8%
a group of people sitting in a bedroom 63.7%

Text analysis

Amazon

B
3
A
0
EIFW
M
NAGON

Google

YT37A2 KODVK YT37A2 B.
KODVK
YT37A2
B.