Human Generated Data

Title

Untitled (man dressed as Santa Claus with two women)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15631

Human Generated Data

Title

Untitled (man dressed as Santa Claus with two women)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Human 96.7
Person 96.7
Person 91.8
Person 91.3
Couch 89.2
Furniture 89.2
Clothing 80.8
Apparel 80.8
Indoors 80.4
Room 80.4
Living Room 80.4
Wood 78.3
Sitting 75.5
Painting 70.3
Art 70.3
Flooring 66.1
Screen 63.1
Electronics 63.1
Monitor 63.1
Display 63.1
Floor 61
Home Decor 60.7
Hardwood 60
LCD Screen 58.9
Face 58.1

Imagga
created on 2022-02-05

armchair 58.2
sofa 52.2
home 41.5
room 36.6
studio couch 35.6
couch 33.8
chair 33.3
interior 32.7
seat 32.2
sitting 30.9
furniture 30.6
convertible 28.5
adult 27.5
indoors 26.4
smiling 23.9
happy 22.6
couple 21.8
lifestyle 21
man 20.8
person 20.8
people 19
house 18.4
attractive 17.5
indoor 17.4
portrait 16.8
bed 16.6
women 16.6
male 16.4
cheerful 16.3
family 16
happiness 15.7
comfortable 15.3
bedroom 14.8
pretty 14.7
mother 14.5
living 14.2
love 14.2
20s 13.7
pillow 13.6
casual 13.6
together 13.1
smile 12.8
fashion 12.8
lady 12.2
looking 12
relaxing 11.8
relax 11.8
living room 11.8
child 11.4
table 11.4
luxury 11.2
relaxation 10.9
comfort 10.6
fun 10.5
sexy 10.4
father 10.2
leisure 10
cup 9.9
one 9.7
adults 9.5
kin 9.4
light 9.4
model 9.3
cute 9.3
window 9.2
modern 9.1
holding 9.1
brunette 8.7
hotel 8.6
men 8.6
resting 8.6
elegant 8.6
wall 8.6
rest 8.5
females 8.5
sit 8.5
togetherness 8.5
lying 8.5
relaxed 8.4
book 8.3
inside 8.3
style 8.2
parent 8.2
computer 8.1
night 8
cushions 7.9
ottoman 7.9
cushion 7.9
daughter 7.8
full length 7.8
lamp 7.7
apartment 7.7
husband 7.6
enjoyment 7.5
senior 7.5
design 7.4
domestic 7.4
color 7.2
body 7.2
posing 7.1

Google
created on 2022-02-05

Microsoft
created on 2022-02-05

text 96.7
furniture 95.6
floor 91.3
indoor 91
red 89.2
person 88.1
clothing 86.9
chair 83.3
couch 77.9
woman 76.4
family 60.7

Face analysis

Amazon

Google

AWS Rekognition

Age 18-26
Gender Female, 82.3%
Calm 97%
Sad 1.2%
Confused 0.7%
Disgusted 0.6%
Angry 0.2%
Surprised 0.1%
Fear 0.1%
Happy 0%

AWS Rekognition

Age 51-59
Gender Female, 98.4%
Calm 55.7%
Happy 29.5%
Sad 4.6%
Confused 4%
Fear 3.8%
Angry 1.3%
Disgusted 0.6%
Surprised 0.4%

AWS Rekognition

Age 50-58
Gender Male, 99.8%
Calm 27.5%
Surprised 20.2%
Happy 19.5%
Confused 12.9%
Angry 10.8%
Fear 4.6%
Sad 3.1%
Disgusted 1.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.7%
Painting 70.3%

Captions

Microsoft

a person sitting on a bed 85.7%
a man and a woman sitting on a bed 62%
a man and woman sitting on a bed 54.4%

Text analysis

Amazon

A
NAGON
EIFW

Google

KODVK
A'2
YT37
KODVK YT37 A'2