Human Generated Data

Title

Untitled (two men in bathing suits in front of backdrop with ocean scene)
Date

c. 1856 - c. 1910
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.2

Human Generated Data

Title

Untitled (two men in bathing suits in front of backdrop with ocean scene)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Human 99.8
Person 99.8
Person 98.1
Shorts 96.6
Clothing 96.6
Apparel 96.6
Furniture 77.8
Barefoot 77.2
Painting 76.2
Art 76.2
Undershirt 72.7
Sitting 67.4
Face 57.1
Finger 55.4
Goggles 55.1
Accessories 55.1
Accessory 55.1

Imagga
created on 2022-05-28

sexy 28.9
body 27.2
adult 27
person 25.8
model 24.1
attractive 23.8
people 21.8
fashion 20.4
sensuality 20
portrait 19.4
kin 18.8
erotic 18.3
hair 18.2
man 16.9
pretty 16.8
posing 16
style 15.6
elegance 15.1
one 14.9
lady 14.6
chair 14.6
women 14.2
sitting 13.7
sensual 13.6
skin 13.5
human 13.5
face 13.5
lifestyle 13
blond 11.7
electric chair 11.5
love 11
dark 10.9
vintage 10.7
nude 10.7
room 10.6
naked 10.6
looking 10.4
passion 10.3
elegant 10.3
dancer 10.2
gorgeous 10
male 9.9
breast 9.8
sex 9.7
art 9.7
sexual 9.6
device 9.6
sibling 9.6
instrument of execution 9.5
legs 9.4
light 9.4
slim 9.2
studio 9.1
old 9.1
black 9
brunette 8.7
couple 8.7
performer 8.6
grunge 8.5
furniture 8.3
makeup 8.2
happy 8.1
dress 8.1
fitness 8.1
armchair 7.7
desire 7.7
glamor 7.7
seat 7.7
seductive 7.7
relax 7.6
relaxation 7.5
dance 7.5
sport 7.4
lips 7.4
instrument 7.3
fireplace 7.3
stylish 7.2
cute 7.2
romance 7.1
smile 7.1
cool 7.1
interior 7.1
happiness 7
musical instrument 7

Google
created on 2022-05-28

Picture frame 84.3
Art 81
Flash photography 80.8
Tints and shades 77.2
Vintage clothing 72.1
Chair 70.4
Knee 69.1
Foot 67.9
Wood 67.4
Visual arts 66.7
Shorts 65
Barefoot 64.8
Stock photography 63.6
Sitting 63.3
Painting 62.8
Fun 60.5
Room 59.9
Antique 57.4
Monochrome photography 56.9
Monochrome 55.3

Microsoft
created on 2022-05-28

person 98.3
wall 96.6
human face 93.9
clothing 91.9
text 77.8
smile 75.5
drawing 62.9
man 58.4
old 48.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Sad 100%
Calm 10.1%
Surprised 6.3%
Fear 5.9%
Angry 0.4%
Confused 0.4%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 27-37
Gender Male, 100%
Calm 95.1%
Surprised 6.5%
Fear 6%
Sad 2.4%
Angry 2%
Confused 0.9%
Happy 0.5%
Disgusted 0.2%

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Painting 76.2%

Captions

Microsoft

a man sitting on a bench 69.6%
a man and a woman sitting on a bench 49.2%
a group of people sitting on a bench 49.1%