Human Generated Data

Title

Untitled (Mrs. Smith at work)

Date

1978, printed later

People

Artist: Milton Rogovin, American 1909 - 2011

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Jon Vein and Ellen Goldsmith-Vein, 2011.612.1

Human Generated Data

Title

Untitled (Mrs. Smith at work)

People

Artist: Milton Rogovin, American 1909 - 2011

Date

1978, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Clothing 100
Apparel 100
Person 99.7
Human 99.7
Helmet 96.1
Shoe 95.7
Footwear 95.7
Face 90
Sitting 85.7
Pants 83.2
Boot 74
Portrait 72.2
Photo 72.2
Photography 72.2
Hat 69.6
Shorts 66.2
Man 63.9
Accessories 60.2
Goggles 60.2
Accessory 60.2
Cap 59
Sleeve 55
Brick 55
Shoe 51.4

Clarifai
created on 2018-03-23

people 100
adult 99.5
portrait 99.3
one 98.8
wear 98.5
man 97.7
outfit 95.3
two 94.2
woman 92
facial expression 90.4
outerwear 89.5
boy 89.3
uniform 89.1
veil 88.5
child 88.4
music 86.4
actor 82.8
street 82.4
lid 81.9
administration 81.9

Imagga
created on 2018-03-23

person 27.1
people 23.4
style 23
adult 22.3
performer 18.7
man 18.1
model 17.9
wind instrument 17.8
fashion 17.3
black 17.3
musical instrument 17.3
posing 16
studio 16
dark 15.9
male 15.6
lady 15.4
sexy 15.3
musician 15
performance 14.4
silhouette 14.1
dance 14.1
water 14
singer 13.5
brass 13.1
player 12.9
portrait 12.9
blond 12.9
attractive 12.6
sport 12.5
electric chair 12.2
instrument 12.1
device 12
body 12
motion 12
sunset 11.7
cool 11.5
sax 11.2
elegant 11.1
dancer 11
sensual 10.9
lifestyle 10.8
clothing 10.6
dancing 10.6
modern 10.5
one 10.5
action 10.2
happy 10
pose 10
instrument of execution 9.8
looking 9.6
boy 9.6
hair 9.5
erotic 9.5
legs 9.4
music 9.2
elegance 9.2
fitness 9
wet 8.9
night 8.9
symbol 8.7
stage 8.7
women 8.7
guy 8.6
seductive 8.6
men 8.6
casual 8.5
passion 8.5
athlete 8.3
holding 8.3
fun 8.2
exercise 8.2
stylish 8.1
dirty 8.1
accordion 8
rap 7.9
splashes 7.8
chair 7.8
jumping 7.7
sitting 7.7
suit 7.7
wall 7.7
grunge 7.7
sky 7.7
outdoor 7.6
balance 7.6
pleasure 7.5
human 7.5
teenager 7.3
sensuality 7.3
love 7.1

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

outdoor 94.2
person 92.8
old 73.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 99%
Angry 2.1%
Disgusted 1.7%
Calm 26.6%
Happy 58.4%
Sad 4.8%
Surprised 2%
Confused 4.4%

Microsoft Cognitive Services

Age 72
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Helmet 96.1%
Shoe 95.7%

Captions

Microsoft

a man sitting on a bench posing for the camera 89.8%
a man sitting on a bench 86.6%
a man sitting on a bench posing for a photo 85.6%