Human Generated Data

Title

Untitled (miner and his wife in their living room, Czechoslovakia)
Date

1990, printed later
People

Artist: Milton Rogovin, American 1909 - 2011
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Jon Vein and Ellen Goldsmith-Vein, 2011.606.2

Human Generated Data

Title

Untitled (miner and his wife in their living room, Czechoslovakia)

People

Artist: Milton Rogovin, American 1909 - 2011

Date

1990, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Clothing 99.9
Apparel 99.9
Human 99.8
Person 99.8
Person 99.2
Shorts 98.1
Plant 97.3
Face 93.5
Jar 92.1
Pottery 92.1
Vase 92.1
Potted Plant 91
Furniture 87.6
Footwear 85.1
Blossom 83.2
Flower 83.2
Shoe 79.1
Indoors 78
Female 77.7
Wristwatch 74.6
Smile 73.9
Flower Arrangement 72.5
Chair 71.2
Photo 66.5
Portrait 66.5
Photography 66.5
Man 63.7
Tree 63.5
Room 63.4
Girl 62.3
T-Shirt 57.5
Pants 57.4
Planter 56.5
Home Decor 56
Woman 55.6

Clarifai
created on 2018-03-23

people 99.9
group 99.3
two 98.8
adult 98.6
man 97.2
woman 96.8
three 95.7
actress 95.5
portrait 94.4
group together 94.2
wear 94.1
four 92.6
musician 91.9
music 91.6
singer 91.4
facial expression 90
several 89.3
recreation 89.2
leader 89
one 87.5

Imagga
created on 2018-03-23

person 27.9
sexy 27.3
portrait 25.2
fashion 23.4
adult 22.7
model 21.8
style 20
throne 19.8
banjo 18.5
people 18.4
attractive 18.2
stringed instrument 17.7
black 17.4
sitting 17.2
man 16.8
sensual 16.4
face 16.3
musical instrument 16.3
elegance 15.9
chair of state 15.9
hair 15.8
art 15.7
chair 15.5
lady 14.6
elegant 14.6
dress 14.5
male 14.3
retro 13.9
guitar 13.9
musician 13.8
music 13.6
religion 13.4
old 13.2
pretty 12.6
vintage 12.4
cute 12.2
stylish 11.8
posing 11.5
interior 11.5
looking 11.2
golden 11.2
luxury 11.1
youth 11.1
make 10.9
clothing 10.5
play 10.3
sculpture 10.3
church 10.2
sensuality 10
smile 10
romantic 9.8
human 9.7
statue 9.7
brunette 9.6
couple 9.6
god 9.6
seductive 9.6
singer 9.5
hairstyle 9.5
women 9.5
instrument 9.5
religious 9.4
room 9.3
dark 9.2
blond 9.1
one 9
lovely 8.9
body 8.8
vertical 8.7
musical 8.6
sofa 8.6
culture 8.5
expression 8.5
comic book 8.5
studio 8.4
seat 8
lifestyle 7.9
guitarist 7.9
furniture 7.8
song 7.8
figure 7.7
charming 7.6
leisure 7.5
holding 7.4
performer 7.4
playing 7.3
pose 7.2
device 7.1

Google
created on 2018-03-23

white 96
photograph 95.7
black 95.4
facial expression 93.5
black and white 91
sitting 87
photography 82.7
snapshot 81.8
monochrome photography 79.4
standing 78
smile 71.9
monochrome 69.2
family 68.1
retro style 61.5
girl 58.9
vintage clothing 58.6
fun 58.4

Microsoft
created on 2018-03-23

person 99.8
sitting 98.4
posing 57.9
seat 33.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 99.8%
Surprised 1.2%
Sad 23.3%
Happy 1.8%
Disgusted 14.6%
Angry 15%
Calm 37.8%
Confused 6.4%

AWS Rekognition

Age 26-43
Gender Female, 92.5%
Happy 0.3%
Disgusted 1%
Angry 0.9%
Surprised 0.6%
Sad 5.2%
Calm 91.4%
Confused 0.5%

AWS Rekognition

Age 26-43
Gender Female, 55%
Disgusted 45.2%
Calm 46.9%
Happy 48.6%
Angry 45.8%
Sad 47.1%
Confused 45.7%
Surprised 45.6%

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 8
Gender Female

Microsoft Cognitive Services

Age 46
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Wristwatch 74.6%

Captions

Microsoft

a group of people sitting on a bench posing for the camera 93.1%
a group of people sitting on a bench posing for a photo 91.3%
a couple of people that are sitting on a bench posing for the camera 88.4%