Human Generated Data

Title

Untitled (older man and woman standing in bedroom with two framed portraits and a poster of Jesus Christ on the walls)

Date

1962-1971, printed later

People

Artist: Milton Rogovin, American 1909 - 2011

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Jon Vein and Ellen Goldsmith-Vein, 2011.602

Human Generated Data

Title

Untitled (older man and woman standing in bedroom with two framed portraits and a poster of Jesus Christ on the walls)

People

Artist: Milton Rogovin, American 1909 - 2011

Date

1962-1971, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Jon Vein and Ellen Goldsmith-Vein, 2011.602

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99
Human 99
Clothing 99
Apparel 99
Furniture 96.9
Person 96.1
Face 94.5
Bed 83.3
Man 80.2
Indoors 78.2
Interior Design 76
Pants 74.2
Coat 68.8
Overcoat 68.8
Suit 68.8
Bedroom 68
Room 68
Photography 62.3
Portrait 62.3
Photo 62.3
Sleeve 61.1
Female 60.6
Home Decor 59

Clarifai
created on 2018-03-23

people 100
adult 99.3
man 98.3
two 97.8
portrait 97.8
group 96.5
one 94.6
three 94.5
administration 94.2
wear 93.9
leader 92
woman 89.3
facial expression 88.7
actor 87.9
indoors 85.6
music 85.2
group together 83.9
room 83.7
four 82.1
outfit 80.3

Imagga
created on 2018-03-23

person 26.6
black 26.2
portrait 25.2
face 24.1
man 20.2
mask 20
adult 18.8
male 17.7
attractive 17.5
fashion 17.3
people 16.2
lady 15.4
disk jockey 15.4
dark 15
sexy 14.4
style 14.1
human 12.7
elegance 12.6
pretty 12.6
currency 12.6
broadcaster 12.3
eyes 12
one 11.9
sensual 11.8
model 11.7
smiling 11.6
business 11.5
body 11.2
party 11.2
art 11.1
old 11.1
hair 11.1
money 11.1
dress 10.8
covering 10.8
closeup 10.8
light 10.7
smile 10.7
studio 10.6
look 10.5
dance 10.4
dollar 10.2
communicator 10.2
music 9.9
dancing 9.6
mystery 9.6
happy 9.4
expression 9.4
entertainment 9.2
gorgeous 9.1
fun 9
world 8.9
performer 8.9
posing 8.9
clothing 8.8
conceptual 8.8
lifestyle 8.7
hairstyle 8.6
luxury 8.6
elegant 8.6
club 8.5
future 8.4
emotion 8.3
cash 8.2
spotlight 8.2
close 8
love 7.9
hand 7.6
head 7.6
disguise 7.5
senior 7.5
disco 7.4
suit 7.3
alone 7.3
figure 7.3
bank 7.2
bright 7.1
women 7.1
lovely 7.1
night 7.1

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 96.8
posing 94.7
standing 85.5
white 63.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Male, 76.3%
Calm 53.1%
Surprised 22.5%
Happy 2.4%
Sad 4.3%
Disgusted 3.7%
Confused 11.4%
Angry 2.6%

AWS Rekognition

Age 57-77
Gender Male, 98.2%
Sad 82.9%
Surprised 0.7%
Calm 12.9%
Happy 0.6%
Angry 0.9%
Disgusted 0.5%
Confused 1.6%

AWS Rekognition

Age 35-52
Gender Male, 67.7%
Happy 8.5%
Disgusted 6%
Confused 3%
Calm 17.6%
Sad 18.5%
Angry 39.1%
Surprised 7.4%

Microsoft Cognitive Services

Age 84
Gender Male

Microsoft Cognitive Services

Age 57
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Suit 68.8%