Human Generated Data

Title

Untitled (Mrs. Smith at home)
Date

1978, printed later
People

Artist: Milton Rogovin, American 1909 - 2011
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Jon Vein and Ellen Goldsmith-Vein, 2011.612.3

Human Generated Data

Title

Untitled (Mrs. Smith at home)

People

Artist: Milton Rogovin, American 1909 - 2011

Date

1978, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Jon Vein and Ellen Goldsmith-Vein, 2011.612.3

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 99.7
Person 99.7
Person 99.6
Person 98.9
Person 98.7
Clothing 96.4
Apparel 96.4
Accessory 91.7
Accessories 91.7
Glasses 91.7
Chair 91.4
Furniture 91.4
People 91.2
Person 89.4
Person 88.7
Pants 84.2
Face 72.7
Indoors 71.4
Family 71.1
Room 70.7
Bedroom 70
Person 68
Person 67.7
Living Room 65.9
Person 65.3
Person 61.8
Hair 60.3
Shorts 59.5
Photo 56.3
Portrait 56.3
Photography 56.3
Shelf 55.6
Boy 55.4

Clarifai
created on 2018-03-23

people 99.7
group 98.8
woman 97.5
adult 97.4
portrait 96.2
administration 96
actress 95.6
man 95.1
musician 94.1
leader 94.1
music 94
group together 93.6
singer 93.6
wear 93.3
four 93.1
five 92.1
three 91.4
facial expression 91.2
two 91.1
offspring 90.4

Imagga
created on 2018-03-23

adult 31.2
person 28.5
people 28.5
fashion 26.4
dress 24.4
man 24.2
happy 23.8
portrait 22.7
brunette 21.8
attractive 21.7
women 20.6
sexy 20.1
pretty 19.6
black 19.4
couple 19.2
male 19.1
lady 17.9
style 17.8
hair 17.4
model 17.1
lifestyle 15.9
face 15.6
smile 14.3
happiness 14.1
smiling 13.7
elegant 13.7
elegance 13.4
interior 13.3
clothing 12.4
cute 12.2
room 11.8
child 11.7
vintage 11.6
standing 11.3
home 11.2
costume 11.2
brother 11.1
love 11
casual 11
two 11
mother 10.8
life 10.7
family 10.7
human 10.5
fun 10.5
party 10.3
makeup 10.2
look 9.6
looking 9.6
men 9.4
clothes 9.4
suit 9.2
stylish 9
cheerful 8.9
posing 8.9
indoors 8.8
girls 8.2
hat 8.2
retro 8.2
pose 8.2
handsome 8
night 8
world 7.9
buddy 7.9
holiday 7.9
urban 7.9
expression 7.7
outfit 7.6
professional 7.5
holding 7.4
musical instrument 7.4
decoration 7.2

Google
created on 2018-03-23

people 96.3
photograph 96.1
black 95.1
person 93.2
social group 92.8
standing 88.9
black and white 86.3
vintage clothing 81.8
snapshot 81.8
family 80.9
photography 80.2
monochrome photography 72.2
monochrome 62.6
human behavior 62.3
smile 56.4

Microsoft
created on 2018-03-23

person 99.9
posing 98.5
woman 90
standing 83.3
people 75.6
group 71
white 70.9
old 69.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 99.1%
Sad 9.1%
Surprised 6.9%
Confused 35.9%
Happy 5.5%
Calm 34.7%
Disgusted 2.8%
Angry 5.2%

AWS Rekognition

Age 26-43
Gender Male, 93.7%
Disgusted 0.7%
Surprised 1.3%
Sad 8.4%
Calm 78.3%
Angry 1.5%
Happy 7.5%
Confused 2.4%

AWS Rekognition

Age 9-14
Gender Male, 60.6%
Disgusted 2.1%
Sad 1.7%
Calm 2.6%
Surprised 5.6%
Happy 77.3%
Confused 6.4%
Angry 4.4%

AWS Rekognition

Age 6-13
Gender Female, 80.5%
Surprised 6%
Confused 5.1%
Disgusted 5.6%
Calm 66.8%
Angry 3.6%
Sad 7.1%
Happy 5.8%

AWS Rekognition

Age 26-43
Gender Male, 53%
Confused 45.1%
Sad 47%
Surprised 45.3%
Calm 52.3%
Happy 45%
Disgusted 45%
Angry 45.2%

AWS Rekognition

Age 26-43
Gender Male, 53.9%
Angry 45.2%
Happy 54.1%
Calm 45.1%
Surprised 45.1%
Confused 45.1%
Disgusted 45.2%
Sad 45.2%

AWS Rekognition

Age 26-43
Gender Male, 54.1%
Disgusted 45.1%
Sad 53%
Calm 45.9%
Surprised 45.2%
Happy 45.3%
Confused 45.2%
Angry 45.3%

AWS Rekognition

Age 26-44
Gender Male, 50.3%
Disgusted 49.6%
Surprised 49.6%
Happy 49.7%
Confused 49.6%
Calm 49.5%
Sad 49.8%
Angry 49.6%

AWS Rekognition

Age 11-18
Gender Male, 50.2%
Happy 49.6%
Confused 49.5%
Sad 49.9%
Angry 49.6%
Calm 49.7%
Disgusted 49.5%
Surprised 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Calm 49.6%
Disgusted 49.6%
Sad 49.7%
Angry 49.7%
Confused 49.6%
Surprised 49.6%
Happy 49.6%

AWS Rekognition

Age 20-38
Gender Male, 50.2%
Sad 50%
Surprised 49.6%
Calm 49.7%
Happy 49.6%
Angry 49.6%
Disgusted 49.5%
Confused 49.6%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Calm 49.5%
Disgusted 49.6%
Angry 49.5%
Happy 49.6%
Confused 49.5%
Surprised 49.5%
Sad 50.2%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Angry 49.6%
Sad 49.7%
Happy 49.6%
Surprised 49.6%
Confused 49.6%
Disgusted 49.7%
Calm 49.8%

AWS Rekognition

Age 26-43
Gender Female, 50%
Disgusted 49.5%
Happy 49.5%
Surprised 49.5%
Sad 49.7%
Calm 49.9%
Angry 49.6%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Happy 49.5%
Confused 49.5%
Sad 50.3%
Angry 49.5%
Calm 49.6%
Disgusted 49.5%
Surprised 49.5%

Microsoft Cognitive Services

Age 60
Gender Male

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 10
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 20
Gender Male

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Glasses 91.7%