Human Generated Data

Title

Vincent Series #4

Date

2001

People

Artist: Lester Johnson, American 1919-2010

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Lillian Heidenberg, 2003.304

Human Generated Data

Title

Vincent Series #4

People

Artist: Lester Johnson, American 1919-2010

Date

2001

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Human 99.6
Person 99.6
Person 98.3
Person 96.3
Person 95.9
Painting 92.8
Art 92.8
Person 89
Apparel 88
Clothing 88
Hat 88
Person 88
Hat 87.5
Sunglasses 80.6
Accessories 80.6
Accessory 80.6
Person 73.3
Skin 66.5
People 62.1
Collage 55.9
Advertisement 55.9
Poster 55.9

Clarifai
created on 2020-04-23

people 99.8
painting 99.3
art 99.1
illustration 96.7
woman 96.6
group 95.7
adult 92.6
man 92.3
retro 92.1
wear 88.2
lid 88
portrait 87.6
dress 85.7
fame 84.4
veil 84.2
son 83.7
famous 82.2
print 81.6
religion 80.8
costume 77.7

Imagga
created on 2020-04-23

attractive 32.2
people 30.7
sexy 30.5
happy 30.1
adult 29.8
party 28.4
fashion 27.9
person 27.5
costume 26.4
together 25.4
pretty 25.2
brunette 24.4
fun 23.2
sensual 22.7
man 22.2
women 22.1
portrait 22
love 21.3
male 20.6
model 20.2
couple 19.2
girls 19.1
friends 18.8
smile 18.5
dress 18.1
smiling 17.4
lifestyle 17.3
happiness 17.2
nightclub 16.6
face 14.9
lady 14.6
gorgeous 14.5
dancing 14.5
holiday 14.3
romantic 14.3
night 14.2
black 13.8
group 13.7
disco 13.7
handsome 13.4
joy 13.4
style 13.4
dance 13.1
cute 12.9
expression 12.8
body 12.8
posing 12.4
club 12.3
entertainment 12
joyful 11.9
hair 11.9
two 11.9
nightlife 11.7
hat 11.7
boyfriend 11.6
fashionable 11.4
dancer 11.2
friendship 11.2
celebration 11.2
stylish 10.8
clubbing 10.8
erotic 10.6
girlfriend 10.6
makeup 10.1
teenager 10
make 10
vogue 9.7
seductive 9.6
enjoying 9.5
laughing 9.5
elegant 9.4
blond 9.4
guy 9.3
studio 9.1
holding 9.1
music 9
decoration 8.9
cool 8.9
carnival 8.8
hands 8.7
festival 8.6
eyes 8.6
enjoy 8.5
feminine 8.4
glasses 8.3
bar 8.3
teen 8.3
retro 8.2
cheerful 8.1
looking 8
colorful 7.9
performer 7.9
hugging 7.8
glamorous 7.7
luxury 7.7
diversity 7.7
youth 7.7
loving 7.6
hairstyle 7.6
females 7.6
cabaret 7.6
passion 7.5
dark 7.5
clothing 7.4
emotion 7.4
vacation 7.4
modern 7
look 7

Google
created on 2020-04-23

Microsoft
created on 2020-04-23

text 99.4
person 97.8
book 96.7
human face 93.1
clothing 86.3
fashion accessory 81.6
woman 75.8
hat 73.7
poster 67.7
smile 59.3
painting 58
posing 52.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 7-17
Gender Female, 89.2%
Fear 2.7%
Disgusted 0.1%
Happy 1%
Calm 91.1%
Confused 0.5%
Angry 0.3%
Surprised 3.3%
Sad 0.9%

AWS Rekognition

Age 28-44
Gender Male, 81.9%
Confused 0.1%
Fear 0%
Angry 0.2%
Happy 0%
Calm 98.9%
Surprised 0%
Sad 0.7%
Disgusted 0%

AWS Rekognition

Age 24-38
Gender Male, 88.1%
Surprised 0.8%
Calm 82.9%
Angry 1.1%
Disgusted 0.2%
Sad 7.5%
Happy 3.4%
Fear 2.4%
Confused 1.8%

AWS Rekognition

Age 8-18
Gender Female, 70.4%
Fear 0%
Calm 98.8%
Surprised 0.2%
Sad 0.7%
Confused 0.1%
Disgusted 0.1%
Happy 0%
Angry 0.1%

AWS Rekognition

Age 20-32
Gender Female, 90.8%
Fear 0.8%
Happy 5%
Confused 1%
Sad 1.4%
Angry 0.8%
Surprised 3.6%
Disgusted 0.3%
Calm 87.1%

AWS Rekognition

Age 22-34
Gender Female, 96.9%
Fear 0.2%
Disgusted 0.3%
Sad 3.6%
Confused 0.5%
Calm 94%
Happy 0.2%
Surprised 0.4%
Angry 0.8%

AWS Rekognition

Age 21-33
Gender Female, 96.8%
Happy 3.9%
Calm 75.3%
Angry 1.4%
Disgusted 0.5%
Fear 8.3%
Sad 3.6%
Confused 2.2%
Surprised 4.8%

Microsoft Cognitive Services

Age 39
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Painting 92.8%
Hat 88%
Sunglasses 80.6%

Captions

Microsoft

a group of people posing for a photo 92.5%
a group of people posing for the camera 92.4%
a group of people posing for a picture 92.3%

Text analysis

Amazon

Vincent
agr

Google

incent
incent