Human Generated Data

Title

4 Heads, Broadway, New York

Date

1954

People

Artist: William Klein, American 1928 - 2022

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.874

Human Generated Data

Title

4 Heads, Broadway, New York

People

Artist: William Klein, American 1928 - 2022

Date

1954

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.874

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Face 98.9
Human 98.9
Person 95.4
Advertisement 94.8
Person 94.5
Collage 93.5
Person 89.9
Head 81.5
Hat 73.1
Clothing 73.1
Apparel 73.1
Officer 68.8
Military 68.8
Military Uniform 68.8
Portrait 63.7
Photography 63.7
Photo 63.7
Poster 63.3
Flyer 57.1
Paper 57.1
Brochure 57.1
Text 55.5
Person 42.3

Clarifai
created on 2023-10-25

people 100
portrait 100
adult 99.8
man 99.3
two 98.4
facial expression 97.8
retro 96.6
affection 95.9
three 95.9
leader 95.7
woman 94.7
facial hair 94.6
group 94.1
monarch 90.8
veil 90.2
monochrome 89.8
administration 89.6
socialism 88.7
vintage 88.3
lid 87.7

Imagga
created on 2022-01-09

book jacket 72.4
jacket 58.2
wrapping 42.8
portrait 38.2
face 32.7
black 32.7
beard 32.3
male 30.5
covering 30.5
man 29.6
person 28.3
adult 25.2
attractive 24.5
people 23.4
model 23.3
sexy 23.3
fashion 21.9
eyes 21.5
expression 17.9
close 17.7
hair 16.6
human 16.5
sensual 16.4
studio 16
love 15.8
makeup 15.8
couple 15.7
dark 15
style 14.8
head 14.3
handsome 14.3
brunette 13.9
skin 13.5
serious 13.4
pretty 13.3
lips 13
comedian 12.9
emotion 12.9
brother 12
body 12
make 11.8
look 11.4
guy 11.3
happy 11.3
looking 11.2
crazy 11.1
art 11.1
youth 11.1
casual 11
performer 10.9
culture 10.3
cute 10
smile 10
romance 9.8
hairstyle 9.5
happiness 9.4
two 9.3
double 9.2
gorgeous 9.1
one 9
eye 8.9
women 8.7
mystery 8.6
men 8.6
hat 8.6
erotic 8.5
vintage 8.3
entertainer 8.2
sensuality 8.2
lady 8.1
romantic 8
lifestyle 8
evil 7.8
dating 7.8
mysterious 7.8
seductive 7.6
hand 7.6
elegance 7.6
passion 7.5
cosmetics 7.5
currency 7.2
posing 7.1

Google
created on 2022-01-09

Forehead 98.5
Smile 95.4
Eyebrow 93.8
Cap 88.1
Gesture 85.3
Style 83.9
Headgear 83.6
Hat 81.7
Font 81.4
Art 77.3
Baseball cap 77.1
Facial hair 71.6
Moustache 70.7
Poster 69.8
Monochrome photography 68.9
Monochrome 68.4
Vintage clothing 67.2
Photo caption 67.2
Flat cap 65.9
Illustration 65

Microsoft
created on 2022-01-09

text 99.9
human face 98.3
book 98.2
person 93.7
smile 92.4
clothing 76.6
man 76.4
poster 67.6
hat 52.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-44
Gender Male, 96.6%
Happy 94.8%
Angry 2.4%
Surprised 1%
Confused 0.5%
Fear 0.5%
Sad 0.4%
Disgusted 0.2%
Calm 0.1%

AWS Rekognition

Age 23-33
Gender Male, 99.8%
Calm 97.4%
Confused 0.7%
Sad 0.6%
Surprised 0.4%
Angry 0.4%
Disgusted 0.2%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 83%
Sad 9.1%
Confused 3.5%
Surprised 1.6%
Fear 0.9%
Angry 0.9%
Disgusted 0.8%
Happy 0.2%

AWS Rekognition

Age 40-48
Gender Female, 85.3%
Calm 47.6%
Sad 35.7%
Angry 10.3%
Fear 3.3%
Happy 1.9%
Surprised 0.5%
Disgusted 0.4%
Confused 0.3%

Microsoft Cognitive Services

Age 48
Gender Female

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.4%
Hat 73.1%
Poster 63.3%

Categories

Imagga

paintings art 95.7%
people portraits 4.1%

Captions