Human Generated Data

Title

Moscow

Date

1959

People

Artist: William Klein, American 1928 - 2022

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1634

Human Generated Data

Title

Moscow

People

Artist: William Klein, American 1928 - 2022

Date

1959

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.3
Human 99.3
Person 98
Clothing 97.9
Apparel 97.9
Face 95.6
Person 89.9
Female 78.5
Evening Dress 71.6
Fashion 71.6
Gown 71.6
Robe 71.6
Shoe 71.3
Footwear 71.3
Shorts 69.6
Tree 67.7
Plant 67.7
Portrait 65.4
Photography 65.4
Photo 65.4
Outdoors 60.8
Suit 60
Coat 60
Overcoat 60
Girl 58.3
Woman 55.7

Imagga
created on 2022-01-08

dad 65.3
father 55.9
child 54.2
parent 53.8
son 29.3
male 27.9
swing 27
family 26.7
mother 25.2
love 24.5
happy 24.5
people 23.4
outdoors 21.7
brother 20.8
plaything 20.6
park 20.6
portrait 20.1
adult 20.1
boy 19.1
mechanical device 18.9
sibling 18.8
kid 18.6
man 18.2
smile 16.4
happiness 15.7
childhood 15.2
smiling 15.2
sitting 14.6
looking 14.4
mechanism 14.1
together 14
lifestyle 13.7
cute 13.6
youth 13.6
adorable 12.9
outside 12.8
children 12.8
pretty 12.6
couple 12.2
fun 12
offspring 12
casual 11.9
women 11.9
two 11.9
bench 11.7
little 11.5
lady 11.4
sexy 11.3
person 11.2
playing 10.9
attractive 10.5
summer 10.3
black 10.2
daughter 10.2
outdoor 9.9
fashion 9.8
cheerful 9.8
body 9.6
toddler 9.6
hair 9.5
enjoying 9.5
kids 9.4
baby 9.4
relationship 9.4
model 9.3
joy 9.2
leisure 9.1
girls 9.1
holding 9.1
old 9.1
care 9.1
home 8.8
grass 8.7
day 8.6
face 8.5
togetherness 8.5
house 8.4
boys 7.8
affectionate 7.7
expression 7.7
married 7.7
jeans 7.6
juvenile 7.6
pair 7.6
friends 7.5
senior 7.5
blond 7.4
teenager 7.3

Google
created on 2022-01-08

Smile 97.4
Plant 89.6
Black-and-white 85.4
Gesture 85.3
Style 83.9
Tree 83.8
Happy 81.2
Monochrome 76.5
Monochrome photography 74.7
Vest 74.5
Vintage clothing 72.4
Event 69.7
Sitting 69.2
Chest 68.4
Fence 68.1
Child 65.4
Photo caption 64.8
Room 64.2
History 63.7
Classic 61.2

Microsoft
created on 2022-01-08

person 99.6
smile 97.6
human face 96.9
posing 96
clothing 95.7
woman 95.2
text 93.2
outdoor 87
smiling 77.5
black 66

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-43
Gender Female, 100%
Happy 97.4%
Confused 0.7%
Angry 0.6%
Disgusted 0.4%
Calm 0.2%
Fear 0.2%
Sad 0.2%
Surprised 0.2%

AWS Rekognition

Age 68-78
Gender Male, 99.5%
Sad 99.4%
Calm 0.2%
Angry 0.2%
Confused 0.1%
Fear 0%
Disgusted 0%
Happy 0%
Surprised 0%

AWS Rekognition

Age 23-31
Gender Male, 99.4%
Calm 54.8%
Sad 23.2%
Angry 7.3%
Happy 4.1%
Surprised 4.1%
Fear 3.5%
Confused 1.6%
Disgusted 1.5%

Microsoft Cognitive Services

Age 14
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Shoe 71.3%

Captions

Microsoft

a woman posing for a photo 98.2%
a woman smiling and posing for a photo 96.7%
a woman posing for a picture 96.6%