Human Generated Data

Title

Untitled (woman talking on phone while three girls play with cord)

Date

1980

People

Artist: Susan Kandel, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.601

Human Generated Data

Title

Untitled (woman talking on phone while three girls play with cord)

People

Artist: Susan Kandel, American 20th century

Date

1980

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.7
Human 99.7
Person 99.5
Person 98.6
Clothing 97.7
Apparel 97.7
Person 92.8
Leisure Activities 77.8
Guitar 77.8
Musical Instrument 77.8
Female 77.2
Face 63
Woman 62.4
Art 59.3
Drawing 59.3
Advertisement 58.1
Poster 58.1
Collage 58.1
Hair 58.1
Sleeve 56.6
Musician 56.6

Imagga
created on 2022-01-08

person 25.6
people 25.1
adult 23.7
man 22.2
brass 21.4
black 21.3
sexy 20.9
wind instrument 20.8
fashion 18.8
musical instrument 18.6
male 18.4
portrait 18.1
women 16.6
attractive 16.1
model 14.8
style 14.1
device 14.1
lady 13.8
music 13.6
guitar 13.1
youth 12.8
pretty 12.6
professional 12.6
happy 12.5
urban 12.2
standing 12.2
face 12.1
call 11.7
lifestyle 11.6
life 11.5
to 11.5
cornet 11.4
brunette 11.3
musician 10.7
smile 10.7
looking 10.4
business 10.3
men 10.3
smiling 10.1
studio 9.9
party 9.5
microphone 9.4
equipment 9.2
dress 9
fun 9
body 8.8
sax 8.8
hair 8.7
rock 8.7
work 8.6
cute 8.6
corporate 8.6
stand 8.5
casual 8.5
two 8.5
modern 8.4
entertainment 8.3
world 8.2
one 8.2
bass 8.2
performer 8.1
suit 8.1
couple 7.8
sitting 7.7
power 7.6
dark 7.5
city 7.5
holding 7.4
emotion 7.4
singer 7.4
office 7.4
danger 7.3
sensual 7.3
sensuality 7.3
school 7.2
businessman 7.1
indoors 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

person 96.8
drawing 95.8
clothing 93.5
text 88.8
woman 81.2
sketch 79.4
black and white 78.9
standing 75.5
cartoon 65.5
posing 64.4
gallery 55

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 86%
Calm 99.7%
Sad 0.1%
Surprised 0%
Confused 0%
Fear 0%
Angry 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 6-14
Gender Female, 100%
Calm 48.7%
Angry 34.9%
Confused 7%
Disgusted 4.7%
Sad 1.6%
Surprised 1.5%
Fear 1%
Happy 0.6%

AWS Rekognition

Age 6-14
Gender Female, 99.9%
Fear 70.9%
Disgusted 24.2%
Surprised 1.5%
Sad 1%
Angry 0.9%
Calm 0.8%
Confused 0.4%
Happy 0.3%

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 8
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Guitar 77.8%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 91.5%
a group of people standing in front of a mirror posing for the camera 78.4%
a man and woman standing in front of a mirror posing for the camera 68.5%

Text analysis

Amazon

SAN

Google

SAF
SAF