Human Generated Data

Title

Coney Island, New York City

Date

1946

People

Artist: Morris Engel, American 1918 - 2005

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, by exchange, P2000.31

Human Generated Data

Title

Coney Island, New York City

People

Artist: Morris Engel, American 1918 - 2005

Date

1946

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.9
Human 99.9
Person 99.7
Person 99.4
Person 98.2
Person 95.8
Person 95.7
Clothing 91.9
Apparel 91.9
Person 89
Person 87.1
People 85
Person 81.4
Person 80
Skin 68.2
Shorts 62.9
Crowd 61.3
Face 59.4
Finger 58.6
Female 56.2
Leisure Activities 56.1

Imagga
created on 2022-01-08

couple 36.6
sexy 36.1
people 35.1
love 33.9
adult 33
kin 31.3
attractive 30.8
portrait 28.5
fashion 27.9
man 26.9
sensual 26.4
person 25.9
happy 25.1
male 25
model 24.9
together 22.8
pretty 22.4
body 21.6
two 20.3
passion 17.9
mother 17.6
skin 17.4
lady 17
clothing 17
child 15.9
relationship 15.9
face 15.6
parent 15.5
lifestyle 15.2
husband 15.2
family 15.1
women 15
happiness 14.9
erotic 14.6
boyfriend 14.5
cute 14.3
hair 14.3
romantic 14.3
style 14.1
black 13.9
girls 13.7
sensuality 13.6
gorgeous 13.6
summer 13.5
sexual 13.5
girlfriend 13.5
married 13.4
posing 13.3
wife 13.3
smiling 13
lingerie 12.8
romance 12.5
brunette 12.2
handsome 11.6
bride 11.5
smile 11.4
human 11.2
outdoors 11.2
youth 11.1
beach 11
elegance 10.9
passionate 10.8
sex 10.7
boy 10.4
lying 10.3
blond 10.3
covering 10.3
men 10.3
wedding 10.1
groom 9.9
underwear 9.7
desire 9.6
loving 9.5
sitting 9.4
luxury 9.4
elegant 9.4
expression 9.4
dark 9.2
stylish 9
dress 9
fun 9
sibling 8.9
lovely 8.9
kiss 8.8
hug 8.7
eyes 8.6
life 8.5
togetherness 8.5
pair 8.5
relax 8.4
outdoor 8.4
maillot 8.4
leisure 8.3
emotion 8.3
garment 8.2
make 8.2
looking 8
intimate 7.9
embrace 7.8
lovers 7.7
seductive 7.6
studio 7.6
females 7.6
hot 7.5
guy 7.5
swimsuit 7.5
vintage 7.4
world 7.4
retro 7.4
vacation 7.4
makeup 7.3
room 7.3
pose 7.2
holiday 7.2
interior 7.1

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

person 100
clothing 94.6
outdoor 91.7
group 86.9
text 85.8
people 85.5
woman 79.4
human face 72.6
smile 65.3
crowd 0.8

Face analysis

Amazon

Google

AWS Rekognition

Age 21-29
Gender Male, 78.2%
Happy 76.4%
Disgusted 13.6%
Angry 3.6%
Calm 2.2%
Sad 1.9%
Surprised 1.1%
Fear 0.6%
Confused 0.6%

AWS Rekognition

Age 4-12
Gender Female, 99.9%
Angry 92.9%
Calm 3.2%
Happy 0.9%
Sad 0.9%
Disgusted 0.7%
Surprised 0.5%
Fear 0.4%
Confused 0.3%

AWS Rekognition

Age 23-31
Gender Male, 99.7%
Calm 85.7%
Sad 11.1%
Fear 0.9%
Confused 0.9%
Angry 0.5%
Surprised 0.3%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 41-49
Gender Male, 99.5%
Sad 93.9%
Calm 5.5%
Happy 0.2%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 50-58
Gender Male, 99.6%
Calm 45.7%
Happy 30%
Sad 13%
Angry 5.8%
Fear 1.8%
Surprised 1.5%
Disgusted 1.3%
Confused 0.8%

AWS Rekognition

Age 23-33
Gender Female, 83.5%
Calm 68.5%
Sad 16.4%
Fear 3.9%
Happy 3.9%
Angry 2.4%
Confused 1.9%
Surprised 1.6%
Disgusted 1.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%

Captions

Microsoft

a group of people around each other 95.1%
a group of people standing in front of a crowd 94.6%
a group of people that are talking to each other 91.6%