Human Generated Data

Title

Delancey Street, New York City

Date

1947

People

Artist: Rebecca Lepkoff, American 1916 - 2014

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, by exchange, P2000.30

Human Generated Data

Title

Delancey Street, New York City

People

Artist: Rebecca Lepkoff, American 1916 - 2014

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.6
Human 98.6
Person 98.1
Person 97.9
Person 95.8
Interior Design 91.4
Indoors 91.4
Person 89.8
Musical Instrument 88.5
Musician 88.2
Oboe 86.3
Leisure Activities 82.8
Saxophone 65.4
Face 63.7
Advertisement 61.8
Poster 61.8
Person 60.5
Coat 58.5
Overcoat 58.5
Clothing 58.5
Apparel 58.5
Music Band 58.1
Horn 56.9
Brass Section 56.9

Imagga
created on 2022-01-08

person 36.3
man 29.6
people 25.1
male 22.8
adult 20.5
black 17.9
portrait 15.5
music 15.3
dark 15
sax 13.7
guitar 13.7
silhouette 13.2
world 13.1
performer 13.1
studio 12.9
business 12.8
sexy 12
stage 12
lifestyle 11.6
couple 11.3
attractive 11.2
party 11.2
musician 11.1
model 10.9
night 10.7
fashion 10.6
one 10.4
dance 10.4
room 10.4
love 10.3
expression 10.2
hand 9.9
musical instrument 9.8
disco 9.7
hands 9.6
planner 9.5
men 9.4
passion 9.4
entertainment 9.2
pretty 9.1
guy 9
spectator 9
player 9
lady 8.9
interior 8.8
happy 8.8
concert 8.7
electric guitar 8.5
two 8.5
indoor 8.2
office 8.2
style 8.2
handsome 8
life 8
looking 8
body 8
businessman 7.9
hair 7.9
women 7.9
work 7.8
rock 7.8
elegant 7.7
performance 7.7
professional 7.6
club 7.5
fun 7.5
holding 7.4
window 7.4
event 7.4
suit 7.4
dancer 7.3
alone 7.3
teenager 7.3
sensual 7.3
group 7.3
metal 7.2
shadow 7.2
romance 7.1
singer 7.1
face 7.1
to 7.1
together 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

text 100
person 98.3
clothing 96.5
dance 75.5
woman 72.3
black and white 70.8
man 66.8
human face 63.7
poster 55.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-43
Gender Male, 99.3%
Calm 99%
Sad 0.3%
Confused 0.2%
Fear 0.2%
Angry 0.1%
Disgusted 0.1%
Surprised 0.1%
Happy 0.1%

AWS Rekognition

Age 39-47
Gender Male, 80%
Disgusted 60.6%
Calm 18.6%
Fear 7.6%
Angry 6.8%
Sad 4.1%
Surprised 1%
Confused 0.8%
Happy 0.6%

AWS Rekognition

Age 41-49
Gender Male, 79.2%
Disgusted 28.7%
Angry 22.4%
Surprised 18.3%
Calm 9.3%
Happy 7.1%
Sad 6.1%
Fear 4.9%
Confused 3.3%

AWS Rekognition

Age 26-36
Gender Female, 53.7%
Fear 29.9%
Sad 28.8%
Calm 20.1%
Angry 9.6%
Disgusted 4.7%
Happy 2.7%
Confused 2.5%
Surprised 1.8%

Microsoft Cognitive Services

Age 42
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Poster 61.8%

Captions

Microsoft

a group of people posing for a photo 85.2%
a group of people standing in front of a store 78.1%
a group of people posing for the camera 78%

Text analysis

Amazon

BEER
ROOT
Cigarettes
Cigarettes 18
18
2
DR
5
ORA
K
FRANK
35
2 For 35
Koff
Levy's
For
0
Roberca Lop Koff
Lop
Roberca
ANGE
Dolang
DRINK

Google

2
1947
Levy's THER ROOT BEER Cigarettes 18 2 for 35 ORA O DR FRAN K 1947
Levy's
Cigarettes
O
THER
ROOT
BEER
for
ORA
18
35
DR
FRAN
K