Human Generated Data

Title

Delancey Street, New York City

Date

1947

People

Artist: Rebecca Lepkoff, American 1916 - 2014

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, by exchange, P2000.30

Human Generated Data

Title

Delancey Street, New York City

People

Artist: Rebecca Lepkoff, American 1916 - 2014

Date

1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, by exchange, P2000.30

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.6
Human 98.6
Person 98.1
Person 97.9
Person 95.8
Interior Design 91.4
Indoors 91.4
Person 89.8
Musical Instrument 88.5
Musician 88.2
Oboe 86.3
Leisure Activities 82.8
Saxophone 65.4
Face 63.7
Poster 61.8
Advertisement 61.8
Person 60.5
Overcoat 58.5
Coat 58.5
Clothing 58.5
Apparel 58.5
Music Band 58.1
Horn 56.9
Brass Section 56.9

Clarifai
created on 2023-10-25

people 99.8
group 98.8
woman 97.5
adult 96.8
music 95.7
many 92.6
group together 90.8
man 90.5
several 89.7
administration 89.3
leader 87.4
street 86.4
wear 85
war 82.1
musician 80.9
actress 80.3
singer 78.9
portrait 77.7
child 76.7
outfit 75.9

Imagga
created on 2022-01-08

person 36.3
man 29.6
people 25.1
male 22.8
adult 20.5
black 17.9
portrait 15.5
music 15.3
dark 15
sax 13.7
guitar 13.7
silhouette 13.2
world 13.1
performer 13.1
studio 12.9
business 12.8
sexy 12
stage 12
lifestyle 11.6
couple 11.3
attractive 11.2
party 11.2
musician 11.1
model 10.9
night 10.7
fashion 10.6
one 10.4
dance 10.4
room 10.4
love 10.3
expression 10.2
hand 9.9
musical instrument 9.8
disco 9.7
hands 9.6
planner 9.5
men 9.4
passion 9.4
entertainment 9.2
pretty 9.1
guy 9
spectator 9
player 9
lady 8.9
interior 8.8
happy 8.8
concert 8.7
electric guitar 8.5
two 8.5
indoor 8.2
office 8.2
style 8.2
handsome 8
life 8
looking 8
body 8
businessman 7.9
hair 7.9
women 7.9
work 7.8
rock 7.8
elegant 7.7
performance 7.7
professional 7.6
club 7.5
fun 7.5
holding 7.4
window 7.4
event 7.4
suit 7.4
dancer 7.3
alone 7.3
teenager 7.3
sensual 7.3
group 7.3
metal 7.2
shadow 7.2
romance 7.1
singer 7.1
face 7.1
to 7.1
together 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

text 100
person 98.3
clothing 96.5
dance 75.5
woman 72.3
black and white 70.8
man 66.8
human face 63.7
poster 55.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-43
Gender Male, 99.3%
Calm 99%
Sad 0.3%
Confused 0.2%
Fear 0.2%
Angry 0.1%
Disgusted 0.1%
Surprised 0.1%
Happy 0.1%

AWS Rekognition

Age 39-47
Gender Male, 80%
Disgusted 60.6%
Calm 18.6%
Fear 7.6%
Angry 6.8%
Sad 4.1%
Surprised 1%
Confused 0.8%
Happy 0.6%

AWS Rekognition

Age 41-49
Gender Male, 79.2%
Disgusted 28.7%
Angry 22.4%
Surprised 18.3%
Calm 9.3%
Happy 7.1%
Sad 6.1%
Fear 4.9%
Confused 3.3%

AWS Rekognition

Age 26-36
Gender Female, 53.7%
Fear 29.9%
Sad 28.8%
Calm 20.1%
Angry 9.6%
Disgusted 4.7%
Happy 2.7%
Confused 2.5%
Surprised 1.8%

Microsoft Cognitive Services

Age 42
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Poster 61.8%

Text analysis

Amazon

BEER
ROOT
Cigarettes
Cigarettes 18
18
2
DR
5
ORA
K
FRANK
35
2 For 35
Koff
Levy's
For
0
Roberca Lop Koff
Lop
Roberca
ANGE
Dolang
DRINK

Google

Levy's THER ROOT BEER Cigarettes 18 2 for 35 ORA O DR FRAN K 1947
Levy's
THER
ROOT
BEER
Cigarettes
18
2
for
35
ORA
O
DR
FRAN
K
1947