Human Generated Data

Title

James Baldwin, Colored Entrance Only, New Orleans

Date

1963

People

Artist: Steve Schapiro, American 1934 - 2022

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Richard and Ronay Menschel Fund for the Acquisition of Photographs, 2018.116

Copyright

© Steve Schapiro

Human Generated Data

Title

James Baldwin, Colored Entrance Only, New Orleans

People

Artist: Steve Schapiro, American 1934 - 2022

Date

1963

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Clothing 99.6
Apparel 99.6
Human 97.1
Person 97.1
Home Decor 95.1
Door 94.3
Suit 93.3
Cream 91.7
Ice Cream 91.7
Dessert 91.7
Creme 91.7
Food 91.7
Coat 89
Brick 85
Face 81.4
Sleeve 72.1
Female 71.3
Overcoat 65.3
Woman 62.1
Long Sleeve 58.5
Tuxedo 57.2
Man 56.2
Smile 56
People 55.7
Person 45

Clarifai
created on 2018-08-01

people 99.7
adult 97.7
one 97
leader 94.8
administration 93.7
wear 93.1
man 92.6
woman 88.4
portrait 87.6
military 87.5
two 87
uniform 82.8
group together 80
war 78.6
outfit 78
three 78
group 76.7
street 74.9
music 73.3
offense 71

Imagga
created on 2018-08-01

musical instrument 43.3
wind instrument 31.9
brass 28.4
banjo 24.4
trombone 22.7
stringed instrument 20.8
man 18.1
male 14.2
statue 13.8
wall 13.7
old 13.2
accordion 12.4
art 12.3
building 12.1
people 11.7
person 11.3
culture 11.1
sax 10.9
sculpture 10.5
architecture 10.2
stone 10.1
city 10
keyboard instrument 10
vintage 9.9
adult 9.7
ancient 9.5
door 9.5
sport 9.2
street 9.2
business 9.1
silhouette 9.1
portrait 9
symbol 8.7
entrance 8.7
historical 8.5
historic 8.2
tourism 8.2
human 8.2
black 8.2
window 7.7
office 7.6
fashion 7.5
pay-phone 7.5
one 7.5
device 7.3
financial 7.1
face 7.1

Google
created on 2018-08-01

Microsoft
created on 2018-08-01

building 99.9
outdoor 97.6
person 85.8
standing 78
black 73.4
posing 61.1
dressed 27.7

Face analysis

Amazon

Google

AWS Rekognition

Age 35-52
Gender Female, 96.7%
Surprised 4.4%
Angry 5.7%
Sad 29.6%
Calm 41.8%
Confused 11.6%
Disgusted 3.6%
Happy 3.4%

AWS Rekognition

Age 35-53
Gender Female, 80.3%
Angry 9.8%
Sad 1.6%
Disgusted 0.3%
Surprised 0.4%
Happy 0.1%
Confused 0.1%
Calm 87.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.1%
Door 94.3%
Ice Cream 91.7%
Coat 89%
Overcoat 65.3%

Captions

Microsoft

James Baldwin standing in front of a building 91.7%
James Baldwin standing in front of a building 90.6%
James Baldwin standing in front of a brick building 87.4%

Text analysis

Amazon

ENTRANCE
COLORED ENTRANCE
COLORED
ONLY

Google

ONLY
ENTRANCE
COLORED ENTRANCE ONLY
COLORED