Human Generated Data

Title

Untitled (Sixth Avenue, New York City)

Date

1932-1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4256

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Sixth Avenue, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 97.9
Human 97.9
Clothing 96.4
Apparel 96.4
Home Decor 95.3
Person 76.4
Advertisement 71.5
Poster 65.3
Collage 59.9
Overcoat 55.1
Coat 55.1

Imagga
created on 2022-01-08

book jacket 41.8
jacket 36.4
billboard 29
wrapping 24.7
signboard 23.5
structure 20.6
old 20.2
man 20.2
covering 18.7
money 17.9
male 16.3
person 15.8
people 15.6
currency 15.2
cash 14.6
product 14.6
newspaper 14.5
bill 14.3
portrait 14.2
business 14
black 14
dollar 13.9
banking 13.8
face 13.5
art 13.3
bank 12.9
creation 12.9
finance 12.7
financial 12.5
one 11.9
paper 11.8
head 11.8
vintage 11.6
close 11.4
savings 11.2
human 9.7
office 9.5
symbol 9.4
senior 9.4
adult 9.1
hair 8.7
antique 8.7
ancient 8.6
exchange 8.6
culture 8.5
economy 8.3
retro 8.2
dollars 7.7
mail 7.7
sculpture 7.4
success 7.2
aged 7.2
wealth 7.2
window 7.1
businessman 7.1

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

text 99.4
human face 97.8
person 96
clothing 93.2
outdoor 85.4
woman 67.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Female, 87.8%
Sad 65.7%
Calm 18.8%
Fear 7.1%
Confused 3.4%
Surprised 1.6%
Disgusted 1.6%
Angry 1.2%
Happy 0.5%

Microsoft Cognitive Services

Age 28
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.9%

Captions

Microsoft

a person standing in front of a window 77.6%
a person sitting in front of a window 58.4%
a person standing in front of a window 58.3%

Text analysis

Amazon

FOR
FOR RE
RE
Apply
76
Apply To
To
William
Horace S.
76 William ؟
&C
Horace S. El &C
؟
El

Google

Apply
76
FOR RE Apply Horace S.Elv & C 76 William
RE
S.Elv
William
Horace
C
FOR
&