Human Generated Data

Title

Untitled (Sixth Avenue, New York City)

Date

1932-1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4254

Human Generated Data

Title

Untitled (Sixth Avenue, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.3
Human 99.3
Person 98.7
Clothing 98.1
Apparel 98.1
Person 97.4
Person 93.9
Person 89.2
Person 83.7
Person 80.1
People 78.3
Military 75.9
Military Uniform 73.8
Hat 71.4
Person 70.1
Helmet 61.2
Fireman 59.2
Armored 56
Army 56

Imagga
created on 2022-01-08

car 20.5
television 19.1
light 16
black 15.9
man 14.8
night 14.2
telecommunication system 13.8
dark 13.4
silhouette 13.2
vehicle 12.5
device 11.9
chair 11.6
hat 10.4
seat 10.3
business 10.3
model t 10.2
road 9.9
cowboy hat 9.9
transportation 9.9
motor vehicle 9.4
conveyance 9.2
male 9.2
people 8.9
room 8.6
sitting 8.6
window 8.6
building 8.5
old 8.4
sky 8.3
equipment 8.2
technology 8.2
person 7.9
sidecar 7.9
travel 7.7
industry 7.7
elegance 7.5
art 7.5
computer 7.5
vintage 7.4
safety 7.4
street 7.4
industrial 7.3
metal 7.2
wheeled vehicle 7.1
working 7.1

Google
created on 2022-01-08

Black 89.8
Hat 89
Font 80.4
Suit 78.9
Art 71.8
Motor vehicle 67.7
Monochrome 67.7
History 67
Sun hat 66.3
Vintage clothing 65.7
Fedora 64.6
Monochrome photography 63.8
Room 63.3
Stock photography 62.2
Classic 61.9
Tie 59.9
Collection 57.6
Photo caption 56.7
Street 53.4
Visual arts 52

Microsoft
created on 2022-01-08

text 100
person 88.5
clothing 83.1
vehicle 81.6
land vehicle 80.5
man 73.8
human face 69.2
street 68.6
black and white 62.9
car 59.4

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Female, 96.8%
Calm 81.1%
Surprised 6.5%
Sad 5.9%
Confused 2.7%
Angry 1.5%
Happy 0.8%
Fear 0.8%
Disgusted 0.6%

AWS Rekognition

Age 47-53
Gender Male, 95.8%
Calm 75.9%
Angry 8.2%
Sad 5.4%
Confused 4.7%
Surprised 2.8%
Fear 1.8%
Happy 0.9%
Disgusted 0.4%

AWS Rekognition

Age 18-24
Gender Male, 99.5%
Calm 99.3%
Surprised 0.2%
Sad 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Happy 0%
Fear 0%

AWS Rekognition

Age 47-53
Gender Male, 98.7%
Calm 68.6%
Angry 26.3%
Fear 1.8%
Sad 1.1%
Surprised 0.8%
Happy 0.5%
Disgusted 0.5%
Confused 0.3%

AWS Rekognition

Age 25-35
Gender Female, 55.8%
Calm 81.9%
Surprised 4.8%
Fear 3.4%
Sad 2.9%
Happy 2.3%
Disgusted 1.8%
Confused 1.5%
Angry 1.4%

AWS Rekognition

Age 26-36
Gender Female, 99.4%
Calm 98.6%
Surprised 0.3%
Confused 0.3%
Fear 0.2%
Disgusted 0.2%
Sad 0.1%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 25-35
Gender Male, 99.9%
Calm 97.1%
Sad 0.7%
Surprised 0.6%
Happy 0.4%
Angry 0.4%
Confused 0.4%
Fear 0.2%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Helmet 61.2%

Captions

Microsoft

a man standing in front of a store 70.4%
a man standing in front of a building 67.7%
a man standing in front of a sign 67.6%

Text analysis

Amazon

FOR
FOR RENT
RENT
SALE
CAMPA
8
7
ION
SB 8
SB
WIST A
DI WIST A
AV
LATIN
QUATION LATIN
QUATION
DI

Google

JITAMORHJMA9 FOR RENT JON SALE S B8 DAMPA
B8
SALE
JON
S
FOR
DAMPA
JITAMORHJMA9
RENT