Human Generated Data

Title

Untitled (Willis Avenue Bridge, New York City)

Date

1932-1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2811

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Willis Avenue Bridge, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 99.5
Person 99.5
Person 99.3
Furniture 98.4
Sitting 93.6
Wood 92.9
Apparel 91.2
Clothing 91.2
Bench 86.6
Park Bench 75
Finger 60.9
Plywood 57.6
Porch 56.3

Clarifai
created on 2018-03-23

people 99.9
adult 98.7
man 97.6
group 96.2
one 94.2
war 93.6
two 93.4
portrait 92.1
three 90.4
woman 89.3
vehicle 89.3
several 88.7
administration 88.3
group together 86.4
recreation 86
music 84
watercraft 83.9
leader 83.5
four 81.5
facial expression 81.2

Imagga
created on 2018-03-23

bassoon 50.5
catapult 24.2
man 22.2
male 21.3
engine 20.8
instrument 19.7
construction 19.7
industry 19.6
people 16.7
device 16.5
industrial 15.4
building 15.2
person 13.4
sky 13.4
steel 13.4
worker 13.3
old 13.2
adult 13
helmet 12.5
working 12.4
smiling 12.3
site 12.2
equipment 12.1
wind instrument 11.2
men 11.1
work 11.1
fun 10.5
outdoors 10.4
builder 10.3
architecture 10.1
city 10
child 9.9
job 9.7
happy 9.4
outdoor 9.2
group 8.9
labor 8.7
boy 8.7
senior 8.4
playing 8.2
protection 8.2
structure 8.1
metal 8
park 8
together 7.9
urban 7.9
smile 7.8
bridge 7.6
hard 7.6
wood 7.5
active 7.3
hat 7.3
machine 7.2
transportation 7.2
family 7.1
kid 7.1
factory 7
travel 7

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 99.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 60-80
Gender Male, 93.9%
Happy 34.3%
Confused 6.3%
Sad 8.9%
Angry 8%
Calm 22.3%
Disgusted 13.2%
Surprised 7%

AWS Rekognition

Age 26-43
Gender Male, 96.5%
Confused 2%
Surprised 0.9%
Calm 5.4%
Sad 85.9%
Disgusted 1.7%
Happy 1.1%
Angry 2.9%

Microsoft Cognitive Services

Age 42
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people sitting on a bench 84%
a man sitting on a bench 81.7%
a man and a woman sitting on a bench 67.2%