Human Generated Data

Title

Untitled (Westmoreland County, Pennsylvania)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1673

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Westmoreland County, Pennsylvania)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1673

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 97.5
Person 97.5
Text 97.3
Nature 93
Outdoors 88.7
Person 79.7
Newspaper 75.7
Person 72.6
Plant 66.4
Vegetation 66.4
Tree 65.9
Land 57.2
Architecture 56.4
Building 56.4

Clarifai
created on 2018-03-23

people 99.9
adult 99.7
one 98.9
portrait 98.5
street 97.7
monochrome 97.5
sign 96.3
signal 96
man 95.8
no person 95.6
bill 94.3
text 93.2
vertical 91.5
vehicle 91.4
group together 91.1
group 90.6
two 90.2
many 89.9
wear 88.4
woman 87.8

Imagga
created on 2018-03-23

structure 55
architecture 43.5
billboard 43
tower 41.2
building 37.9
signboard 35.3
city 27.4
landmark 27.1
sky 26.8
column 26.4
pole 25
clock 24.2
old 23
tourism 21.5
famous 21.4
travel 21.1
church 20.4
totem pole 19.9
rod 19.5
historic 18.3
monument 17.8
town 17.6
vodka 17.4
history 17
england 16.2
stone 15
window 14.8
ancient 14.7
house 14.2
exterior 13.8
tourist 13.7
religion 12.6
place 12.1
outdoors 11.9
cathedral 11.5
attraction 11.5
urban 11.4
tall 11.3
wall 11.1
obelisk 10.7
culture 10.3
parliament 9.9
houses 9.7
medieval 9.6
united 9.5
cloud 9.5
historical 9.4
bell 9.3
statue 9.1
skyscraper 8.9
palace 8.7
cityscape 8.5
brick 8.5
street 8.3
sign 8.3
time 8.2
touristic 7.8
kingdom 7.8
high 7.8
construction 7.7
architectural 7.7
village 7.7
great 7.7
capital 7.6
vintage 7.6
traditional 7.5
business 7.3

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

tree 100
outdoor 99.8
sign 96.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 99.6%
Confused 6%
Sad 10.2%
Calm 70.6%
Happy 3.4%
Surprised 2.2%
Angry 6.4%
Disgusted 1.2%

AWS Rekognition

Age 38-59
Gender Male, 98.9%
Sad 8.9%
Calm 46.4%
Confused 13.5%
Disgusted 2.7%
Surprised 5.8%
Happy 1.5%
Angry 21.2%

AWS Rekognition

Age 26-43
Gender Male, 52.9%
Surprised 45.1%
Happy 53.3%
Disgusted 45.1%
Calm 45.9%
Sad 45.5%
Angry 45.1%
Confused 45%

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.5%

Categories

Captions

Microsoft
created on 2018-03-23

a sign on a pole 95.3%
a black sign with white text 93.1%
a black sign with white letters 91.8%

Text analysis

Amazon

BORTZ
ROSE
SHERIFF
REGISTER
COMMISSIONER'
ARD
PERSHINC
RAY BORTZ X
LARENCE
Your Your REGISTER
IFF
X
RAY
Your
ARE
FOR
LARENCE ARE 11
11

Google

COMISSION CLARENCEH PERSHIN REGISTER Your . MORRIS L ROS SHERIFF RAY BORTZX
COMISSION
CLARENCEH
PERSHIN
REGISTER
Your
.
MORRIS
L
ROS
SHERIFF
RAY
BORTZX