Human Generated Data

Title

Untitled (movie theatre, Japan)
Date

March 14, 1960-April 22, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3227
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (movie theatre, Japan)

People

Artist: Ben Shahn, American 1898 - 1969

Date

March 14, 1960-April 22, 1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Vehicle 99.9
Bike 99.9
Transportation 99.9
Bicycle 99.9
Machine 99.5
Wheel 99.5
Person 99.5
Human 99.5
Person 99.4
Person 99.3
Wheel 98.7
Bicycle 97
Person 96.2
Person 89.6
Sports 83.3
Sport 83.3
Cyclist 83.3
Text 75.4
Advertisement 71.9
Pedestrian 66.5
Urban 65.5
Road 58.8
Town 57.7
City 57.7
Building 57.7
Downtown 57.7
Asphalt 55.3
Tarmac 55.3
Person 46.4
Person 45.8

Clarifai
created on 2018-03-23

people 99.9
street 98.9
group 98.8
adult 98.4
group together 97.2
vehicle 96.9
man 95.9
one 94.6
monochrome 94.6
two 94.1
many 93.9
transportation system 91.9
administration 91.2
woman 91.2
several 89.3
stock 88.7
commerce 88.3
three 88.2
wear 87.5
graffiti 85.9

Imagga
created on 2018-03-23

tricycle 48
wheeled vehicle 44.9
vehicle 33.2
shop 27.1
building 24.1
conveyance 21.5
city 20.8
mercantile establishment 19.6
wheelchair 19.3
architecture 18.7
chair 18
street 17.5
wall 16.2
old 16
transportation 15.2
travel 14.8
seat 14.6
road 13.5
window 13.4
barbershop 13.3
urban 13.1
place of business 12.9
brick 11.3
sign 11.3
people 11.1
tobacco shop 11.1
transport 10.9
stall 10.6
color 10.6
blackboard 10.2
town 10.2
door 9.5
bench 9.2
outdoors 8.9
light 8.7
bicycle 8.7
grunge 8.5
business 8.5
horizontal 8.4
balcony 8.3
newspaper 8.3
furniture 8.2
structure 7.9
scene 7.8
outdoor 7.6
lamp 7.6
exterior 7.4
tourist 7.2
dirty 7.2
bank 7.2
information 7.1

Google
created on 2018-03-23

road 94.4
wall 91.3
black and white 91.2
street 90.9
infrastructure 90.1
urban area 89.5
public space 85.1
car 84.2
town 82.1
advertising 79.7
photography 79.6
monochrome photography 78.8
vehicle 76.5
monochrome 72.3
facade 69.8
city 66.1
window 66.1
house 63.2
building 62
street art 61.3

Microsoft
created on 2018-03-23

building 99.8
outdoor 98
road 97.1
bicycle 92.5
store 33
past 28.7

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 23-38
Gender Male, 54.6%
Confused 46.1%
Surprised 45.4%
Angry 46.9%
Sad 45.6%
Happy 45.3%
Calm 45.5%
Disgusted 50.3%

AWS Rekognition

Age 20-38
Gender Female, 54.9%
Disgusted 45.2%
Confused 45.3%
Calm 50.3%
Surprised 45.5%
Angry 45.4%
Sad 48.2%
Happy 45.1%

AWS Rekognition

Age 38-57
Gender Male, 50.5%
Angry 49.7%
Calm 49.9%
Happy 49.6%
Disgusted 49.6%
Surprised 49.5%
Sad 49.7%
Confused 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Angry 49.9%
Calm 49.5%
Happy 49.5%
Disgusted 49.7%
Surprised 49.5%
Sad 49.8%
Confused 49.5%

AWS Rekognition

Age 35-52
Gender Male, 50.2%
Angry 49.7%
Sad 49.6%
Calm 49.6%
Disgusted 49.8%
Happy 49.5%
Surprised 49.6%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Sad 50.5%
Angry 49.5%
Happy 49.5%
Calm 49.5%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Happy 49.6%
Angry 49.6%
Disgusted 49.6%
Calm 49.5%
Sad 49.8%
Surprised 49.6%
Confused 49.7%

AWS Rekognition

Age 20-38
Gender Female, 50%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%
Sad 50.5%
Angry 49.5%
Happy 49.5%
Calm 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Confused 49.5%
Sad 50.4%
Calm 49.5%
Happy 49.5%
Surprised 49.5%
Angry 49.5%
Disgusted 49.5%

AWS Rekognition

Age 17-27
Gender Female, 50.4%
Calm 49.7%
Sad 50%
Confused 49.5%
Happy 49.5%
Disgusted 49.6%
Angry 49.6%
Surprised 49.5%

AWS Rekognition

Age 38-59
Gender Male, 50.2%
Angry 49.6%
Sad 49.5%
Calm 49.5%
Confused 49.5%
Surprised 49.5%
Happy 49.5%
Disgusted 50.3%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Confused 49.5%
Surprised 49.6%
Calm 49.6%
Happy 49.8%
Angry 49.7%
Sad 49.7%
Disgusted 49.6%

AWS Rekognition

Age 17-27
Gender Female, 53.6%
Sad 48.1%
Surprised 45.8%
Disgusted 48.7%
Confused 45.5%
Calm 45.7%
Happy 45.2%
Angry 46.1%

Microsoft Cognitive Services

Age 40
Gender Female

Microsoft Cognitive Services

Age 29
Gender Male

Feature analysis

Amazon

Bicycle 99.9%
Wheel 99.5%
Person 99.5%

Captions

Microsoft

a person riding a bicycle in front of a store 73.8%
a person riding a bicycle in front of a building 73.7%
a person riding a bicycle on the side of a building 73.6%

Text analysis

Amazon

AGHG
Kll-
3
Br 3
Br
514>
WTE NILERNE'ST
t't
FIIGGER
RHISTE 514>
IRPAIN
E3*tat tB! WTE NILERNE'ST
4:toes'
FR
FIbl
82424
f*l
44)-25210
E3*tat
RHISTE
LT%5
tB!
88F
YEE 88F
B
YEE

Google

ウ机トディズニー製作☆ 総天然色豪83木立。上映中! い巟野! 8728 ·i·洋楽侵洋 ˋ出こ力茁 なん睽転 rのべ出向 の 上 ニの 映:1低 てる杆 ス ..' ,余 FRIC アン,
ウ
机
ト
ディズニー
製作
☆
総
天然色
豪
83
木立
。
上映
中
!
い
巟野
8728
·
i
洋
楽
侵
ˋ
出
こ
力
茁
なん
睽転
r
のべ
出向
の
上
ニ
映
:
1
低
てる
杆
ス
..
'
,
余
FRIC
アン