Human Generated Data

Title

Crime, Prisons: United States. New York. New York City. "The Tombs": Department of Correction, New York City: The Warden. City Prison ("The Tombs") Manhattan.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1301

Human Generated Data

Title

Crime, Prisons: United States. New York. New York City. "The Tombs": Department of Correction, New York City: The Warden. City Prison ("The Tombs") Manhattan.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-04

Human 99.2
Person 99.2
Furniture 98.1
Table 84.8
Shelf 80.6
Desk 79.3
Display 78
Monitor 78
Electronics 78
Screen 78
LCD Screen 76.1
Text 75.2
Face 70.7
Apparel 66.3
Clothing 66.3
Coat 58.8
Overcoat 58.8
Wood 57.8
Poster 57.2
Advertisement 57.2
Cabinet 56
Closet 55.3
Cupboard 55.3

Clarifai
created on 2019-06-04

people 99.3
adult 98.3
man 96.1
indoors 96
furniture 93.7
one 93.2
woman 90.6
monochrome 89
sit 86.3
desk 84.5
room 81.1
shelf 80.9
elderly 80
side view 76.7
concentration 74.3
portrait 72.1
nostalgia 71.5
paper 70.7
horizontal 70.2
technology 69.3

Imagga
created on 2019-06-04

home 33.5
person 27.6
people 24
adult 23.2
laptop 21.8
man 21.5
happy 21.3
indoors 21.1
smiling 21
house 20.9
work 19.8
interior 18.6
male 18.4
room 18
computer 17.8
smile 17.8
box 16.7
business 16.4
sitting 15.4
office 15.2
table 14.7
looking 14.4
working 14.1
holding 14
furniture 13.6
technology 13.3
patient 12.9
desk 12.3
device 12.3
education 12.1
professional 12.1
corporate 12
student 11.8
portrait 11.6
attractive 11.2
happiness 11
case 10.9
equipment 10.6
job 10.6
cheerful 10.6
modern 10.5
school 10.1
inside 10.1
businesswoman 10
product 9.9
worker 9.8
pretty 9.8
newspaper 9.6
chair 9.5
home appliance 9.5
container 9.4
mature 9.3
occupation 9.2
confident 9.1
old 9
electronic equipment 9
brown 8.8
book 8.8
boxes 8.8
couple 8.7
women 8.7
standing 8.7
child 8.6
indoor 8.2
briefcase 8
family 8
appliance 8
creation 7.9
lifestyle 7.9
businessman 7.9
cute 7.9
machine 7.7
studying 7.7
sofa 7.6
college 7.6
television 7.5
doctor 7.5
senior 7.5
relaxing 7.3
suit 7.2
holiday 7.2
carton 7.2
kitchen 7.1
coat 7.1
hospital 7.1
iron lung 7.1
medical 7.1

Google
created on 2019-06-04

Microsoft
created on 2019-06-04

furniture 94.4
indoor 93.7
clothing 93.4
person 93.2
box 88.9
table 79.3
shelf 71.4
man 68.4

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 35-52
Gender Male, 64.2%
Disgusted 1.5%
Sad 11.3%
Happy 1.2%
Confused 6.1%
Surprised 27.2%
Calm 47.1%
Angry 5.8%

Microsoft Cognitive Services

Age 57
Gender Male

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a person sitting in a box 73.3%
a person sitting in front of a box 73.1%
a person sitting in a box on a shelf 59.1%

Text analysis

Amazon

Department
New
York
Department of Correction, New York City
Correction,
of
City
CITY
MANHATTA
WARDEN
CITY PRISOIN CTHETOMIS) MANHATTA
PRISOIN
THE WARDEN
C169.73.3.31
CTHETOMIS)
THE
om
DDIW

Google

Department
New
(THE
MANHATTAN
York
THE
169.73.
PRIScN
TOMBS)
Department of Correction, New York City AC 169.73. B.31 THE WARDEN CITY PRIScN (THE TOMBS) MANHATTAN
of
Correction,
WARDEN
City
AC
B.31
CITY