Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.: Printing office, organized in 1900. The G.J.R. paper, The Citizen, is printed here.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1240.1

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.: Printing office, organized in 1900. The G.J.R. paper, The Citizen, is printed here.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1240.1

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 99.4
Person 99.4
Machine 99.3
Leisure Activities 99.3
Piano 99.3
Musical Instrument 99.3
Person 98.7
Person 98
Person 93.6
Person 88.8
Housing 85.3
Building 85.3
Workshop 68.3
Lathe 67.3
Factory 58.5

Clarifai
created on 2019-06-07

people 100
adult 99.6
two 98.6
one 98.4
group 98.1
group together 98
vehicle 97.8
three 97
man 96.5
administration 94.4
war 93.4
many 93.1
military 92.5
wear 92.5
furniture 92.1
medical practitioner 91.8
woman 91.5
watercraft 91.5
transportation system 91.3
four 91.3

Imagga
created on 2019-06-07

loom 88.3
machine 73
textile machine 71.1
device 46.2
industrial 36.3
factory 33.9
industry 32.4
steel 30
building 23.1
metal 20.9
modern 20.3
interior 19.4
power 19.3
engineering 19
plant 18.2
manufacturing 17.6
inside 17.5
equipment 15.6
structure 15.5
heavy 15.2
work 14.9
pipe 14.6
pollution 14.4
typesetting machine 14.3
heat 14.1
architecture 14
old 13.9
business 13.3
mechanic 12.7
waste 12.6
steam 12.6
chair 12.6
tube 12.5
urban 12.2
printer 12
machinery 11.8
mechanical 11.7
gas 11.5
house 10.9
production 10.7
fuel 10.6
engine 10.6
burn 10.6
energy 10.1
man 10.1
hot 10
working 9.7
technical 9.7
technology 9.6
design 9.6
system 9.5
wall 9.5
room 9.4
iron 9.3
economy 9.3
environment 9
dirty 9
science 8.9
piping 8.9
pipes 8.8
petrol 8.8
chimney 8.8
complex 8.7
station 8.7
supply 8.7
concrete 8.6
men 8.6
dishwasher 8.5
construction 8.5
people 8.4
oil 8.3
furniture 8.2
turbine 7.9
refinery 7.9
pipeline 7.9
appliance 7.8
male 7.8
table 7.8
chemical 7.7
shopping cart 7.7
vintage 7.4
oven 7.4
light 7.3
water 7.3
black 7.2
transportation 7.2
person 7.1

Google
created on 2019-06-07

Machine 69.6
Art 50.2

Microsoft
created on 2019-06-07

person 91.7
indoor 91.6
factory 89.9
clothing 69.8
work 57.8
cooking 24.2
work-clothing 20
miller 5.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 17-27
Gender Female, 93.2%
Calm 11%
Angry 6%
Disgusted 1.8%
Sad 76.2%
Confused 2.2%
Surprised 1.6%
Happy 1.2%

AWS Rekognition

Age 20-38
Gender Male, 54.9%
Happy 45.3%
Calm 46.8%
Surprised 45.4%
Disgusted 45.2%
Confused 45.5%
Angry 45.4%
Sad 51.4%

AWS Rekognition

Age 29-45
Gender Male, 93.5%
Angry 6.1%
Calm 72.2%
Confused 5.3%
Disgusted 1.2%
Happy 1.5%
Sad 8.7%
Surprised 5.1%

AWS Rekognition

Age 15-25
Gender Female, 55%
Disgusted 45.4%
Sad 46.1%
Calm 49.9%
Confused 46.5%
Surprised 45.9%
Happy 45.7%
Angry 45.4%

AWS Rekognition

Age 26-43
Gender Female, 53.7%
Happy 45.3%
Calm 49.8%
Surprised 46.1%
Disgusted 45.2%
Confused 46%
Angry 45.2%
Sad 47.3%

Microsoft Cognitive Services

Age 8
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 24
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Piano 99.3%

Categories

Imagga

paintings art 99.8%

Captions

Microsoft
created on 2019-06-07

a man standing next to a factory 77.2%
a man standing in front of a factory 77.1%
a man in a factory 77%

Text analysis

Amazon

G314