Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.: The street-cleaning department at work.

Date

c. 1903

People

Artist: Simon Lubin, American 1876 - 1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1247.5

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.: The street-cleaning department at work.

People

Artist: Simon Lubin, American 1876 - 1936

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 96.9
Person 96.9
Wheel 96.6
Machine 96.6
Transportation 91.2
Vehicle 91.1
Wagon 87.6
Animal 78.1
Horse 78.1
Mammal 78.1
Horse Cart 72.2
Cow 62.4
Cattle 62.4
Carriage 61.6
Spoke 59.8
Tire 57
Person 44.3

Clarifai
created on 2019-06-07

people 99.9
carriage 99.8
adult 99.5
cavalry 99.5
cart 99.4
wagon 99.1
two 99.1
vehicle 99
transportation system 98.6
one 98.5
group 98.2
man 97.3
mammal 96.3
three 95.1
group together 94.6
woman 94.5
several 90
four 89.7
wear 89.3
no person 88.7

Imagga
created on 2019-06-07

carriage 44.7
old 32.7
antique 31.1
cart 28.5
wagon 22.9
transportation 21.5
machine 21.4
thresher 21.3
vehicle 19
horse cart 18.2
vintage 18.2
transport 17.3
farm machine 17.1
wheel 16.2
retro 15.5
horse 14.2
artillery 13.5
rural 13.2
device 13.2
history 12.5
wheeled vehicle 12
wheels 11.7
historical 11.3
celebration 11.2
box 11
cannon 11
historic 11
aged 10.8
travel 10.6
wooden 10.5
antiquity 10.4
gift 10.3
farm 9.8
ribbon 9.5
armament 9.4
field artillery 9.3
city 9.1
container 9
decoration 8.7
driver 8.7
ancient 8.6
day 8.6
holiday 8.6
festive 8.3
gold 8.2
daily 8.1
machinery 7.8
hay 7.7
structure 7.7
old fashioned 7.6
traditional 7.5
brown 7.4
tool 7.3
black 7.2
grass 7.1
architecture 7

Google
created on 2019-06-07

Microsoft
created on 2019-06-07

building 99.5
horse 98.7
carriage 97.9
pulling 95.4
drawn 94.1
old 92.5
outdoor 89.3
cart 82.8
land vehicle 78.5
wheel 76.7
person 76.4
transport 70.9
animal 70.4
vehicle 69.8
white 67.3
horse and buggy 65.2
wagon 57.9

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 54.9%
Angry 45.6%
Happy 48.9%
Sad 47.6%
Surprised 45.6%
Calm 45.6%
Confused 45.7%
Disgusted 46.1%

AWS Rekognition

Age 26-44
Gender Male, 53.7%
Calm 49.6%
Sad 46.1%
Surprised 45.8%
Angry 45.7%
Happy 45.4%
Disgusted 45.5%
Confused 47%

Feature analysis

Amazon

Person 96.9%
Wheel 96.6%
Horse 78.1%
Cow 62.4%

Captions

Microsoft

an old photo of a horse drawn carriage 97.5%
a black and white photo of a horse drawn carriage 95.7%
a man riding a horse drawn carriage 93.6%

Text analysis

Google

7
3 7
3