Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.: A dining room scene.

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1237.1

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.: A dining room scene.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1237.1

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Restaurant 98.7
Person 98.6
Human 98.6
Person 98
Person 97.8
Person 97.5
Person 97.2
Person 97
Person 96.8
Person 95
Chair 94.6
Furniture 94.6
Chair 93.1
Room 89.7
Indoors 89.7
Person 88.2
Person 88.2
Person 88
Pub 87.3
Person 87
Meal 83.7
Food 83.7
Person 83.6
Cafeteria 82.3
Interior Design 71
Person 68.1
Bar Counter 67.6
Cafe 63.6
Person 63
Table 59.8
Classroom 59.7
School 59.7
Couch 59.4
Food Court 57.2

Clarifai
created on 2019-06-07

people 100
group 99.7
many 99.4
group together 98.8
adult 97.7
administration 96.8
several 96.6
man 94.8
leader 94.6
furniture 93.2
military 91.7
woman 90.9
chair 90.7
war 85.9
room 84.6
sit 83.8
wear 80.2
vehicle 79.1
recreation 78.3
five 77.3

Imagga
created on 2019-06-07

brass 54.9
wind instrument 47.3
cornet 44.5
musical instrument 36
man 25.5
interior 23.9
people 22.3
television camera 21.2
room 21.2
chair 19
business 18.8
male 17.7
inside 17.5
television equipment 17
men 16.3
group 16.1
person 15.6
trombone 14.7
indoor 14.6
modern 14
table 13.8
office 13.8
adult 13.4
silhouette 13.2
indoors 13.2
urban 13.1
window 12.9
music 12.8
electronic equipment 12.7
equipment 12.7
restaurant 12.2
floor 12.1
glass 11.7
light 11.4
design 11.2
home 11.2
communication 10.9
black 10.9
hall 10.9
photographer 10.7
businessman 10.6
corporate 10.3
building 10.1
musician 10.1
night 9.8
concert 9.7
couple 9.6
women 9.5
meeting 9.4
work 9.4
lifestyle 9.4
stage 9.1
style 8.9
device 8.7
professional 8.7
party 8.6
contemporary 8.5
elegance 8.4
house 8.4
drink 8.3
city 8.3
leisure 8.3
entertainment 8.3
occupation 8.2
playing 8.2
microphone 8.1
suit 8.1
handsome 8
chairs 7.8
architecture 7.8
education 7.8
sitting 7.7
classroom 7.7
performance 7.7
guitar 7.6
sound 7.6
club 7.5
team 7.2
job 7.1
working 7.1

Google
created on 2019-06-07

Microsoft
created on 2019-06-07

person 99.7
clothing 97.9
indoor 96
group 94.3
people 92.3
furniture 91.2
chair 87.2
man 84.7
table 78.1
posing 39.9
restaurant 16.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-57
Gender Male, 88.7%
Sad 16.5%
Confused 6.2%
Calm 44.4%
Happy 4.5%
Angry 9.8%
Surprised 2.9%
Disgusted 15.8%

AWS Rekognition

Age 35-52
Gender Male, 95.2%
Angry 4.1%
Happy 0.7%
Sad 72%
Disgusted 3.5%
Confused 4.7%
Calm 14.1%
Surprised 1%

AWS Rekognition

Age 15-25
Gender Male, 81.3%
Sad 17.5%
Happy 1.4%
Angry 15.6%
Calm 40.5%
Surprised 7.8%
Disgusted 3.1%
Confused 14%

AWS Rekognition

Age 15-25
Gender Female, 53.9%
Surprised 45.1%
Happy 45.1%
Confused 45.2%
Angry 45.2%
Calm 46.6%
Sad 52.6%
Disgusted 45.1%

AWS Rekognition

Age 23-38
Gender Female, 50.8%
Angry 48.5%
Happy 45%
Sad 50.5%
Calm 45.5%
Disgusted 45.1%
Confused 45.2%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Female, 53.8%
Disgusted 45.1%
Sad 51.9%
Confused 45.1%
Calm 45.4%
Surprised 45.1%
Angry 45.3%
Happy 47.2%

AWS Rekognition

Age 35-55
Gender Male, 50.2%
Calm 45.9%
Sad 52.2%
Angry 45.6%
Surprised 45.2%
Happy 45.2%
Confused 45.2%
Disgusted 45.6%

AWS Rekognition

Age 27-44
Gender Female, 52.3%
Sad 50.7%
Angry 45.2%
Calm 47.2%
Happy 45.5%
Disgusted 45.2%
Confused 45.8%
Surprised 45.4%

AWS Rekognition

Age 26-43
Gender Female, 51.1%
Disgusted 45.4%
Angry 45.5%
Happy 45.7%
Surprised 45.3%
Calm 48.8%
Confused 45.2%
Sad 49.1%

AWS Rekognition

Age 14-25
Gender Male, 54.3%
Confused 45.4%
Angry 45.6%
Calm 51%
Happy 45.3%
Sad 47%
Disgusted 45.2%
Surprised 45.4%

AWS Rekognition

Age 23-38
Gender Female, 54.2%
Disgusted 45.2%
Angry 45.2%
Happy 46.2%
Confused 45.1%
Calm 49.7%
Sad 48.3%
Surprised 45.3%

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Chair 94.6%

Categories

Text analysis

Amazon

G95H

Google

R
R