Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.: The judge of the Republic seated at his official desk; the clerk of the court is seated at his side.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1251.2

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.: The judge of the Republic seated at his official desk; the clerk of the court is seated at his side.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1251.2

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 99.6
Person 99.6
Furniture 97.2
Person 97.1
Table 92.3
Desk 87.6
Worker 84.5
Wood 80.9
Indoors 75.1
Tie 72.6
Accessories 72.6
Accessory 72.6
Sitting 68.6
Plywood 67.4
Crowd 60.7
Office 59.8
Portrait 55.1
Photo 55.1
Face 55.1
Photography 55.1

Clarifai
created on 2019-06-07

people 99.8
adult 99
administration 98
furniture 97.6
group 96.9
room 96.8
desk 96.1
group together 96
woman 95.5
man 94.7
two 93.5
leader 93.1
three 91.2
war 89.2
home 88.3
education 88.2
wear 86.1
outfit 86
chair 84.7
four 84.6

Imagga
created on 2019-06-07

stringed instrument 100
musical instrument 82.3
device 50.2
office 37.6
laptop 34.7
business 34.6
person 34
computer 32.9
people 32.3
adult 30.6
work 29
man 28.2
sitting 27.5
working 27.4
businesswoman 26.4
male 24.8
businessman 24.7
happy 24.4
corporate 24.1
professional 22.3
attractive 21.7
job 21.2
desk 20
women 19.8
technology 19.3
executive 19.2
table 19.1
worker 18.9
smiling 18.8
communication 17.6
looking 17.6
indoors 17.6
lifestyle 17.3
smile 16.4
suit 16.2
businesspeople 16.1
pretty 16.1
portrait 15.5
cheerful 15.4
home 15.1
success 14.5
team 14.3
scholar 13.9
education 13.9
student 13.6
casual 13.6
notebook 13.2
meeting 12.2
manager 12.1
group 12.1
successful 11.9
colleagues 11.7
workplace 11.4
intellectual 11.1
happiness 11
handsome 10.7
face 10.7
modern 10.5
sit 10.4
room 10.2
teamwork 10.2
phone 10.1
human 9.7
black 9.6
men 9.4
mature 9.3
coffee 9.3
horizontal 9.2
school 9.1
blond 9
one 9
lady 8.9
interior 8.8
boss 8.6
talking 8.6
career 8.5
two 8.5
keyboard 8.4
senior 8.4
company 8.4
color 8.3
book 8.2
alone 8.2
indoor 8.2
brunette 7.8
couple 7.8
secretary 7.8
model 7.8
partner 7.7
serious 7.6
chair 7.6
contemporary 7.5
house 7.5
holding 7.4
occupation 7.3
20s 7.3
building 7.3
clothing 7.2
hair 7.1

Google
created on 2019-06-07

Photograph 96.2
Snapshot 84.1
Photography 62.4
Furniture 56.7
Sitting 54.1

Microsoft
created on 2019-06-07

sitting 97
person 93.6
clothing 93.4
laptop 91.8
indoor 91.4
window 82.1
furniture 77.1
working 62.6
man 58.4
table 55.2
desk 7.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 96.1%
Angry 7.5%
Calm 53.2%
Confused 8.8%
Disgusted 3.6%
Sad 11.2%
Surprised 6.9%
Happy 8.8%

AWS Rekognition

Age 35-52
Gender Male, 91.6%
Happy 1.8%
Angry 6.1%
Calm 30.3%
Confused 3.5%
Sad 54.8%
Disgusted 2.1%
Surprised 1.4%

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Tie 72.6%

Text analysis

Amazon

GDI4