Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Exhibit I.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3538

Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Exhibit I.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3538

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 98.4
Person 98.4
Person 88.1
Mustache 83
Text 81.4
Face 76.4
Photo Booth 55.1

Clarifai
created on 2019-06-05

people 99.8
portrait 98.5
chalkboard 97.8
physics 96.9
man 96.5
adult 96.5
classroom 96.4
education 95.7
teacher 95.3
school 94.8
one 94.7
illustration 93.7
genius 93.5
professor 93.2
art 91.8
chalk 91.5
display 91
mustache 90.4
mathematics 88.7
invention 87.4

Imagga
created on 2019-06-05

phonograph record 100
blackboard 26.3
money 23
currency 21.5
book jacket 19.8
financial 19.6
dollar 19.5
cash 19.2
business 17.6
finance 16.9
black 16.8
bill 16.2
jacket 15.4
person 15.2
man 14.8
wealth 14.4
dark 14.2
banking 13.8
adult 13.6
people 13.4
dollars 12.6
exchange 12.4
male 12.1
wrapping 11.7
bank 11.6
vintage 11.6
retro 11.5
close 11.4
paper 11
banknote 10.7
one 10.5
face 9.9
portrait 9.7
stamp 9.7
mail 9.6
old 9.1
fashion 9
postmark 8.9
states 8.7
art 8.6
grunge 8.5
economy 8.3
symbol 8.1
success 8
light 8
market 8
covering 7.9
hundred 7.7
finances 7.7
post 7.6
united 7.6
savings 7.5
rich 7.4
style 7.4
letter 7.3
design 7.3

Google
created on 2019-06-05

Forehead 78.2
History 54.1
Portrait 53.5

Microsoft
created on 2019-06-05

human face 98.3
text 98.2
person 93.1
book 91.9
handwriting 84
man 81.4
clothing 76.5
old 66.2
posing 63.7
portrait 63.7
vintage 44.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 97.3%
Angry 4.5%
Happy 5.6%
Sad 29.6%
Confused 9.9%
Disgusted 1.1%
Calm 43.4%
Surprised 5.8%

AWS Rekognition

Age 26-43
Gender Female, 98.6%
Angry 2.4%
Sad 6.4%
Disgusted 1%
Calm 83.4%
Confused 3.1%
Surprised 2.3%
Happy 1.4%

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 34
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%

Text analysis

Amazon

I
de
CXHIBIT I
BIRONE
4
GEREUTH
CXHIBIT
BIRONE CHRHDE hRlde GEREUTH
3.
BRRON MIFURO de HIR
hRlde
BRRON
MIFURO
HIR
CHRHDE

Google

EXHIBIT I BRIN MTURKE de IRn 24
EXHIBIT
I
BRIN
MTURKE
de
IRn
24