Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J., Baron de Hirsch Fund.: 13. A Group of Newly Arrived Immigrants from Kishineff, Russia.
Date

c. 1901
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.136.1

Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J., Baron de Hirsch Fund.: 13. A Group of Newly Arrived Immigrants from Kishineff, Russia.

People

Artist: Unidentified Artist,

Date

c. 1901

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.136.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 99.1
Human 99.1
Person 98.4
Person 98.1
Person 98
Person 97.5
Person 96.4
Advertisement 91.3
Poster 91.3
Person 81.1
Text 60.4
Fireman 59.3

Clarifai
created on 2019-06-05

people 99.3
adult 97.7
man 96.1
woman 95.1
group 92.9
indoors 92.7
wear 91.4
room 89.9
child 89
furniture 88.6
painting 87.1
print 86.2
many 85.1
portrait 85.1
military 85
family 84.8
one 83.4
war 83
no person 82
leader 81.1

Imagga
created on 2019-06-05

brass 49.7
blackboard 47.2
memorial 45.8
structure 38.3
vintage 33.1
old 30
chalkboard 25.5
retro 25.4
grunge 22.1
board 21
texture 20.8
letter 20.2
message 20.1
aged 19.9
chalk 19.5
billboard 19.4
antique 19
black 18
text 17.5
ancient 17.3
frame 16.9
paper 16.5
note 15.6
envelope 14.9
circa 14.8
education 14.7
stamp 14.6
business 14.6
art 14.1
postmark 13.8
postage 13.8
book jacket 13.7
blank 13.7
mail 13.4
design 12.9
symbol 12.8
postal 12.8
classroom 12.7
dirty 12.6
school 12.6
space 12.4
money 11.9
signboard 11.8
border 11.8
jacket 11.7
financial 11.6
damaged 11.4
learn 11.3
card 11.1
cash 11
finance 11
paint 10.9
printed 10.8
material 10.7
bill 10.5
film 10.3
banking 10.1
global 10
currency 9.9
worn 9.5
icon 9.5
college 9.5
graphic 9.5
writing 9.4
university 9.2
drawing 9
sign 9
one 9
philately 8.9
shows 8.9
decoration 8.8
closeup 8.8
your 8.7
class 8.7
empty 8.6
post 8.6
word 8.5
savings 8.4
dollar 8.4
wrapping 8.1
bank 8.1
book 8
address 7.8
states 7.7
wall 7.7
grungy 7.6
man 7.6
communication 7.6
pattern 7.5
study 7.5
close 7.4
rough 7.3
office 7.2
wealth 7.2

Google
created on 2019-06-05

Photograph 94.8
Text 86.9
Snapshot 84.7
Picture frame 74.7
Room 74.4
Photography 62.4
Family 51
Art 50.2

Microsoft
created on 2019-06-05

clothing 97.6
person 95.2
smile 81.2
picture frame 76.8
human face 74.3
man 70.1
handwriting 60
different 50.5
posing 41.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 26-43
Gender Male, 54.7%
Sad 45.1%
Angry 45.2%
Confused 45.1%
Happy 45.1%
Disgusted 45.5%
Surprised 45.2%
Calm 53.6%

AWS Rekognition

Age 26-43
Gender Male, 50.7%
Happy 45.1%
Angry 45.5%
Calm 53.4%
Sad 45.3%
Surprised 45.4%
Confused 45.2%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Male, 52.9%
Sad 46.5%
Calm 52.1%
Angry 45.6%
Disgusted 45.2%
Surprised 45.2%
Confused 45.3%
Happy 45.1%

AWS Rekognition

Age 60-90
Gender Male, 54.5%
Sad 45.3%
Angry 45.5%
Calm 47.1%
Confused 45.3%
Happy 46.9%
Disgusted 48.7%
Surprised 46.2%

AWS Rekognition

Age 20-38
Gender Female, 50.9%
Angry 45.9%
Calm 46.5%
Confused 45.2%
Happy 45.1%
Sad 52%
Disgusted 45.3%
Surprised 45.1%

AWS Rekognition

Age 48-68
Gender Female, 50.4%
Surprised 45.1%
Happy 45%
Calm 45.5%
Disgusted 54.1%
Confused 45.1%
Sad 45%
Angry 45.2%

AWS Rekognition

Age 26-43
Gender Female, 53%
Angry 46.9%
Sad 47.1%
Surprised 45.4%
Confused 45.4%
Disgusted 45.5%
Calm 49.5%
Happy 45.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Poster 91.3%

Categories

Imagga

streetview architecture 64%
paintings art 31.7%
text visuals 3.7%

Text analysis

Amazon

e
H
From
Newly
sedlimeny
13.
Baon
Prrived
Wovdbire
Fund
Hhrsch e Baon Fund
Ressia.
From Kishinerf, Ressia.
IDigrayts
13. PGrocyp oR Newly Prrived IDigrayts
Kishinerf,
wndbre
Hhrsch
Wovdbire sedlimeny Scrrl wndbre t
PGrocyp
H n. 69.5.7 Ra
69.5.7
n.
Scrrl
Ra
t
oR

Google

13. AGrap oNewly Aerived Impigrayts rom Kishineys, Rssia. Wordbue Sedlinent Barn de Hrsh Fand H R . 69. S.7
13.
AGrap
oNewly
Aerived
Impigrayts
rom
Kishineys,
Rssia.
Wordbue
Sedlinent
Barn
de
Hrsh
Fand
H
R
.
69.
S.7