Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: 5. Trustees of Baron de Hirsch Fund.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3539

Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: 5. Trustees of Baron de Hirsch Fund.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Advertisement 98.9
Collage 98.9
Person 97.1
Human 97.1
Person 96.7
Person 93.9
Person 93.5
Person 93.4
Person 85.7
Bird 82.2
Animal 82.2
Flyer 81.1
Brochure 81.1
Paper 81.1
Person 77.9
Face 76.2
Text 72.4
Head 72.3
Word 70.7
Portrait 66.5
Photo 66.5
Photography 66.5
Poster 66.4
Person 60.8
Person 41.9

Clarifai
created on 2019-06-05

people 98.1
illustration 96.2
no person 95.7
woman 94.3
man 94.2
group 93.9
art 93.2
collection 93
museum 92.5
retro 92.3
painting 91.7
adult 91.6
image 91.1
set 89.7
one 89.6
two 88.3
indoors 86.7
picture frame 86.2
print 86.2
many 84.9

Imagga
created on 2019-06-05

buckle 25.5
stamp 23.8
paper 23.6
fastener 23.3
symbol 21.5
money 21.3
old 20.2
vintage 20.2
currency 19.7
dollar 18.6
card 18.2
house of cards 17.9
cash 17.4
restraint 17.3
retro 17.2
structure 16.5
collection 16.2
design 15.9
bookmark 15.5
finance 15.2
antique 14.7
text 14
device 13.7
grunge 13.6
business 13.4
bill 13.3
brown 13.2
texture 13.2
letter 12.8
bank 12.5
block 12
sign 12
banking 12
ingot 11.9
object 11.7
container 11.2
play 11.2
set 11
frame 10.8
black 10.8
wealth 10.8
die 10.7
letters 10.6
textured 10.5
success 10.5
word 10.4
amulet 10
box 10
aged 10
gold 9.9
cards 9.7
mail 9.6
exchange 9.6
post 9.5
ancient 9.5
book 9
postage 8.8
close 8.6
print 8.5
decoration 8.4
communication 8.4
investment 8.3
one 8.2
shaping tool 8.1
market 8
icon 7.9
collectible 7.9
postmark 7.9
color 7.8
ornament 7.8
hundred 7.8
gift 7.7
golden 7.7
dollars 7.7
mark 7.7
obsolete 7.7
international 7.6
grungy 7.6
page 7.4
package 7.4
square 7.2
dirty 7.2
charm 7.1
game 7.1
hand 7
envelope 7
wooden 7

Google
created on 2019-06-05

Collection 55.6
Games 52.1

Microsoft
created on 2019-06-05

gallery 96.9
human face 94.7
person 92.7
man 87.6
different 86.5
book 79.6
various 72.2
clothing 70.3
picture frame 68.4
bunch 55
several 38.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-53
Gender Male, 54.9%
Sad 45.4%
Disgusted 45.2%
Calm 53.6%
Angry 45.2%
Surprised 45.2%
Confused 45.3%
Happy 45.1%

AWS Rekognition

Age 48-68
Gender Male, 99.7%
Calm 98.9%
Surprised 0.1%
Disgusted 0%
Angry 0.2%
Happy 0.1%
Sad 0.3%
Confused 0.4%

AWS Rekognition

Age 48-68
Gender Male, 54.9%
Calm 47.3%
Surprised 45.4%
Disgusted 45.3%
Confused 45.7%
Happy 47.6%
Angry 46.7%
Sad 47.1%

AWS Rekognition

Age 48-68
Gender Male, 55%
Calm 50.3%
Disgusted 45.2%
Angry 45.5%
Surprised 45.2%
Happy 47.8%
Sad 45.3%
Confused 45.6%

AWS Rekognition

Age 48-68
Gender Male, 54.7%
Confused 45.1%
Sad 45.3%
Surprised 45%
Disgusted 45%
Calm 54.5%
Happy 45%
Angry 45.1%

AWS Rekognition

Age 57-77
Gender Male, 54.9%
Disgusted 45.1%
Confused 45.3%
Calm 48.5%
Angry 50.5%
Happy 45.2%
Sad 45.3%
Surprised 45.1%

AWS Rekognition

Age 48-68
Gender Male, 55%
Disgusted 45%
Angry 45.1%
Happy 45.1%
Surprised 45%
Confused 45.2%
Calm 54.5%
Sad 45.2%

AWS Rekognition

Age 48-68
Gender Male, 54.7%
Surprised 45.1%
Sad 51%
Happy 45.1%
Confused 45.1%
Calm 47.2%
Angry 46.5%
Disgusted 45.1%

AWS Rekognition

Age 30-47
Gender Male, 53.7%
Angry 48.5%
Happy 45.8%
Sad 48%
Confused 45.3%
Disgusted 45.8%
Calm 46.3%
Surprised 45.3%

AWS Rekognition

Age 35-53
Gender Male, 55%
Sad 45.9%
Disgusted 45%
Confused 45.5%
Happy 45.1%
Calm 53.1%
Surprised 45.1%
Angry 45.3%

Microsoft Cognitive Services

Age 67
Gender Male

Microsoft Cognitive Services

Age 63
Gender Male

Microsoft Cognitive Services

Age 60
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.1%
Bird 82.2%
Poster 66.4%

Captions

Microsoft

a bunch of different books 28.3%
a bunch of different items that are on display 28.2%

Text analysis

Amazon

de
FUND.
BARDY de HIRSC FUND.
BARDY
TRIEE
HIRSC
4
5.
se
einees

Google

TRYTEE
diendall
de
HIRCH
FUND
TRYTEE 5 diendall BARDN de HIRCH FUND
5
BARDN