Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: 5. Trustees of Baron de Hirsch Fund.: Mayer Sulzberger
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3539.3

Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: 5. Trustees of Baron de Hirsch Fund.: Mayer Sulzberger

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3539.3

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 96.8
Human 96.8
Art 94.1
Painting 90.1
Clothing 55.8
Apparel 55.8

Clarifai
created on 2019-06-05

people 99.8
portrait 98.9
one 97.8
leader 97.4
art 97.1
print 96.4
wear 96.2
adult 95.8
antique 95.4
administration 94.9
man 94.4
old 93.8
paper 93.6
vintage 91.6
retro 90.4
painting 90.4
politician 88.6
illustration 88
poet 85.9
writer 85.5

Imagga
created on 2019-06-05

ruler 100
statue 27
sculpture 26.7
religion 24.2
ancient 21.6
money 20.4
art 19.2
old 18.8
culture 18.8
currency 17.9
dollar 17.6
history 17
man 16.8
business 16.4
stone 16.1
religious 15.9
male 15.6
cash 15.6
god 15.3
one 14.9
temple 14.4
close 14.3
portrait 13.6
finance 13.5
face 12.8
architecture 12.7
carving 12.4
people 12.3
historical 12.2
historic 11.9
wealth 11.7
bank 11.6
success 11.3
antique 11.3
savings 11.2
banking 11
paper 11
black 10.8
vintage 10.8
holy 10.6
spiritual 10.6
person 10.4
church 10.2
symbol 10.1
travel 9.9
human 9.8
marble 9.7
dollars 9.7
us 9.6
spirituality 9.6
loan 9.6
bill 9.5
monument 9.3
figure 9.3
suit 8.9
banknote 8.7
hundred 8.7
head 8.4
closeup 8.1
financial 8
museum 7.8
prayer 7.7
pay 7.7
dark 7.5
famous 7.4
rich 7.4
smile 7.1
businessman 7.1

Google
created on 2019-06-05

Photograph 96.2
Photography 62.4
Art 58.1
Portrait 56.7

Microsoft
created on 2019-06-05

person 98.7
painting 96.1
man 93.9
human face 93.8
text 91.7
clothing 91
posing 72.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 96.7%
Angry 18.4%
Happy 1.2%
Surprised 3.5%
Disgusted 4.2%
Sad 3.5%
Confused 6.2%
Calm 63.1%

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.8%

Categories

Imagga

paintings art 86.9%
people portraits 5%
events parties 2.7%
pets animals 1.6%
interior objects 1.4%

Captions

Microsoft
created on 2019-06-05

a person posing for the camera 93.1%
a black and white photo of a man 79.8%
a man posing for a photo 79.7%

Text analysis

Amazon

mayer
berg
Jakr
mayer Jakr berg c
rd
c

Google

VIy
VIy