Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Exhibit I.: Baroness Clara de Hirsch de Gereuth. 4.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3538.2

Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Exhibit I.: Baroness Clara de Hirsch de Gereuth. 4.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Art 91.7
Person 82.5
Human 82.5
Face 76
Painting 75.9
Photography 67.8
Portrait 67.8
Photo 67.8
Text 60.7

Clarifai
created on 2019-06-05

people 100
one 99.8
adult 99.8
portrait 99.7
print 99.2
art 98.8
woman 97.3
engraving 96
wear 93.6
illustration 92.8
music 92.6
painting 90.7
leader 90.6
man 90.5
veil 88.3
monarch 84.9
wig 84.4
scientist 81.9
science 80.8
side view 80.4

Imagga
created on 2019-06-05

portrait 42
phonograph record 36.3
black 31.8
face 30.5
attractive 26.6
person 26.2
adult 24.6
fashion 24.1
model 23.3
sexy 23.3
head 21.8
hair 21.4
people 21.2
pretty 19.6
studio 18.2
eyes 18.1
look 16.6
close 16.5
smile 16.4
hat 16.1
cute 15.8
brunette 15.7
lady 15.4
expression 15.3
dark 15
lips 14.8
man 14.8
make 14.5
male 14.2
casual 12.7
one 12.7
currency 12.6
happy 12.5
skin 11.7
eye 11.6
lifestyle 11.6
closeup 11.4
human 11.2
style 11.1
makeup 11
sensual 10.9
lovely 10.7
business 10.3
money 10.2
dollar 10.2
dress 9.9
posing 9.8
looking 9.6
serious 9.5
elegant 9.4
lamp 9.4
cash 9.1
gorgeous 9.1
art 8.8
banknote 8.7
bill 8.6
culture 8.5
youth 8.5
spotlight 8.5
mouth 8.5
banking 8.3
gong 8.1
smiling 8
finance 7.6
hand 7.6
teenager 7.3
sensuality 7.3
percussion instrument 7.3
financial 7.1
women 7.1
source of illumination 7.1

Google
created on 2019-06-05

Portrait 85.6
Lady 85.5
Forehead 78.2
Vintage clothing 67.8
Self-portrait 52.8
Oval 51.4

Microsoft
created on 2019-06-05

human face 98.2
painting 95.9
person 93.3
drawing 92.7
portrait 89.2
sketch 83.5
woman 82.6
black 72.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Female, 95.1%
Confused 4.9%
Sad 6.4%
Surprised 3.4%
Disgusted 1.5%
Calm 79.3%
Happy 1.4%
Angry 3.1%

Microsoft Cognitive Services

Age 33
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 82.5%
Painting 75.9%

Captions

Microsoft

a black and white photo of a woman 66.4%
a woman in a black shirt 66.3%
a close up of a woman 66.2%