Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: 5. Trustees of Baron de Hirsch Fund.: M.S. Isaacs
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3539.6

Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: 5. Trustees of Baron de Hirsch Fund.: M.S. Isaacs

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Face 99.4
Human 99.4
Person 96
Text 82.4
Beard 80
Mustache 73.4
Photo 68.7
Portrait 68.7
Photography 68.7
Art 63
Head 62.2
Painting 60.8
Overcoat 56.8
Apparel 56.8
Clothing 56.8
Suit 56.8
Coat 56.8

Clarifai
created on 2019-06-05

people 99.3
portrait 98.8
man 98.4
adult 97.2
one 95.8
art 94.3
vintage 92.2
old 91.8
wear 91.1
antique 90.4
person 90.2
famous 89.7
mustache 88.9
facial hair 88.7
beard 87.9
retro 87.9
print 86.3
painting 85.6
leader 85.4
illustration 84.5

Imagga
created on 2019-06-05

man 40.3
portrait 40.1
male 38.3
mustache 36.4
face 36.2
person 31
black 27.7
people 27.3
model 24.1
adult 23.3
mug shot 23
beard 20.6
expression 20.5
head 20.2
eyes 19.8
fashion 19.6
attractive 19.6
serious 19.1
photograph 17.8
look 17.5
guy 17.4
close 17.1
handsome 16.9
hair 16.7
one 16.4
sexy 16.1
human 15
casual 14.4
representation 13.7
looking 13.6
dark 12.5
men 12
style 11.1
lifestyle 10.8
smile 10.7
lady 10.6
clothing 10.4
suit 10.1
call 10.1
alone 10
happy 10
confident 10
studio 9.9
eye 9.8
business 9.7
businessman 9.7
smiling 9.4
creation 9.2
old 9.1
masculine 8.8
closeup 8.8
brunette 8.7
boy 8.7
shirt 8.7
device 8.5
senior 8.4
make 8.2
jacket 8.1
posing 8
body 8
cute 7.9
elegant 7.7
youth 7.7
hand 7.6
gorgeous 7.3
office 7.2
pretty 7

Google
created on 2019-06-05

Photograph 95.5
Facial hair 95.1
Moustache 91.7
Gentleman 87.6
Beard 87.1
Portrait 86.3
Self-portrait 74.4
Art 73.1

Microsoft
created on 2019-06-05

man 99.2
human face 97.6
painting 93.7
person 91.2
clothing 89.9
drawing 87.6
portrait 87.5
indoor 86.3
sketch 72.7
human beard 55

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-69
Gender Male, 99.9%
Calm 69.7%
Surprised 1%
Disgusted 0.8%
Angry 9.1%
Happy 4.9%
Sad 7.6%
Confused 6.9%

Microsoft Cognitive Services

Age 63
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96%
Painting 60.8%

Captions

Microsoft

a man wearing a suit and tie 89.7%
a man wearing a suit and tie looking at the camera 83.4%
a man in a suit and tie 83.3%