Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: 5. Trustees of Baron de Hirsch Fund.: Emanuel Lehman
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3539.2

Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: 5. Trustees of Baron de Hirsch Fund.: Emanuel Lehman

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 96.9
Face 96.9
Person 96.4
Head 93.5
Art 93.2
Painting 89.7
Photography 76.1
Photo 76.1
Portrait 76.1
Text 67.3
Overcoat 62.1
Suit 62.1
Clothing 62.1
Apparel 62.1
Coat 62.1
Wood 58.5
Drawing 55.5

Clarifai
created on 2019-06-05

people 99.9
portrait 99.6
print 98.6
adult 98.2
one 98.2
engraving 97.9
man 97.5
mustache 97
art 96.9
leader 95.8
politician 94.4
facial hair 93.9
scientist 92.2
illustration 91.9
administration 90.5
wear 90.3
writer 89.4
old 87.4
painting 86.1
vintage 85.8

Imagga
created on 2019-06-05

mug shot 94.8
photograph 73.6
man 57.2
representation 56.5
male 49
portrait 42.8
creation 37.6
person 34.7
handsome 32.1
face 32
businessman 30
adult 28.5
people 27.9
suit 26.6
business 26.1
expression 24.8
one 24.7
mature 22.3
guy 22.2
looking 21.6
executive 19.5
black 19.3
corporate 18.9
professional 18.7
head 18.5
confident 18.2
eyes 18.1
men 18.1
tie 18
senior 17.8
casual 17.8
serious 17.2
close 17.1
human 16.5
happy 16.3
beard 16
glasses 15.8
jacket 15.4
office 15.3
necktie 15.2
hair 15.1
smile 14.3
bow tie 14
manager 14
smiling 13.8
old 13.3
look 13.2
success 12.9
attractive 12.6
clothing 12.6
work 12.6
boss 12.4
shirt 12.3
studio 12.2
dark 11.7
hand 11.4
money 11.1
gray 10.8
spectacles 10.5
model 10.1
job 9.7
mustache 9.2
emotion 9.2
alone 9.1
hands 8.7
sad 8.7
age 8.6
occupation 8.3
successful 8.2
friendly 8.2
cheerful 8.1
currency 8.1
worker 8
grandfather 8
stare 7.8
confidence 7.7
elderly 7.7
stress 7.7
garment 7.5
closeup 7.4
optical instrument 7.2
financial 7.1
working 7.1
happiness 7.1
modern 7

Google
created on 2019-06-05

Photograph 95.5
Portrait 91.1
Gentleman 85.7
Art 77.7
Self-portrait 77.3
Jaw 71.8
Illustration 66.9
Painting 63.8
Photography 62.4
Moustache 60.1
Visual arts 55
Drawing 51.1

Microsoft
created on 2019-06-05

human face 97.6
text 97.4
person 96.1
man 95.8
clothing 91.8
portrait 85.6
suit 77.6
wearing 77
painting 71.2
drawing 55.8
old 55.5
tie 50.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 99.8%
Surprised 0.7%
Disgusted 0.7%
Sad 3.1%
Calm 87.4%
Happy 1.5%
Confused 5%
Angry 1.7%

Microsoft Cognitive Services

Age 59
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.4%
Suit 62.1%

Captions

Microsoft

a man wearing a suit and tie 95.3%
an old photo of a man wearing a suit and tie 93.2%
old photo of a man wearing a suit and tie 90.9%

Text analysis

Amazon

mas
Manne mas
Manne