Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: 5. Trustees of Baron de Hirsch Fund.: Emmanuel Marx
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3539.8

Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: 5. Trustees of Baron de Hirsch Fund.: Emmanuel Marx

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3539.8

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 98.4
Person 98.4
Overcoat 97.2
Clothing 97.2
Suit 97.2
Apparel 97.2
Coat 97.2
Face 80.7
Text 80.4
Mustache 76.7
Art 68
Man 67.2
Photo 65.9
Portrait 65.9
Photography 65.9
Accessory 65.1
Accessories 65.1
Tie 64.7

Clarifai
created on 2019-06-05

people 99.7
portrait 99.1
one 98.1
man 97.6
adult 96.6
leader 93.4
administration 91
print 89.9
art 89.3
wear 87.6
mustache 81.8
politician 81.4
engraving 80.7
famous 79.6
retro 79.2
vintage 78.9
antique 78.4
painting 73.9
bill 73.8
paper 73.6

Imagga
created on 2019-06-05

necktie 66.7
suit 63.5
man 63.3
businessman 56.6
male 54.8
bow tie 52.2
garment 45.7
person 44.4
portrait 43.5
tie 41.8
business 40.8
handsome 40.2
adult 35.7
executive 33.8
clothing 32.8
face 30.6
people 30.2
corporate 30.1
looking 28.9
professional 26.5
expression 26.5
manager 25.2
men 24.1
confident 23.7
success 23.4
mature 23.3
one 22.5
smiling 21.8
boss 21.1
office 20.9
smile 20.7
glasses 20.4
head 20.2
successful 20.2
black 19.9
guy 18.4
happy 18.2
senior 16.9
shirt 16.8
work 16.5
jacket 15.8
occupation 15.6
casual 15.3
studio 15.2
standing 13.9
old 13.3
beard 13
baron 13
friendly 12.8
human 12.8
gray 12.6
modern 11.9
collar 11.5
lawyer 11.5
serious 11.5
thinking 11.4
hand 11.4
job 10.6
cheerful 10.6
formal 10.5
eyes 10.4
hair 10.3
model 10.1
mustache 9.8
posing 9.8
close 9.7
worker 9.1
businessperson 8.8
40s 8.8
entrepreneur 8.6
smart 8.5
covering 8.5
dark 8.4
phone 8.3
fashion 8.3
consumer goods 8.3
alone 8.2
look 7.9
hands 7.8
bolo tie 7.8
pensive 7.8
sad 7.7
leader 7.7
attractive 7.7
money 7.7
confidence 7.7
only 7.7
career 7.6
cutout 7.4
director 7.4
judge 7.3
stylish 7.3
mug shot 7.2
happiness 7.1

Google
created on 2019-06-05

Photograph 96.8
Gentleman 88.3
Portrait 84
Moustache 74
Photography 62.4
Vintage clothing 57
Picture frame 51.3
Art 50.2

Microsoft
created on 2019-06-05

man 99.9
person 99.5
suit 98.8
text 98.5
human face 96.7
old 95.2
book 95
clothing 92.1
portrait 85.5
wearing 81.5
photograph 65
tie 64.3
posing 55.6
older 43.2
vintage 25.2
necktie 16.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 99.9%
Surprised 2.3%
Confused 12.2%
Happy 11.1%
Calm 56.6%
Disgusted 1.1%
Sad 10.2%
Angry 6.4%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Suit 97.2%
Tie 64.7%

Categories

Imagga

paintings art 70.7%
events parties 23.8%
people portraits 3.2%

Text analysis

Amazon

u
kay
u puves kay
puves