Human Generated Data

Title

Henry Schofield (1866-1918)
Date

1886-1887
People

Artist: Pach Brothers, American 1867-1947
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.4026

Human Generated Data

Title

Henry Schofield (1866-1918)

People

Artist: Pach Brothers, American 1867-1947

Date

1886-1887

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Clothing 98.3
Apparel 98.3
Accessories 98
Accessory 98
Tie 98
Human 97.6
Person 97.6
Face 95.7
Shirt 94.6
Art 76.8
Overcoat 72.7
Suit 72.7
Coat 72.7
Portrait 70.1
Photography 70.1
Photo 70.1
Drawing 65
Dress Shirt 60.6
Man 58.2
Advertisement 56.9

Clarifai
created on 2019-11-10

people 98.1
man 96.6
paper 96.4
blank 95.7
retro 95
portrait 94.5
art 93.3
one 93.3
wear 90.5
desktop 90.2
adult 89.5
empty 86.4
bill 85.5
picture frame 85.4
business 81.3
facial expression 78.4
note 78.1
vintage 76.7
card 75
head 74.2

Imagga
created on 2019-11-10

bow tie 100
necktie 100
garment 78.2
clothing 41.1
portrait 35.6
person 35.1
model 35
adult 35
face 31.3
attractive 30.1
man 27.6
black 25.9
hair 25.4
people 25.1
sexy 24.9
fashion 24.9
looking 24.8
male 24.1
human 22.5
cute 21.6
make 20.9
elegant 19.7
expression 19.6
pretty 19.6
posing 19.6
studio 17.5
sensual 17.3
hairstyle 17.2
smile 17.1
skin 16.9
look 16.7
style 16.3
lady 16.2
brunette 15.7
suit 15.3
head 15.1
one 14.9
body 14.4
handsome 14.3
business 13.4
lips 13
eyes 12.9
guy 12.9
lovely 12.5
charming 12.3
elegance 11.8
blond 11.7
businessman 11.5
serious 11.5
hand 11.4
boy 11.3
sensuality 10.9
success 10.5
women 10.3
close 10.3
youth 10.2
casual 10.2
smiling 10.1
lifestyle 10.1
healthy 10.1
stylish 10
vintage 9.9
eye 9.8
happiness 9.4
happy 9.4
cosmetics 9.4
professional 9.3
makeup 9.2
closeup 8.8
sad 8.7
seductive 8.6
luxury 8.6
emotion 8.3
holding 8.3
nice 8.3
confident 8.2
gorgeous 8.2
love 7.9
hands 7.8
expressive 7.8
modern 7.7
thinking 7.6
tie 7.6
erotic 7.6
dark 7.5
retro 7.4
executive 7.4
slim 7.4
cheerful 7.3
kid 7.1

Google
created on 2019-11-10

Photograph 95.8
Head 88.4
Chin 82.8
Forehead 82.2
Portrait 79.2
Gentleman 70.1
Art 65.5
Photography 62.4
Jaw 57.4
Illustration 54.5

Microsoft
created on 2019-11-10

human face 98.4
text 97.7
person 97.5
clothing 96
man 95.3
portrait 90.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-31
Gender Male, 99.4%
Fear 0%
Happy 0.1%
Confused 0.4%
Surprised 0%
Calm 98.7%
Sad 0.4%
Angry 0.2%
Disgusted 0.1%

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 98%
Person 97.6%

Captions

Microsoft

a close up of a person 59.4%
a person in a black shirt 38.6%
a person taking a selfie 30.7%

Text analysis

Amazon

841
B'WAY,
PACH
841 B'WAY, N.Y.
PACH BRo's,
BRo's,
N.Y.

Google

841 B'WAY, N. Y PACH BRO'S
841
B'WAY,
N.
Y
PACH
BRO'S