Human Generated Data

Title

George Perkins Knapp (d. 1915)

Date

1886-1887

People

Artist: Pach Brothers, American 1867-1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3970

Human Generated Data

Title

George Perkins Knapp (d. 1915)

People

Artist: Pach Brothers, American 1867-1947

Date

1886-1887

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3970

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Human 99.2
Face 99.2
Accessories 98.6
Tie 98.6
Accessory 98.6
Person 97.1
Canvas 95.6
Drawing 88.9
Art 88.9
Apparel 88.1
Clothing 88.1
Portrait 78
Photography 78
Photo 78
Man 68.9
Text 65.8
Female 62.8
Shirt 60.5
Sketch 59
Smile 57.5

Clarifai
created on 2019-11-10

people 98.4
one 94.8
portrait 93.7
paper 92.7
retro 92.3
man 91.9
art 91.5
adult 90.3
wear 89.2
blank 85.3
woman 79.7
monochrome 79.1
empty 78.8
desktop 77.7
vintage 74.4
bill 73.2
facial expression 72.7
picture frame 72
illustration 69.1
nostalgia 66.2

Imagga
created on 2019-11-10

bow tie 100
necktie 100
garment 79.2
clothing 46.9
portrait 38.2
adult 33.7
face 31.3
person 30.8
fashion 27.2
male 27
suit 25.2
attractive 25.2
model 24.1
black 24.1
people 24
hair 23.8
cute 23.7
man 23.5
looking 23.2
smile 21.4
businessman 20.3
studio 19.8
human 19.5
sexy 19.3
business 17.6
pretty 17.5
posing 16
elegant 15.4
expression 15.4
one 14.9
boy 14.8
smiling 14.5
handsome 14.3
happy 13.8
eyes 13.8
style 13.4
cheerful 13
make 12.7
child 12.5
kid 12.4
tie 12.3
charming 12.3
look 12.3
hand 12.2
executive 12
guy 12
youth 11.9
dress 11.8
alone 11
sensuality 10.9
pose 10.9
blond 10.8
serious 10.5
success 10.5
brunette 10.5
shirt 10.3
love 10.3
happiness 10.2
lifestyle 10.1
head 10.1
confident 10
sensual 10
lady 9.7
little 9.7
women 9.5
boss 8.6
corporate 8.6
hairstyle 8.6
close 8.6
casual 8.5
skin 8.5
professional 8.4
elegance 8.4
holding 8.3
fun 8.2
stylish 8.1
lovely 8
standing 7.8
facial 7.7
seductive 7.7
healthy 7.6
cosmetics 7.5
vintage 7.5
phone 7.4
nice 7.3
successful 7.3
body 7.2
eye 7.2
work 7.1

Google
created on 2019-11-10

Microsoft
created on 2019-11-10

text 98.9
man 97.4
human face 93.7
person 93.5
clothing 87.4
portrait 84.5
necktie 18

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-47
Gender Male, 74.2%
Confused 0.1%
Fear 0%
Happy 0.1%
Disgusted 0.1%
Surprised 0.1%
Sad 0.2%
Angry 0%
Calm 99.4%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 98.6%
Person 97.1%

Categories

Imagga

paintings art 79%
people portraits 19.8%

Captions

Text analysis

Amazon

841
Bro's,
B'WAY,
PACH Bro's,
PACH
841 B'WAY, N. Y.
N. Y.

Google

841 B'wAY, N. Y PACH BRO'S
841
B'wAY,
N.
Y
PACH
BRO'S