Human Generated Data

Title

Untitled (bust length portrait of clean shaven man labeled John Webster Knowles)
Date

1886-1887
People

Artist: Pach Brothers, American 1867-1947
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3973

Human Generated Data

Title

Untitled (bust length portrait of clean shaven man labeled John Webster Knowles)

People

Artist: Pach Brothers, American 1867-1947

Date

1886-1887

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3973

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Clothing 99.1
Apparel 99.1
Person 97.3
Human 97.3
Face 90.9
Shirt 90.1
Man 69.9
Portrait 68.5
Photo 68.5
Photography 68.5
Sleeve 65.4
Canvas 61.8
Art 59.3
Head 57.8
Home Decor 57.6

Clarifai
created on 2019-11-10

people 98
paper 95.5
retro 95.5
one 93.7
man 93.5
portrait 91.6
wear 90.2
blank 88.7
art 87.9
desktop 85.4
adult 83.5
empty 80.5
vintage 74.6
picture frame 71.7
bill 70.5
antique 68.5
old 66.9
music 64.1
square 61.4
facial expression 60.8

Imagga
created on 2019-11-10

bow tie 100
necktie 100
garment 79.2
clothing 45
portrait 37.6
person 33.8
man 30.3
adult 29.8
model 29.6
people 29
suit 27.9
male 27.7
black 26.5
face 25.6
studio 25.1
sexy 24.1
fashion 23.4
hair 23
cute 23
attractive 22.4
human 21.8
smile 20.7
looking 19.2
handsome 18.7
businessman 17.7
business 17.6
pretty 16.8
boy 16.5
happy 16.3
elegant 16.3
tie 16.1
one 15.7
confident 15.5
hand 15.2
style 14.8
smiling 14.5
skin 14.4
posing 14.2
sensual 13.7
lady 13
success 12.9
guy 12.9
expression 12.8
make 12.7
dress 12.7
look 12.3
shirt 12.2
body 12
elegance 11.8
hairstyle 11.4
eyes 11.2
youth 11.1
professional 11
sensuality 10.9
child 10.8
cheerful 10.6
men 10.3
casual 10.2
head 10.1
alone 10.1
stylish 10
blond 9.9
brunette 9.6
kid 8.9
standing 8.7
happiness 8.6
corporate 8.6
serious 8.6
close 8.6
bow 8.5
charming 8.5
lips 8.3
holding 8.3
successful 8.2
women 7.9
hands 7.8
modern 7.7
seductive 7.7
dark 7.5
positive 7.4
executive 7.4
makeup 7.3
businesswoman 7.3
gorgeous 7.3
color 7.2
lifestyle 7.2
lovely 7.1
love 7.1
little 7.1
work 7.1

Google
created on 2019-11-10

Photograph 96.7
Gentleman 85.5
Forehead 84.6
Chin 82.8
Portrait 72.6
Photography 62.4
Art 50.2

Microsoft
created on 2019-11-10

text 99.4
human face 97.9
person 96.3
clothing 94.4
portrait 90.2
man 87.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-31
Gender Male, 95.8%
Happy 0%
Disgusted 0%
Sad 0.5%
Calm 99%
Surprised 0%
Fear 0%
Confused 0.1%
Angry 0.3%

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.3%

Categories

Imagga

people portraits 99.5%

Captions

Microsoft
created on 2019-11-10

a person posing for the camera 89.9%
a man posing for the camera 75.9%
a man posing for a picture 75.6%

Text analysis

Amazon

CAMBRIDGE
PACH
PACH BRo's
CAMBRIDGE Mass.
BRo's
Mass.

Google

CAMBRIDGE. MASS PACH BRO'S
CAMBRIDGE.
MASS
PACH
BRO'S