Human Generated Data

Title

Untitled (bust length portrait of man with moustache, labeled Harry Ernest Peabody)
Date

1886-1887
People

Artist: Pach Brothers, American 1867-1947
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3984

Human Generated Data

Title

Untitled (bust length portrait of man with moustache, labeled Harry Ernest Peabody)

People

Artist: Pach Brothers, American 1867-1947

Date

1886-1887

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3984

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Tie 99.3
Accessories 99.3
Accessory 99.3
Human 98
Person 98
Apparel 97.7
Clothing 97.7
Face 97.3
Shirt 91.9
Mustache 78.1
Photography 75.9
Photo 75.9
Portrait 75.9
Text 62.2
Man 60.5
Art 60.3
Head 59
Dress Shirt 55.8

Clarifai
created on 2019-11-10

people 97.4
one 96.5
man 95.5
blank 94.7
portrait 94.3
paper 93.4
retro 88.8
business 88.5
wear 87.4
adult 87.4
empty 86.8
desktop 83.8
bill 75
art 74.9
tie 71.7
facial expression 70.9
note 69.5
picture frame 68.4
card 67.2
music 66.5

Imagga
created on 2019-11-10

bow tie 100
necktie 100
garment 79.3
man 47.1
clothing 46.9
male 42.6
businessman 41.6
suit 41.5
portrait 36.3
person 36.1
adult 35.6
handsome 33
business 30.4
face 26.3
people 25.7
professional 24.5
black 22.3
studio 22.1
tie 21.9
looking 20.8
shirt 20.6
human 19.5
model 19.5
executive 19.4
success 19.3
guy 19.3
one 17.9
smile 17.8
manager 17.7
successful 17.4
fashion 16.6
confident 16.4
corporate 16.3
happy 16.3
attractive 16.1
standing 15.7
expression 15.4
lifestyle 15.2
smiling 14.5
cute 14.4
work 14.1
serious 13.4
alone 12.8
stylish 12.7
boss 12.5
boy 12.2
hand 12.2
sexy 12.1
men 12
hair 11.9
cheerful 11.4
career 11.4
youth 11.1
happiness 11
posing 10.7
jacket 10.6
thinking 10.5
office 10.5
businesspeople 10.5
style 10.4
one person 10.4
elegant 10.3
job 9.7
casual 9.3
occupation 9.2
charming 8.5
child 8.3
20s 8.3
businesswoman 8.2
dress 8.1
worker 8
kid 8
indoors 7.9
look 7.9
vertical 7.9
lawyer 7.9
color 7.8
entrepreneur 7.8
eyes 7.8
formal 7.6
only 7.6
smart 7.5
single 7.4
phone 7.4
pose 7.3
modern 7

Google
created on 2019-11-10

Photograph 95.1
Gentleman 85.4
Chin 85
Forehead 78.2
Portrait 71.8
Photography 62.4
Neck 59.9
Illustration 50.4
Art 50.2

Microsoft
created on 2019-11-10

text 98.6
human face 95.8
man 95.8
clothing 93
portrait 88.7
person 87.2
suit 86.5
tie 79.8
gentleman 53.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 98.7%
Happy 0%
Confused 0.1%
Surprised 0.2%
Angry 0.1%
Calm 99.5%
Fear 0%
Disgusted 0%
Sad 0.1%

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.3%
Person 98%

Categories

Imagga

people portraits 96.5%
events parties 3.5%

Captions

Microsoft
created on 2019-11-10

a man in a white shirt 57%
a man wearing a white shirt 54.4%
a man wearing a black shirt 54.3%

Text analysis

Amazon

PACH
CAMBRIDGE
CAMBRIDGE Mass.
PACH BRo's
Mass.
BRo's

Google

PACH
CAMBRIDGE. MASS. PACH BRO'S
CAMBRIDGE.
MASS.
BRO'S