Human Generated Data

Title

Harris Grafton Hale (1865-1945)
Date

1886-1887
People

Artist: Pach Brothers, American 1867-1947
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3968

Human Generated Data

Title

Harris Grafton Hale (1865-1945)

People

Artist: Pach Brothers, American 1867-1947

Date

1886-1887

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Accessories 99.3
Accessory 99.3
Tie 99.3
Person 97.6
Human 97.6
Clothing 96.4
Apparel 96.4
Tie 95.1
Art 83
Shirt 78.3
Home Decor 73.1
Face 72
Advertisement 65.3
Photography 61.8
Photo 61.8
Portrait 61.8
Overcoat 58.8
Coat 58.8
Suit 58.8
Poster 56.7

Clarifai
created on 2019-11-10

people 97.3
blank 95.9
paper 95.3
one 93.5
man 93.3
retro 91.5
desktop 91.3
portrait 90.5
empty 87.4
bill 86.2
wear 86
art 83.7
adult 83.3
picture frame 79.4
note 77
business 76
vintage 72.5
card 72
banner 68.1
image 66

Imagga
created on 2019-11-10

necktie 100
bow tie 100
garment 79.1
clothing 48.6
portrait 34.3
suit 33.3
male 32.6
person 32.5
adult 32.3
people 30.1
man 28.9
businessman 27.4
business 27.3
face 24.9
studio 20.5
professional 20.3
cute 20.1
human 19.5
handsome 18.7
fashion 18.1
black 18
tie 18
model 17.9
smile 17.8
success 17.7
successful 17.4
smiling 17.4
corporate 17.2
looking 16.8
executive 16.6
boy 16.5
expression 16.2
attractive 16.1
hair 15.9
child 15.8
happy 15
one 14.2
manager 14
cheerful 13.8
confident 13.7
hand 12.9
youth 12.8
businesswoman 12.7
work 12.6
happiness 12.5
boss 12.4
kid 12.4
elegant 12
posing 11.6
job 11.5
little 11.5
standing 11.3
sexy 11.2
style 11.1
occupation 11
men 10.3
guy 10.1
head 10.1
pretty 9.8
office 9.6
charming 9.5
blond 9
brunette 8.7
jacket 8.7
serious 8.6
career 8.5
casual 8.5
positive 8.3
alone 8.2
make 8.2
stylish 8.1
dress 8.1
hands 7.8
hairstyle 7.6
businesspeople 7.6
vintage 7.4
glasses 7.4
20s 7.3
lady 7.3
lifestyle 7.2
childhood 7.2
love 7.1
indoors 7
look 7

Google
created on 2019-11-10

Photograph 96.5
Gentleman 81.4
Forehead 78.2
Portrait 73.5
Photography 62.4
Stock photography 59.4
Art 50.2

Microsoft
created on 2019-11-10

text 98.7
human face 98.3
man 96.7
clothing 96.3
person 96
portrait 90.3
indoor 87.3
suit 66.8
posing 56.7
tie 54.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-32
Gender Male, 90.5%
Sad 0.6%
Fear 0%
Happy 0.2%
Disgusted 0.1%
Confused 0.4%
Calm 98.3%
Surprised 0.2%
Angry 0.2%

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.3%
Person 97.6%

Captions

Microsoft

a man holding a sign posing for the camera 68.7%
a person posing for the camera 68.6%
a man posing for a photo 68.5%

Text analysis

Amazon

841
PACH
B'WAY,
841 B'WAY, N.Y.
PACH BRO'S,
BRO'S,
N.Y.

Google

BRO'S
N.Y
PACH
841 BWAY, N.Y PACH BRO'S
841
BWAY,