Human Generated Data

Title

Frederic Shurtleff Coolidge (d. 1915)

Date

1886-1887

People

Artist: Pach Brothers, American 1867-1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.4033

Human Generated Data

Title

Frederic Shurtleff Coolidge (d. 1915)

People

Artist: Pach Brothers, American 1867-1947

Date

1886-1887

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.4033

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Person 98.2
Human 98.2
Art 95.3
Face 88.5
Drawing 80.5
Clothing 79.3
Overcoat 79.3
Apparel 79.3
Suit 79.3
Coat 79.3
Tie 72.9
Accessories 72.9
Accessory 72.9
Photography 69.2
Photo 69.2
Portrait 67.2
Canvas 67.2
Painting 65.4
Text 64.8
Sketch 59.5
Head 56.5

Clarifai
created on 2019-11-10

people 97.7
man 93.7
paper 93.2
one 92.4
blank 90.2
portrait 85.8
adult 85.7
retro 85.7
desktop 83.2
wear 83
empty 81.2
art 78.8
business 78.2
bill 78.2
picture frame 69.9
banner 69
woman 68.7
fashion 63
wedding 62.4
head 60.8

Imagga
created on 2019-11-10

bow tie 100
necktie 100
garment 70.4
clothing 40.4
person 38.1
portrait 36.9
man 36.3
adult 34.3
people 29.6
male 29.1
handsome 27.7
businessman 26.5
attractive 25.9
face 25.6
business 24.9
suit 23.4
model 23.4
looking 22.4
hair 20.6
fashion 20.4
pretty 18.2
human 18
expression 17.9
smile 17.8
casual 17.8
professional 17.7
happy 17.6
black 17.5
studio 16.7
smiling 16.7
shirt 15.9
executive 15.8
lady 15.4
tie 15.2
posing 15.1
guy 14.8
confident 14.6
lifestyle 14.5
standing 13.9
cheerful 13.8
success 13.7
sexy 13.7
one 13.5
cute 12.9
eyes 12.9
youth 12.8
love 12.6
work 12.6
elegant 12
modern 11.9
blond 11.9
style 11.9
hand 11.4
look 11.4
corporate 11.2
men 11.2
successful 11
happiness 11
worker 11
sensual 10.9
couple 10.5
thinking 10.5
office 10.5
boy 10.4
charming 10.4
job 9.7
brunette 9.6
serious 9.5
smart 9.4
mature 9.3
businesswoman 9.1
sensuality 9.1
stylish 9.1
body 8.8
women 8.7
skin 8.5
head 8.4
joy 8.4
dress 8.1
together 7.9
jacket 7.7
boss 7.7
two 7.6
wearing 7.6
manager 7.5
close 7.4
positive 7.4
natural 7.4
friendly 7.3
alone 7.3
make 7.3
gorgeous 7.3

Google
created on 2019-11-10

Microsoft
created on 2019-11-10

human face 98.4
text 98.3
person 96.8
man 95.4
clothing 94
portrait 87.1
sketch 80.4
drawing 71.3
black and white 64.8
businesscard 17.3
picture frame 8.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-42
Gender Male, 51.7%
Angry 0.1%
Sad 0.2%
Calm 96.3%
Happy 1.4%
Disgusted 0.1%
Confused 1.4%
Surprised 0.5%
Fear 0%

Microsoft Cognitive Services

Age 24
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Tie 72.9%

Categories

Captions

Microsoft
created on 2019-11-10

an old photo of a man 63.3%
a screen shot of a man 62.2%
a black and white photo of a man 53.4%

Text analysis

Amazon

841
PACH
B'WAY,
841 B'WAY, N.Y.
PACH BRO's,
N.Y.
BRO's,

Google

841 BWAY, N.Y PACH BRO'S
841
BWAY,
N.Y
PACH
BRO'S