Human Generated Data

Title

Andrew Preston Peabody (1811-1893)

Date

1885-1890

People

Artist: Pach Brothers, American 1867-1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3990

Human Generated Data

Title

Andrew Preston Peabody (1811-1893)

People

Artist: Pach Brothers, American 1867-1947

Date

1885-1890

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3990

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Apparel 99.3
Coat 99.3
Clothing 99.3
Overcoat 99.3
Human 98.8
Face 98.8
Person 98.7
Tie 98.5
Accessories 98.5
Accessory 98.5
Tuxedo 88.7
Suit 84.6
Photo 73.9
Photography 73.9
Portrait 73.9
Man 71.9
Text 65.9
Shirt 64.2
Art 61.6
Mustache 56
Head 56

Clarifai
created on 2019-11-10

people 99.4
portrait 97.4
man 97.4
one 97
retro 95.5
paper 92.8
adult 92.6
leader 90.7
old 88.4
vintage 87.6
art 86.8
wear 86
bill 82.9
blank 81.2
tie 77.6
business 72.8
antique 72.2
music 72.1
desktop 71.8
picture frame 70.1

Imagga
created on 2019-11-10

bow tie 100
necktie 100
garment 80.6
man 54.5
male 48.3
businessman 47.7
clothing 43.9
senior 41.3
handsome 40.2
portrait 35
adult 35
business 34.7
elderly 34.5
person 34.3
professional 32.1
mature 31.7
suit 30.6
executive 30.6
tie 29.5
people 27.4
old 26.5
looking 25.6
manager 24.2
corporate 23.2
face 22.8
glasses 22.3
smiling 19.6
smile 19.3
confident 19.1
men 18.9
occupation 17.4
boss 17.2
gray 17.2
expression 17.1
happy 16.9
success 16.9
work 16.5
office 16.1
older 15.6
successful 14.7
jacket 14.5
black 14.4
retirement 14.4
hair 14.3
worker 14.2
shirt 14
lifestyle 13.8
retired 13.6
human 13.5
leadership 13.5
one 13.5
hand 12.9
job 12.4
couple 12.2
grandfather 12
leader 11.6
studio 11.4
businesspeople 11.4
cheerful 11.4
friendly 11
alone 11
aged 10.9
formal 10.5
standing 10.4
one person 10.4
doctor 10.4
happiness 10.2
head 10.1
businessperson 9.8
look 9.6
husband 9.6
serious 9.5
age 9.5
love 9.5
eyes 9.5
career 9.5
casual 9.3
modern 9.1
care 9.1
medical 8.8
closeup 8.8
only 8.6
guy 8.3
close 8
working 8
gray hair 7.9
lawyer 7.9
grandmother 7.8
40s 7.8
confidence 7.7
health 7.7
telephone 7.6
medicine 7.1

Google
created on 2019-11-10

Microsoft
created on 2019-11-10

text 98.8
man 96.6
wall 95.3
human face 94.6
suit 94.3
person 93
clothing 90.8
indoor 88.8
tie 88.3
portrait 81.6
drawing 72.6
old 72.3
sketch 70.2
gentleman 50.4
necktie 18.5
picture frame 8.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 53-71
Gender Male, 98%
Fear 0%
Happy 0%
Angry 0.2%
Sad 1.8%
Calm 97.5%
Disgusted 0.1%
Surprised 0.1%
Confused 0.4%

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Tie 98.5%
Suit 84.6%

Categories

Imagga

people portraits 99.8%

Text analysis

Amazon

841
PACH
PACH BRO'S,
B'WAY,
BRO'S,
841 B'WAY, N.Y.
N.Y.

Google

841 BWAY, N.Y PACH BRO'S
841
BWAY,
N.Y
PACH
BRO'S