Human Generated Data

Title

Frederick Harold Bailey (b. 1865)
Date

1886-1887
People

Artist: Pach Brothers, American 1867-1947
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.4034

Human Generated Data

Title

Frederick Harold Bailey (b. 1865)

People

Artist: Pach Brothers, American 1867-1947

Date

1886-1887

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Clothing 98.1
Apparel 98.1
Human 97.9
Face 97.9
Person 97.6
Shirt 89
Head 88.3
Art 79.1
Tie 78.7
Accessories 78.7
Accessory 78.7
Photo 76.5
Portrait 76.5
Photography 76.5
Sleeve 71.3
Man 66.6
Drawing 64.7
Text 63.6
Long Sleeve 59.9
Home Decor 57.1
Suit 56.3
Overcoat 56.3
Coat 56.3
Canvas 55.7

Clarifai
created on 2019-11-10

people 97.6
man 97.1
paper 95.8
blank 95.6
one 95.3
portrait 93.4
retro 90
empty 89.5
adult 87.5
desktop 82.7
wear 82.5
business 82.5
note 80.2
bill 75.8
art 74.8
card 66.6
picture frame 66.2
devoid 65.1
profile 63.6
head 62.3

Imagga
created on 2019-11-10

bow tie 100
necktie 100
garment 67.2
clothing 38
man 37.7
person 36.6
portrait 33
male 32.9
adult 27.8
people 26.8
face 26.3
model 25.7
attractive 24.5
suit 24.2
handsome 24.1
fashion 20.4
smile 20
hair 19.8
human 19.5
looking 19.2
business 18.8
black 18.8
happy 18.2
businessman 17.7
sexy 16.9
lifestyle 16.6
expression 16.2
corporate 15.5
tie 14.2
guy 14.2
pretty 14
boy 13.9
smiling 13.8
studio 13.7
hand 13.7
cute 13.6
youth 13.6
professional 13.5
one 13.4
shirt 13.1
lady 13
success 12.1
casual 11.9
love 11.8
posing 11.6
executive 11.3
body 11.2
work 11
modern 10.5
look 10.5
couple 10.5
standing 10.4
style 10.4
eyes 10.3
happiness 10.2
men 9.5
elegant 9.4
skin 9.3
confident 9.1
sensual 9.1
job 8.8
office 8.8
healthy 8.8
serious 8.6
head 8.4
manager 8.4
dark 8.4
friendly 8.2
cheerful 8.1
color 7.8
confidence 7.7
boss 7.7
two 7.6
hairstyle 7.6
child 7.6
blond 7.5
relationship 7.5
mature 7.4
holding 7.4
single 7.4
alone 7.3
teenager 7.3
pose 7.2
adolescent 7

Google
created on 2019-11-10

Photograph 96.6
Chin 82.8
Forehead 82.2
Portrait 81.7
Gentleman 69
Photography 62.4
Art 50.2

Microsoft
created on 2019-11-10

text 99
human face 98.5
man 96
clothing 95.4
person 91.9
portrait 91.5
suit 67.8
tie 53.6
posing 48.2
businesscard 18.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 94.7%
Surprised 0.1%
Happy 0.2%
Calm 99.1%
Fear 0%
Confused 0.2%
Angry 0.1%
Disgusted 0%
Sad 0.3%

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.6%
Tie 78.7%

Captions

Microsoft

a person posing for the camera 93.7%
a man posing for a photo 83%
a man posing for the camera 82.9%

Text analysis

Amazon

Mass.
CAMBRIDGE, Mass.
CAMBRIDGE,
BRo's
PaCH BRo's
PaCH

Google

fAMBRIBGE, MASS. PACH BRO'S
fAMBRIBGE,
MASS.
PACH
BRO'S