Human Generated Data

Title

Untitled (bust length portrait of clean shaven man labeled Francis Michael)
Date

1886-1887
People

Artist: Pach Brothers, American 1867-1947
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3999

Human Generated Data

Title

Untitled (bust length portrait of clean shaven man labeled Francis Michael)

People

Artist: Pach Brothers, American 1867-1947

Date

1886-1887

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Person 98.5
Human 98.5
Face 96
Clothing 86.7
Apparel 86.7
Man 71.2
Head 70
Photo 69.3
Portrait 69.3
Photography 69.3
Art 68.7
Text 64.9
Coat 58.2
Overcoat 58.2
Suit 58.2
Drawing 57.5
Shirt 57.5

Clarifai
created on 2019-11-10

people 98.8
one 97.1
man 97
blank 96.6
paper 96.2
portrait 95.8
empty 91.6
adult 91.5
business 91
desktop 90.3
bill 89.4
retro 86.1
wear 84.9
card 72.2
facial expression 71.3
sign 71.1
boy 69.9
banner 68.3
education 67.7
actor 67.3

Imagga
created on 2019-11-10

necktie 100
bow tie 100
garment 53.2
groom 52.9
man 51.8
male 41.2
suit 40.9
person 39.9
businessman 39.8
handsome 35.7
clothing 32.5
portrait 31.7
adult 31.1
business 28.6
tie 26.6
people 25.1
executive 24.7
looking 24
confident 21.9
smiling 21
couple 20.9
standing 20
happy 19.4
professional 19.4
love 18.9
men 18
expression 17.9
smile 17.8
face 17.8
attractive 17.5
lifestyle 17.4
happiness 17.2
corporate 17.2
black 16.8
dress 16.3
cheerful 16.3
success 16.1
studio 16
manager 14.9
modern 14.7
wedding 14.7
guy 14.6
elegant 14.6
fashion 14.3
human 14.3
work 14.1
two 13.6
formal 13.4
bride 12.7
model 12.5
office 12.1
posing 11.6
married 11.5
confidence 11.5
serious 11.4
smart 11.3
successful 11
alone 11
worker 11
romance 10.7
job 10.6
boss 10.5
one 10.5
shirt 10.3
mature 10.2
youth 10.2
casual 10.2
holding 9.9
good looking 9.8
old 9.8
leader 9.6
look 9.6
bouquet 9.4
one person 9.4
senior 9.4
glasses 9.3
elegance 9.2
hand 9.1
romantic 8.9
style 8.9
businessperson 8.8
boy 8.7
adolescent 8.7
cute 8.6
thinking 8.6
businesspeople 8.5
pretty 8.4
color 8.3
outdoors 8.2
stylish 8.1
sexy 8
family 8
hugging 7.8
life 7.7
leadership 7.7
elderly 7.7
marriage 7.6
head 7.6
joy 7.5
relationship 7.5
fun 7.5
camera 7.4
friendly 7.3
hair 7.1
together 7

Google
created on 2019-11-10

Photograph 96.9
Forehead 84.6
Gentleman 83.9
Portrait 81.3
Jaw 63
Moustache 62.5
Photography 62.4
Stock photography 59.4
Art 58.1
Self-portrait 55.4
Illustration 50.4

Microsoft
created on 2019-11-10

text 99.1
man 98.4
human face 97.2
person 96.4
wall 95.6
clothing 93.9
indoor 91.8
portrait 83.4
sketch 76.6
suit 71.6
posing 71.5
drawing 69.2
old 43

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-33
Gender Male, 98.8%
Disgusted 0%
Angry 0.1%
Fear 0%
Happy 0%
Confused 0.1%
Surprised 0.1%
Calm 99.4%
Sad 0.2%

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%

Captions

Microsoft

a vintage photo of a man 86.7%
a vintage photo of a man in a suit and tie 86.6%
a vintage photo of a man wearing a suit and tie 86.5%

Text analysis

Amazon

PACH
CAMBRIDGE,
PACH BRO'S
CAMBRIDGE, Mass.
Mass.
BRO'S

Google

PACH BRO'S CAMBRIDGE, MASS.
PACH
BRO'S
CAMBRIDGE,
MASS.