Human Generated Data

Title

Rufus Choate

Date

c. 1855-1860

People

Artist: Josiah Johnson Hawes, American 1808 - 1901

Sitter: Rufus Choate,

Classification

Photographs

Human Generated Data

Title

Rufus Choate

People

Artist: Josiah Johnson Hawes, American 1808 - 1901

Sitter: Rufus Choate,

Date

c. 1855-1860

Classification

Photographs

Machine Generated Data

Tags

Amazon

Human 94.4
Person 94.4
Clothing 93.4
Apparel 93.4
Face 89.4
Painting 81.1
Art 81.1
Sitting 74.8
Coat 71.5
Portrait 70.2
Photography 70.2
Photo 70.2
Overcoat 69.2
Suit 69.1
Text 67
Female 64.4
Performer 63.5
People 62.7

Clarifai

people 100
one 99.9
portrait 99.9
adult 99.6
man 99.3
leader 99
wear 97.5
administration 96.2
scientist 96.1
music 95.4
facial hair 94.6
writer 93.2
neckwear 91.3
mustache 91
outfit 90.5
sit 89.8
two 89.7
chair 89.1
menswear 89.1
art 89

Imagga

person 40.2
portrait 37.6
necktie 34.1
comedian 32.4
man 30.3
performer 29.9
male 29.2
attractive 25.9
people 25.7
black 25
face 22.7
adult 22.7
suit 21.9
fashion 21.1
entertainer 21.1
model 21
hair 20.6
expression 19.6
garment 19.5
sexy 18.5
lady 17.9
looking 16
clothing 15.6
handsome 15.2
studio 14.4
smile 14.3
human 14.3
pretty 14
eyes 13.8
dark 13.4
businessman 13.2
glasses 13
business 12.8
serious 12.4
look 12.3
shirt 12.1
sitting 12
one 12
youth 11.9
guy 11.3
happy 11.3
elegant 11.1
posing 10.7
smiling 10.1
lifestyle 10.1
confident 10
make 10
dress 9.9
tie 9.5
senior 9.4
cute 9.3
casual 9.3
alone 9.1
hand 9.1
style 8.9
cool 8.9
success 8.9
jacket 8.8
home 8.8
couple 8.7
love 8.7
seductive 8.6
thinking 8.5
costume 8.5
passion 8.5
head 8.4
lips 8.3
vintage 8.3
friendly 8.2
sensual 8.2
office 8
brunette 7.8
happiness 7.8
evil 7.8
masculine 7.8
corporate 7.7
men 7.7
professional 7.7
old 7.7
executive 7.6
room 7.4
family 7.1
to 7.1

Microsoft

person 98.9
man 98.2
wall 97.7
old 93
white 71.3
posing 55.1
vintage 48.7
older 23.4
necktie 18.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-69
Gender Male, 97.7%
Confused 6.1%
Calm 10.7%
Sad 69.8%
Angry 8.2%
Disgusted 0.4%
Surprised 2.9%
Happy 1.8%

Microsoft Cognitive Services

Age 60
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 94.4%
Painting 81.1%

Captions

Microsoft

a vintage photo of a man in a suit and tie 98.1%
a vintage photo of a man 95.5%
a vintage photo of a man wearing a suit and tie 95.4%