Human Generated Data

Title

Albert Fitch Bellows (1829-1883)
Date

1866-1871
People

Artist: Napoleon Sarony, American 1821 - 1896

Sitter: Albert Fitch Bellows, American 1829 - 1883

Author: Henry Theodore Tuckerman, American 1813-1871
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.411.30

Human Generated Data

Title

Albert Fitch Bellows (1829-1883)

People

Artist: Napoleon Sarony, American 1821 - 1896

Sitter: Albert Fitch Bellows, American 1829 - 1883

Author: Henry Theodore Tuckerman, American 1813-1871

Date

1866-1871

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Human 99.8
Face 99.8
Person 97.9
Accessories 97.6
Accessory 97.6
Tie 97.6
Art 95.4
Beard 89.3
Drawing 79.6
Portrait 72.8
Photography 72.8
Photo 72.8
Overcoat 68.9
Suit 68.9
Clothing 68.9
Apparel 68.9
Coat 68.9
Mustache 64.6
Painting 59.8
Text 59.1
Art Gallery 56.8
Sketch 56

Clarifai
created on 2019-02-18

people 95
retro 94
one 89.6
man 89.1
portrait 86.5
art 84
elegant 83.9
wear 83.4
adult 82.4
classic 82.3
vintage 81
old 78.6
paper 78.5
antique 78
picture frame 73.6
empty 71.5
painting 69.6
nostalgia 67.3
fashion 67.2
desktop 63.4

Imagga
created on 2019-02-18

call 49.3
person 39.4
attractive 33.6
portrait 32.4
stethoscope 32.4
people 31.8
microphone 31.7
business 30.4
adult 29.8
pretty 25.2
medical instrument 25
face 24.9
device 23.7
telephone 22.7
smiling 22.5
smile 22.1
professional 22.1
lady 21.9
office 21.7
phone 21.2
model 21
businesswoman 20.9
fashion 19.6
looking 19.2
youth 18.8
instrument 18.4
happy 18.2
casual 17.8
blond 17.3
work 17.3
expression 17.1
communication 16.8
women 16.6
headset 16.2
man 16.1
hair 15.9
cute 15.8
one 15.7
male 15.6
black 15.2
human 15
friendly 14.7
corporate 14.6
confident 14.6
head 14.3
suit 13.7
sexy 13.7
talking 13.3
executive 13.1
studio 12.9
talk 12.5
job 12.4
lifestyle 12.3
eyes 12.1
modern 11.9
successful 11.9
style 11.9
handsome 11.6
worker 11.6
cell 11.5
look 11.4
makeup 11.4
brunette 11.3
gorgeous 10.9
hand 10.6
confidence 10.5
communicate 10.5
electrical device 10.5
manager 10.3
make 10
cheerful 9.8
assistant 9.7
listen 9.7
secretary 9.5
service 9.3
posing 8.9
working 8.8
businessman 8.8
headphones 8.8
standing 8.7
serious 8.6
thinking 8.6
center 8.6
shirt 8.6
support 8.5
mobile 8.5
guy 8.4
occupation 8.3
teenager 8.2
dress 8.1
success 8.1
cool 8
representative 7.8
happiness 7.8
operator 7.8
conversation 7.8
listening 7.7
customer 7.6
tie 7.6
smart 7.5
joy 7.5
leisure 7.5
help 7.5
technology 7.4
glasses 7.4
lips 7.4
teen 7.4
music 7.2
skin 7.1
to 7.1

Google
created on 2019-02-18

Photograph 95.9
Moustache 88.8
Picture frame 87.3
Gentleman 86.2
Portrait 81.5
Drawing 74.6
Art 70.9
Facial hair 64.8
Illustration 57.7
Self-portrait 56.9
Interior design 54.4
Sketch 50.1

Microsoft
created on 2019-02-18

gallery 68.3
picture frame 35.2
art 35.2
portrait 25.5
museum 22
person 17.7
print 11.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 72.4%
Calm 23.8%
Disgusted 3.1%
Confused 4.5%
Sad 3.7%
Angry 3%
Surprised 54.7%
Happy 7.2%

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.9%
Tie 97.6%
Suit 68.9%

Captions

Microsoft

an old photo of a person 61.9%
old photo of a person 54.9%
a photo of a person 54.8%

Text analysis

Amazon

hert
hert Jak e llrut
e llrut
Jak