Human Generated Data

Title

Untitled (unidentified sitter)
Date

c. 1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.1988

Human Generated Data

Title

Untitled (unidentified sitter)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

c. 1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.7
Human 98.7
Art 96.4
Tie 90.3
Accessories 90.3
Accessory 90.3
Drawing 77.9
Text 65
Face 60.2
Portrait 56.9
Photography 56.9
Photo 56.9
Painting 53.5

Imagga
created on 2022-01-08

hat 73.4
headdress 45.8
sombrero 45.3
clothing 36.3
portrait 31
cowboy hat 28.3
person 27.6
man 24.2
adult 23.9
people 23.4
male 22.2
covering 20.1
model 19.4
face 19.2
hair 17.4
fashion 17.3
attractive 16.1
consumer goods 15.7
black 15
human 15
happy 14.4
cute 12.9
sexy 12.8
one 12.7
pretty 12.6
posing 12.4
serious 12.4
lady 12.2
handsome 11.6
smile 11.4
expression 11.1
studio 10.6
look 10.5
men 10.3
make 10
currency 9.9
old 9.7
child 9.5
love 9.5
smiling 9.4
lifestyle 9.4
head 9.2
dark 9.2
blond 9
looking 8.8
guy 8.8
bill 8.5
youth 8.5
money 8.5
dollar 8.3
sensuality 8.2
style 8.2
body 8
happiness 7.8
banknote 7.8
eyes 7.7
elegant 7.7
casual 7.6
skin 7.6
finance 7.6
elegance 7.5
fun 7.5
close 7.4
makeup 7.3
business 7.3
device 7.1

Google
created on 2022-01-08

Hair 98.6
Forehead 98.5
Head 97.5
Chin 96.8
Eyebrow 95.1
Hairstyle 95.1
Eye 93.4
Oval 91.9
Jaw 88.3
Headgear 84.6
Collar 83.9
Facial hair 79.2
Art 78.4
Blazer 78
Tints and shades 77.1
Vintage clothing 76.7
Formal wear 72.5
Circle 70.5
Moustache 69
History 67.8

Microsoft
created on 2022-01-08

human face 97.9
wall 95.5
person 91.9
man 91
clothing 89
black 88
white 84.6
portrait 76.9
old 72.9
drawing 68.7
text 68.1
sketch 57.8
vintage 49.1
posing 48.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Male, 100%
Calm 99.5%
Sad 0.1%
Confused 0.1%
Happy 0.1%
Surprised 0.1%
Angry 0%
Fear 0%
Disgusted 0%

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Tie 90.3%
Painting 53.5%

Captions

Microsoft

a vintage photo of a person 80.7%
a vintage photo of a person 77.9%
a vintage photo of a person in a suit and tie 77.8%