Human Generated Data

Title

Untitled (unidentified sitter)
Date

c. 1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2097

Human Generated Data

Title

Untitled (unidentified sitter)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

c. 1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Art 98.9
Person 97.5
Human 97.5
Painting 95.5
Face 84.7
Drawing 65.5
Portrait 63.8
Photography 63.8
Photo 63.8
Art Gallery 63
Wood 59.3

Imagga
created on 2022-01-08

pick 36.3
light bulb 35.2
device 35
electric lamp 28.2
lamp 24.4
black 17.5
ball 16.9
source of illumination 14.2
food 12.2
symbol 12.1
light 12
fruit 11.8
dark 11.7
drawing 10.7
close 10.3
texture 9.7
shape 9.7
sky 9.6
moon 9.4
design 9.1
color 8.9
object 8.8
diagram 8.7
pattern 8.2
love 7.9
holiday 7.9
orange 7.8
balloon 7.6
single 7.4
sun 7.4
sphere 7.3
art 7.3
diet 7.3
game equipment 7.2

Google
created on 2022-01-08

Brown 98
Head 97.2
Coat 93.9
Eyebrow 93.7
Art 82.8
Picture frame 82.2
Suit 78.2
Rectangle 77.7
Tints and shades 77.3
Collar 77
Facial hair 76
Oval 73.4
Circle 71.2
Vintage clothing 70.2
Painting 68
Visual arts 65.9
Illustration 63.6
Moustache 63.2
Wood 60.9
Interior design 58.1

Microsoft
created on 2022-01-08

text 98.5
human face 93
man 91.9
person 87.8
electronics 83.2
drawing 69.3
white 65.6
clothing 62.1
old 47

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Male, 90%
Calm 77.1%
Sad 12.4%
Confused 5.6%
Angry 2%
Fear 1.6%
Surprised 0.8%
Happy 0.3%
Disgusted 0.1%

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.5%

Captions

Microsoft

an old photo of a person 34.5%