Human Generated Data

Title

Untitled (unidentified sitter)

Date

c. 1858

People

Artist: John Adams Whipple, American 1822 - 1891

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2096

Human Generated Data

Title

Untitled (unidentified sitter)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

c. 1858

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2096

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.3
Human 98.3
Art 96.1
Painting 94.1
Drawing 64.7
Photography 62.8
Photo 62.8
Portrait 61.4
Face 61.4

Clarifai
created on 2023-10-25

portrait 99.6
one 99.1
people 99
man 98
art 97.1
adult 96.3
street 96.1
old 93.6
music 93.4
wear 91.9
retro 91.3
urban 90.5
girl 90.4
vintage 88.5
model 87.1
woman 86.7
face 86.4
sepia 85.6
two 85.5
light 84.9

Imagga
created on 2022-01-08

old 24.4
grunge 23.8
retro 22.9
vintage 21.6
wall clock 19.2
antique 18.2
money 17
symbol 16.8
device 16.5
dirty 16.3
texture 16
drawing 15.7
art 15.2
paper 15
clock 14.9
shield 14.8
design 14.8
aged 14.5
cash 13.7
finance 13.5
damaged 13.3
sign 12.8
currency 12.6
pattern 12.3
board 12.3
timepiece 11.6
armor 11.1
diagram 10.8
material 10.7
ancient 10.4
black 10.2
stucco 10.1
wallpaper 9.9
painting 9.9
wealth 9.9
bank 9.8
financial 9.8
country 9.7
textured 9.6
protective covering 9.6
covering 9.3
dollar 9.3
close 9.1
national 9.1
style 8.9
faded 8.8
pick 8.7
coins 8.7
blank 8.6
measuring instrument 8.5
element 8.3
world 8.1
detail 8
decoration 7.8
flag 7.8
wall 7.7
flower 7.7
pay 7.7
old fashioned 7.6
weathered 7.6
book 7.5
rich 7.4
artwork 7.3
business 7.3
metal 7.2
icon 7.1
travel 7

Google
created on 2022-01-08

Eyebrow 94.8
Coat 85.4
Facial hair 85
Headgear 83
Art 82.9
Rectangle 81
Suit 79.3
Beard 78
Font 77.8
Tints and shades 77.4
Collar 74.5
Blazer 72.5
Moustache 71.4
Paper 70.6
Vintage clothing 70.3
Circle 69.7
Paper product 68.5
Formal wear 67.9
Visual arts 66.2
Illustration 64.9

Microsoft
created on 2022-01-08

human face 96
man 94.9
person 93.2
box 82.9
white 71.5
text 68.4
clothing 60.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 37-45
Gender Male, 99.7%
Calm 99%
Angry 0.4%
Disgusted 0.2%
Confused 0.2%
Surprised 0.1%
Happy 0.1%
Fear 0%
Sad 0%

Microsoft Cognitive Services

Age 50
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%

Categories

Imagga

paintings art 98%
food drinks 1.1%

Captions

Microsoft
created on 2022-01-08

a close up of a box 61.7%
close up of a box 56.6%
an old photo of a box 39.4%