Human Generated Data

Title

James Danforth Thurber, Plymouth, Massachusetts (1839-1921)
Date

1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2015

Human Generated Data

Title

James Danforth Thurber, Plymouth, Massachusetts (1839-1921)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2015

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 99.1
Person 99.1
Text 91.2
Suit 89.7
Overcoat 89.7
Coat 89.7
Clothing 89.7
Apparel 89.7
Painting 83.8
Art 83.8
Accessories 68.5
Tie 68.5
Accessory 68.5
Face 67.6
Performer 57.3

Clarifai
created on 2023-10-25

one 99.5
portrait 99.4
people 99.3
adult 98.8
man 98
art 97.8
two 97
wear 96.8
music 95.7
facial expression 93.3
no person 92.2
veil 90.8
woman 90.6
retro 89.5
mammal 88.3
sepia 86.9
illustration 86.5
musician 85
sculpture 84.1
old 82.9

Imagga
created on 2022-01-08

sombrero 41.6
hat 40.7
headdress 29.3
currency 26.9
money 25.5
finance 18.6
cash 18.3
close 18.2
clothing 18.2
bank 16.1
closeup 14.1
dollar 13
coins 12.5
art 12.5
coin 12.4
food 12.3
old 11.8
object 11.7
financial 11.6
bill 11.4
banking 11
covering 10.7
us 10.6
fruit 10.6
brown 10.3
paper 10.3
consumer goods 9.9
vintage 9.9
one 9.7
banknote 9.7
black 9.6
round 9.5
business 9.1
wealth 9
love 8.7
pay 8.6
two 8.5
texture 8.3
note 8.3
symbol 8.1
moon 7.8
rusty 7.6
natural 7.4
cowboy hat 7.3
antique 7.3
amulet 7

Google
created on 2022-01-08

Forehead 98.5
Chin 96.7
Outerwear 95.1
Hairstyle 95.1
Eyebrow 94.8
Sleeve 87.2
Oval 87.1
Handwriting 85
Collar 83.6
Headgear 81
Tints and shades 76.7
Vintage clothing 76.5
Suit 75.6
Facial hair 74.9
Art 70.8
Moustache 70.2
Blazer 69.3
Font 68
Circle 66.8
History 65.7

Microsoft
created on 2022-01-08

text 99.5
human face 97.8
person 95.3
man 94.1
clothing 84.6
handwriting 76.2
letter 63.5
old 47.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Male, 96.9%
Calm 99.8%
Sad 0.1%
Confused 0.1%
Angry 0%
Happy 0%
Surprised 0%
Fear 0%
Disgusted 0%

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Painting 83.8%

Categories

Imagga

paintings art 91.4%
people portraits 4.9%
food drinks 3.5%

Captions

Microsoft
created on 2022-01-08

an old photo of a person 43.3%
an old photo of a person 42.8%
an old photo of a person 37.4%

Text analysis

Amazon

1839
mass
D.
st
21
Yeb 21 st 1839
James D. Thurber
James
Plymouth. mass
Thurber
Yeb
Plymouth.

Google

mee
mee