Human Generated Data

Title

Samuel Hidden Wentworth, Concord, New Hampshire (1834-1912)

Date

1858

People

Artist: John Adams Whipple, American 1822 - 1891

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2093

Human Generated Data

Title

Samuel Hidden Wentworth, Concord, New Hampshire (1834-1912)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2093

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.9
Human 98.9
Text 96.3
Face 83.2
Art 73.2
Photography 68.3
Photo 68.3
Drawing 65.6
Portrait 62.9
Head 56.8
Tower 56
Building 56
Architecture 56
Handwriting 55.5

Clarifai
created on 2023-10-25

no person 98.5
one 98.2
retro 96.9
art 96
wear 94.3
two 93.8
people 92.7
portrait 91.3
old 90.5
antique 90.4
man 88.9
painting 88.3
vintage 86.5
museum 85.3
hanging 85.3
food 85.2
adult 84.5
paper 84.3
artistic 82.8
Easter 80.9

Imagga
created on 2022-01-08

pick 52.2
device 46.5
diagram 22.5
phonograph record 21.5
money 20.4
drawing 19.9
currency 17.9
cash 16.5
representation 15.5
black 15
finance 14.4
symbol 12.8
old 12.5
object 12.4
close 12
bank 11.6
design 11.2
dollar 11.1
pattern 10.9
hat 10.9
wealth 10.8
financial 10.7
coin 10.5
banking 10.1
art 10
vintage 9.9
sign 9.8
coins 9.6
paper 9.5
envelope 9.2
texture 9
silver 8.8
closeup 8.8
blank 8.6
bill 8.6
retro 8.2
metal 8
card 8
graphic 8
moon 8
world 8
business 7.9
exchange 7.6
two 7.6
dark 7.5
one 7.5
style 7.4
circle 7.2
icon 7.1

Google
created on 2022-01-08

Coat 91.3
Sleeve 84.8
Beard 83.9
Facial hair 79.6
Suit 78.7
Art 78.4
Tints and shades 77
Font 75.9
Collar 75.3
Vintage clothing 69.4
Moustache 69.1
Formal wear 68.2
Rectangle 67
Visual arts 63.5
Paper product 63.2
History 61.8
Illustration 59.9
Circle 59.1
Paper 59
Portrait 55.5

Microsoft
created on 2022-01-08

text 99.3
human face 93.7
person 86.5
man 83.9
handwriting 75.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Calm 71.4%
Sad 17%
Confused 6.8%
Fear 2%
Disgusted 1%
Angry 1%
Surprised 0.5%
Happy 0.2%

Microsoft Cognitive Services

Age 35
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Categories

Imagga

paintings art 89.6%
food drinks 5.2%
text visuals 4.1%

Captions

Microsoft
created on 2022-01-08

text 76.8%

Text analysis

Amazon

July
July 16th 1854
l
16th
1854
n
I am l H. n
I am
H.
boncord
boncord sr.
sr.

Google

boncsrol . 16 1754-
boncsrol
.
16
1754-