Human Generated Data

Title

Simon Greenleaf Fuller, Andover, Massachusetts (1838-1872)
Date

1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2021

Human Generated Data

Title

Simon Greenleaf Fuller, Andover, Massachusetts (1838-1872)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2021

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.1
Human 99.1
Text 95.1
Art 91.3
Painting 82.5
Tie 71.7
Accessories 71.7
Accessory 71.7
Suit 70.7
Clothing 70.7
Coat 70.7
Overcoat 70.7
Apparel 70.7
Drawing 69.4
Photography 60.3
Photo 60.3
Face 59.5
Handwriting 59.4

Clarifai
created on 2023-10-25

one 99.4
adult 99
people 98.9
portrait 98.6
man 98.5
art 97.4
two 97
music 96.6
no person 96.5
wear 93.4
woman 91.4
illustration 91.4
ball-shaped 89.6
retro 89.5
veil 89.2
moon 88.5
facial expression 85.5
mammal 82.7
side view 81.3
painting 81

Imagga
created on 2022-01-08

money 23.8
currency 22.4
amulet 21.2
cash 20.1
finance 18.6
dollar 18.5
bill 17.1
charm 16.8
banking 16.5
art 15.7
bank 15.2
close 13.7
banknote 13.6
wealth 13.5
financial 13.4
business 12.7
moon 12.6
us 12.5
closeup 12.1
symbol 12.1
paper 11.8
vintage 11.6
design 11.5
cartoon 10.7
retro 10.6
dollars 10.6
love 10.2
silhouette 9.9
old 9.7
black 9.7
style 9.6
card 9.4
graphic 8.7
hundred 8.7
person 8.4
portrait 8.4
graphics 8.4
rich 8.4
antique 8.3
note 8.3
one 8.2
valentine 8.2
sombrero 8.1
man 8.1
light 8
hat 7.8
people 7.8
pay 7.7
floral 7.6
coin 7.6
decoration 7.6
color 7.2

Google
created on 2022-01-08

Outerwear 95.1
Hairstyle 95.1
Eyebrow 94.4
Sleeve 84.1
Collar 82.1
Vintage clothing 77.8
Tints and shades 77.3
Blazer 76.7
Art 76.6
Oval 75.9
Facial hair 75.6
Beard 73.7
Font 72.4
Suit 70.9
Handwriting 68.5
Circle 68.5
Moustache 66.8
Formal wear 64
Paper product 63.2
Visual arts 62.8

Microsoft
created on 2022-01-08

text 99
man 96.1
person 92.7
human face 90.1
clothing 85
drawing 65.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Male, 98.5%
Calm 99.5%
Confused 0.2%
Angry 0.1%
Sad 0.1%
Surprised 0%
Fear 0%
Happy 0%
Disgusted 0%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Suit
Person 99.1%
Tie 71.7%
Suit 70.7%

Categories

Imagga

paintings art 98.4%
people portraits 1.1%

Captions

Microsoft
created on 2022-01-08

a close up of a person holding a book 32.8%
a close up of a book 32.7%
a person holding a book 32.6%

Text analysis

Amazon

11th
Sept. 11th 1838
Sept.
1838
Andover
Andover Ons.
Ons.

Google

Mer-
Mer-