Human Generated Data

Title

James Putnam Swinerton, Taunton, Massachusetts (1838-1909)
Date

1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2026

Human Generated Data

Title

James Putnam Swinerton, Taunton, Massachusetts (1838-1909)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.1
Human 98.1
Text 88.2
Word 75.3
Art 64.3
Food 62.1
Face 61.9
Handwriting 57.8

Imagga
created on 2022-01-08

fruit 46
food 40.3
healthy 29
juicy 26.4
fresh 24.2
close 24
sweet 23.7
tasty 21.7
vitamin 21.1
object 20.5
diet 20.2
eating 19.3
freshness 19.1
citrus 18.7
eat 18.4
delicious 18.2
ripe 18.1
orange 18
organic 16.8
kiwi 16.2
health 16
color 15.6
snack 15.4
edible fruit 15
single 14.8
natural 14.7
meal 14.6
vegetarian 14.3
closeup 14.1
taste 13.9
tropical 13.6
nutrition 13.4
muskmelon 13
round 12.9
yellow 12.6
brown 12.5
dessert 12.3
gourmet 11.9
melon 11.5
produce 11.5
ingredient 11.4
nobody 10.9
cut 10.8
breakfast 10.6
one 10.5
dieting 10.3
exotic 10
light bulb 9.8
juice 9.5
fruits 9.4
egg 9.3
coconut 9.3
refreshment 9.1
circle 8.7
shiny 8.7
bright 8.6
piece 8.5
seed 8.5
two 8.5
gold 8.2
net melon 8.1
raw 8
celebration 8
decoration 7.9
electric lamp 7.9
peel 7.8
half 7.7
ball 7.7
whole 7.6
studio 7.6
traditional 7.5
slice 7.3
pear 7.2
skin 7.1
seasonal 7

Google
created on 2022-01-08

Face 98.5
Head 97.2
Jaw 87.7
Art 81.4
Handwriting 81.2
Facial hair 79
Oval 78
Suit 76.1
Tints and shades 71.3
Circle 68.7
Font 64.4
Collar 64.4
Moustache 64.3
Vintage clothing 61.3
Collectable 60.7
Formal wear 59.6
History 56.8
Paper product 56.1
Drawing 54.6
Illustration 54.3

Microsoft
created on 2022-01-08

text 99.6
human face 97
person 90.6
man 88.1
handwriting 60.8
clothing 52.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Calm 90.9%
Sad 4%
Confused 2.7%
Disgusted 0.8%
Angry 0.6%
Fear 0.4%
Surprised 0.4%
Happy 0.2%

Microsoft Cognitive Services

Age 45
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%

Captions

Microsoft

a screenshot of a social media app for a photo 26.9%
a close up of a logo 26.8%
a person posing for the camera 26.7%

Text analysis

Amazon

1838
29th
Sec 29th 1838
Sec
Mark.
Younton. Mark.
for
Younton.

Google

thuntii,
thuntii, Mak,
Mak,