Human Generated Data

Title

Annie E.W. Paull
Date

c. 1870
People

Artist: Frederick Gutekunst, American 1831 - 1917
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Eleanor Palmer, P1977.4

Human Generated Data

Title

Annie E.W. Paull

People

Artist: Frederick Gutekunst, American 1831 - 1917

Date

c. 1870

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Eleanor Palmer, P1977.4

Machine Generated Data

Tags

Amazon
created on 2021-04-03

Mouse 90.6
Electronics 90.6
Computer 90.6
Hardware 90.6
Person 87.5
Human 87.5
Bowl 69.4
Art 66.4
Pottery 62.9

Clarifai
created on 2021-04-03

people 98.6
no person 98.6
one 97.4
portrait 97.2
museum 95.3
art 94.6
adult 94.6
wear 93.4
woman 93.2
painting 92.2
two 91.6
still life 88
container 87.3
mirror 86.4
man 85.5
girl 85
face 84.6
sculpture 83.8
color 83.4
fashion 82

Imagga
created on 2021-04-03

bowl 42.1
food 32.5
vessel 32
container 30.4
frying pan 29.7
pan 29.4
plate 26.1
drink 20.9
cup 20.3
healthy 20.1
cooking utensil 20.1
sweet 16.6
glass 16.5
diet 16.2
breakfast 15.7
brown 15.4
gourmet 15.3
beverage 15.1
closeup 14.8
meal 14.7
sugar 14.6
fresh 14.4
lunch 13.9
tea 13.5
kitchen utensil 13.4
delicious 13.2
cooking 13.1
slice 12.7
dessert 12.5
dinner 12.3
powder 11.8
hot 11.7
tasty 11.7
wine 11.2
dish 11.2
restaurant 11.2
health 11.1
nutrition 10.9
eat 10.9
close 10.8
black 10.8
kitchen 10.7
egg 10.1
toiletry 9.7
utensil 9.7
liquid 9.6
coffee 9.5
makeup 9.5
cake 9.4
lifestyle 9.4
nobody 9.3
yellow 9.3
eating 9.2
alcohol 9.2
cream 9.1
sauce 9.1
face powder 9
chocolate 8.6
cuisine 8
leaf 7.8
round 7.8
snack 7.7
toilet seat 7.6
herbal 7.6
aroma 7.5
fruit 7.4
natural 7.4
milk 7.3
spoon 7.2

Google
created on 2021-04-03

Picture frame 94.1
Headgear 82.7
Circle 73.5
Wood 72.1
Cameras & optics 69.7
Audio equipment 68.7
Electric blue 68
Oval 67.9
Fedora 67.3
Art 66.5
Metal 65.7
Hat 64.3
Sound box 52.7
Portrait 51.3

Microsoft
created on 2021-04-03

cup 93.4
indoor 89.2
human face 76.8
oval 58.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-33
Gender Female, 97.2%
Calm 93.9%
Sad 3.1%
Happy 1.5%
Surprised 0.4%
Confused 0.4%
Angry 0.4%
Disgusted 0.2%
Fear 0.1%

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Mouse 90.6%
Person 87.5%

Categories

Imagga

food drinks 97.6%
paintings art 2.3%

Captions

Microsoft
created on 2021-04-03

a cup of coffee 39.1%
a cup of coffee on a table 28.2%
a cup of tea on a table 28.1%