Human Generated Data

Title

Café Osteria

Date

19th century

People

Artist: Franz Joseph, Austrian 19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles H. Taylor, M2505

Human Generated Data

Title

Café Osteria

People

Artist: Franz Joseph, Austrian 19th century

Date

19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles H. Taylor, M2505

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 94.4
Person 94.4
Art 93.9
Person 93.3
Horse 93.1
Animal 93.1
Mammal 93.1
Person 91.8
Person 89.1
Transportation 81.6
Vehicle 80.6
Drawing 78.5
Floor 69.3
Text 67.5
Sketch 63.1
Painting 62.5
Bicycle 57.9
Bike 57.9

Clarifai
created on 2023-10-26

painting 98.7
people 98.4
woman 98.1
no person 97.9
man 97.9
furniture 97
retro 96.8
art 96.5
wear 96.3
two 96.2
adult 96
one 95.8
interior design 94.4
paper 93.5
wood 92.6
indoors 92.1
empty 91.4
dirty 90.1
nature 89.6
family 87.6

Imagga
created on 2022-01-22

envelope 55.9
paper 36.9
container 35.7
old 31.4
vintage 29
insulating material 27.4
retro 24.6
blank 24
grunge 23.8
notebook 21.6
design 20.9
building material 20.5
texture 20.2
page 19.5
book jacket 18.6
empty 18
frame 17.5
card 16.4
book 15.7
letter 15.6
antique 15.6
ancient 15.6
jacket 15.4
aged 15.4
stamp 15
dirty 14.5
drawing 14.4
binding 14.4
note 13.8
wall 13.7
sketch 13.6
art 13
wrapping 12.9
symbol 12.8
covering 12.1
message 11.9
border 11.8
wallpaper 11.5
worn 11.5
office 11.3
document 11.1
rough 10.9
collection 10.8
cardboard 10.6
sign 10.5
business 10.3
object 10.3
binder 9.9
parchment 9.6
mail 9.6
brown 9.6
damaged 9.5
grungy 9.5
gift 9.5
sheet 9.4
black 9
pattern 8.9
postage 8.8
album 8.8
textured 8.8
space 8.5
canvas 8.5
ribbon 8.5
decorative 8.4
cover 8.3
template 8.3
package 8.2
graphic 8
shabby 7.9
manuscript 7.8
crumpled 7.8
stain 7.7
post 7.6
bill 7.6
old fashioned 7.6
greeting 7.4
decoration 7.4
box 7.3
backgrounds 7.3
valentine 7.3
representation 7.2
board 7.1

Google
created on 2022-01-22

Rectangle 84.8
Font 81.4
Art 79.7
Working animal 70.8
Painting 70.6
Drawing 66.8
Paper product 66.3
Illustration 65.8
Paper 65.6
Visual arts 64.4
Wood 61.9
Picture frame 61.1
Room 59.1
Machine 56.6
Modern art 55.2

Microsoft
created on 2022-01-22

wall 99
drawing 96.2
text 89
indoor 88
gallery 88
sketch 84.4
person 83.9
horse 82.5
white 75
room 61.4
cartoon 61
handwriting 52.6
picture frame 7.4

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 21-29
Gender Female, 89.9%
Calm 87.9%
Sad 4.1%
Disgusted 3.3%
Happy 1.9%
Fear 1%
Confused 0.9%
Angry 0.5%
Surprised 0.4%

AWS Rekognition

Age 24-34
Gender Male, 95.6%
Disgusted 96.5%
Angry 1.3%
Calm 1.1%
Happy 0.4%
Surprised 0.3%
Confused 0.2%
Sad 0.2%
Fear 0.1%

AWS Rekognition

Age 16-22
Gender Male, 98.4%
Calm 71.9%
Surprised 11.5%
Fear 7.5%
Sad 4%
Disgusted 1.8%
Angry 1.3%
Happy 1.2%
Confused 0.8%

Feature analysis

Amazon

Person 94.4%
Horse 93.1%

Categories

Imagga

paintings art 99%

Captions

Microsoft
created on 2022-01-22

a sign on a wall 65.5%
a sign for a photo 56.3%
a close up of a sign 56.2%

Text analysis

Amazon

OSTERIA
12LD

Google

O STERIA
O
STERIA