Human Generated Data

Title

Three Men Talking by the Harbor while Another Man Looks off in the Distance

Date

19th century

People

Artist: Franz Joseph, Austrian 19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles H. Taylor, M2507

Human Generated Data

Title

Three Men Talking by the Harbor while Another Man Looks off in the Distance

People

Artist: Franz Joseph, Austrian 19th century

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.5
Person 99.5
Person 99.2
Person 98.2
Art 98.1
Person 95.4
Flooring 83.9
Art Gallery 80.6
Drawing 80.1
Sketch 66.5
Painting 58
Wood 55.5

Imagga
created on 2022-01-22

paper 29.2
old 27.9
vintage 26.5
envelope 25.2
grunge 20.4
blank 19.7
design 19
drawing 18.7
texture 18.1
container 17.5
stamp 17.5
antique 17.3
sketch 17.3
retro 17.2
insulating material 16.3
frame 15.9
empty 15.5
notebook 14.7
aged 14.5
card 13.9
art 13.9
wallpaper 13.8
dirty 13.5
ancient 13
letter 12.8
building material 12.2
page 12.1
wall 12
symbol 11.4
decoration 11
object 11
collection 10.8
representation 10.3
rough 10
cardboard 9.6
brown 9.6
international 9.5
worn 9.5
rusty 9.5
gift 9.5
holiday 9.3
space 9.3
wrapping 9.1
business 9.1
border 9
ribbon 9
postage 8.8
book jacket 8.8
textured 8.8
stain 8.6
obsolete 8.6
mail 8.6
package 8.6
damaged 8.6
sign 8.3
note 8.3
board 8.2
material 8
day 7.8
artistic 7.8
album 7.8
flower 7.7
post 7.6
canvas 7.6
pattern 7.5
greeting 7.4
birthday 7.4
backgrounds 7.3
book 7.3
valentine 7.3
office 7.2
celebration 7.2
die 7.2
country 7
leaf 7

Google
created on 2022-01-22

Picture frame 93.9
Wheel 92.6
Rectangle 87.5
Art 86.1
Tire 82.2
Painting 81.2
Font 80.7
Wood 74.8
Vehicle 73.8
Drawing 70.3
Motor vehicle 70
Illustration 69.5
Visual arts 68.2
Room 63.6
Paper product 63.3
Working animal 62.7
Paper 59.2
Modern art 57.5
Vintage clothing 54
Cart 53.5

Microsoft
created on 2022-01-22

wall 99.8
drawing 99.7
room 99
sketch 99
gallery 98.8
scene 98.7
indoor 96.3
art 92
mirror 85.8
white 72.3
text 63.1
person 60.9
painting 35.8

Face analysis

Amazon

Google

AWS Rekognition

Age 20-28
Gender Male, 99.7%
Calm 97.9%
Disgusted 1%
Surprised 0.3%
Sad 0.3%
Confused 0.2%
Fear 0.2%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 19-27
Gender Male, 87.1%
Calm 92%
Angry 2.9%
Disgusted 2.1%
Surprised 1.1%
Sad 0.7%
Confused 0.4%
Fear 0.4%
Happy 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a painting hanging on a wall 82.6%
a painting in a frame hanging on a wall 77.7%
a painting on the wall 77.6%

Text analysis

Amazon

8145

Google

Fis
Fis