Human Generated Data

Title

Three Men Talking by the Harbor while Another Man Looks off in the Distance
Date

19th century
People

Artist: Franz Joseph, Austrian 19th century
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles H. Taylor, M2507

Human Generated Data

Title

Three Men Talking by the Harbor while Another Man Looks off in the Distance

People

Artist: Franz Joseph, Austrian 19th century

Date

19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles H. Taylor, M2507

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.5
Human 99.5
Person 99.2
Person 98.2
Art 98.1
Person 95.4
Flooring 83.9
Art Gallery 80.6
Drawing 80.1
Sketch 66.5
Painting 58
Wood 55.5

Clarifai
created on 2023-10-26

art 98.8
furniture 98.4
woman 98.4
people 98.3
painting 98.3
portrait 97.7
man 97.5
one 96.9
wood 96.6
no person 96.5
adult 96.2
wear 96.2
wall 96.2
girl 96.2
museum 95.6
indoors 95.3
retro 94
architecture 94
two 91.4
old 90.9

Imagga
created on 2022-01-22

paper 29.2
old 27.9
vintage 26.5
envelope 25.2
grunge 20.4
blank 19.7
design 19
drawing 18.7
texture 18.1
container 17.5
stamp 17.5
antique 17.3
sketch 17.3
retro 17.2
insulating material 16.3
frame 15.9
empty 15.5
notebook 14.7
aged 14.5
card 13.9
art 13.9
wallpaper 13.8
dirty 13.5
ancient 13
letter 12.8
building material 12.2
page 12.1
wall 12
symbol 11.4
decoration 11
object 11
collection 10.8
representation 10.3
rough 10
cardboard 9.6
brown 9.6
international 9.5
worn 9.5
rusty 9.5
gift 9.5
holiday 9.3
space 9.3
wrapping 9.1
business 9.1
border 9
ribbon 9
postage 8.8
book jacket 8.8
textured 8.8
stain 8.6
obsolete 8.6
mail 8.6
package 8.6
damaged 8.6
sign 8.3
note 8.3
board 8.2
material 8
day 7.8
artistic 7.8
album 7.8
flower 7.7
post 7.6
canvas 7.6
pattern 7.5
greeting 7.4
birthday 7.4
backgrounds 7.3
book 7.3
valentine 7.3
office 7.2
celebration 7.2
die 7.2
country 7
leaf 7

Google
created on 2022-01-22

Picture frame 93.9
Wheel 92.6
Rectangle 87.5
Art 86.1
Tire 82.2
Painting 81.2
Font 80.7
Wood 74.8
Vehicle 73.8
Drawing 70.3
Motor vehicle 70
Illustration 69.5
Visual arts 68.2
Room 63.6
Paper product 63.3
Working animal 62.7
Paper 59.2
Modern art 57.5
Vintage clothing 54
Cart 53.5

Microsoft
created on 2022-01-22

wall 99.8
drawing 99.7
room 99
sketch 99
gallery 98.8
scene 98.7
indoor 96.3
art 92
mirror 85.8
white 72.3
text 63.1
person 60.9
painting 35.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 20-28
Gender Male, 99.7%
Calm 97.9%
Disgusted 1%
Surprised 0.3%
Sad 0.3%
Confused 0.2%
Fear 0.2%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 19-27
Gender Male, 87.1%
Calm 92%
Angry 2.9%
Disgusted 2.1%
Surprised 1.1%
Sad 0.7%
Confused 0.4%
Fear 0.4%
Happy 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Categories

Imagga

paintings art 99.3%

Captions

Microsoft
created on 2022-01-22

a painting hanging on a wall 82.6%
a painting in a frame hanging on a wall 77.7%
a painting on the wall 77.6%

Text analysis

Amazon

8145

Google

Fis
Fis