Human Generated Data

Title

Joseph and His Brothers

Date

17th century

People

Artist: Pier Francesco Mola, Italian 1612 - 1666

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, William M. Prichard Fund, S1.85

Human Generated Data

Title

Joseph and His Brothers

People

Artist: Pier Francesco Mola, Italian 1612 - 1666

Date

17th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, William M. Prichard Fund, S1.85

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Human 99.2
Person 99.2
Painting 98.3
Art 98.3
Person 97.1
Person 95.2
Person 92.2
Person 89.3
Person 87.4
Person 81.2
Person 78.4
Person 76.8
Person 74.6
Person 44.1

Clarifai
created on 2018-04-19

people 99.9
illustration 99.5
art 99
print 98.7
man 98.6
adult 98.6
group 98.4
engraving 93.4
veil 91.9
painting 91.1
one 91
woman 89.5
leader 88.9
kneeling 87.7
weapon 87
religion 86.8
administration 86.7
woodcut 86.4
gown (clothing) 85.4
two 84.3

Imagga
created on 2018-04-19

sketch 100
drawing 100
representation 100
map 80.7
antique 39.9
vintage 38.9
old 37
geography 30.9
atlas 29
grunge 28.1
world 27.5
retro 24.6
paper 24.3
travel 24
navigation 23.1
globe 22.3
ancient 21.7
sepia 21.4
texture 20.9
art 20.9
wallpaper 20.7
plan 19.9
continent 19.4
direction 19.1
capital 19
planet 18.9
navigate 18.7
location 18.6
route 18.6
discovery 18.5
road 18.1
journey 17.9
guide 17.6
country 17.6
tourism 17.4
nation 17.1
expedition 16.8
city 15.8
geographic 15.8
boundary 15.8
find 15.7
position 15.7
gold 15.6
tour 14.5
aged 14.5
frame 14.2
design 14.1
pattern 13.7
global 13.7
states 13.6
explore 12.7
history 12.5
grungy 12.4
earth 11.9
dirty 11.8
backdrop 11.6
state 11.5
worn 11.5
page 11.2
business 11
decorative 10.9
border 10.9
color 10.6
graphic 10.2
money 10.2
decoration 9.9
backgrounds 9.7
stamp 9.7
style 9.7
textured 9.7
graffito 9.5
path 9.5
close 9.1
dutch 8.8
torn 8.7
north 8.6
canvas 8.6
finance 8.5
letter 8.3
material 8.1
wall 8
structure 7.8
nobody 7.8
blank 7.7
floral 7.7
card 7.7
damaged 7.6
old fashioned 7.6
east 7.5
element 7.5
grain 7.4
brown 7.4
note 7.4
historic 7.3
detail 7.3
painting 7.2

Google
created on 2018-04-19

Microsoft
created on 2018-04-19

text 99.9
book 99.5

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 26-43
Gender Female, 52.8%
Sad 53%
Calm 45.2%
Disgusted 45.1%
Confused 45%
Happy 46.5%
Angry 45.1%
Surprised 45.1%

AWS Rekognition

Age 23-38
Gender Male, 53.2%
Angry 45.9%
Happy 45.3%
Calm 52.6%
Sad 45.5%
Confused 45.2%
Surprised 45.4%
Disgusted 45.2%

AWS Rekognition

Age 49-69
Gender Female, 50%
Calm 48.1%
Sad 47.4%
Disgusted 45.1%
Surprised 45.5%
Angry 46.8%
Happy 46.7%
Confused 45.4%

AWS Rekognition

Age 60-80
Gender Male, 54.7%
Happy 45.2%
Angry 46.4%
Calm 52.5%
Disgusted 45.2%
Sad 45.4%
Surprised 45.2%
Confused 45.2%

AWS Rekognition

Age 60-80
Gender Male, 53.8%
Disgusted 45.1%
Sad 45.2%
Calm 54.2%
Angry 45.2%
Surprised 45.2%
Happy 45.1%
Confused 45.1%

Microsoft Cognitive Services

Age 76
Gender Male

Feature analysis

Amazon

Person 99.2%
Painting 98.3%

Categories

Imagga

Captions

Microsoft
created on 2018-04-19

an old photo of a book 44.9%
old photo of a book 42.4%
a close up of a book 36.6%