Human Generated Data

Title

Holy Family
Date

19th century
People

Artist: Giovanni Rivera, Italian 1771 - 1866

Artist: Francesc Fontanals y Rovirosa, Spanish 1777 - 1827

Artist after: Raphael, Italian 1483 - 1520
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3602

Human Generated Data

Title

Holy Family

People

Artist: Giovanni Rivera, Italian 1771 - 1866

Artist: Francesc Fontanals y Rovirosa, Spanish 1777 - 1827

Artist after: Raphael, Italian 1483 - 1520

Date

19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3602

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Human 97
Person 97
Art 95.7
Person 92.9
Person 90.8
Painting 75.9

Clarifai
created on 2019-10-29

people 99.8
one 99
portrait 98.5
adult 96.9
baby 96.8
art 96.2
child 95.4
man 91.9
two 90.8
religion 90.7
music 88.7
wear 86.8
woman 83.2
son 82.3
administration 81.1
group 76.8
facial expression 74
god 73.5
love 72.8
affection 71.5

Imagga
created on 2019-10-29

brass 100
memorial 81.1
structure 56.8
money 46
currency 43.1
cash 38.5
dollar 36.2
finance 33.8
shield 31.2
wealth 30.5
bill 26.6
business 26.1
paper 25.9
financial 25.9
banking 25.7
bank 25.1
armor 24.3
dollars 24.2
hundred 23.2
one 22.4
close 21.1
us 20.3
savings 19.6
protective covering 18.4
finances 18.3
pay 18.2
franklin 17.7
banknote 17.5
art 16.3
exchange 16.2
old 16
covering 15.2
loan 14.4
vintage 14.1
rich 14
economy 13.9
ancient 13.8
investment 13.8
culture 13.7
face 13.5
banknotes 12.7
bills 11.7
retro 11.5
closeup 11.5
sculpture 11
statue 10.9
mosaic 10.8
concepts 10.7
profit 10.5
antique 10.4
portrait 10.4
commerce 10.3
note 10.1
gold 9.9
religion 9.9
president 9.8
funds 9.8
wages 9.8
stamp 9.7
states 9.7
price 9.6
mail 9.6
symbol 9.4
number 9.3
postmark 8.9
value 8.7
man 8.7
payment 8.7
notes 8.6
god 8.6
post 8.6
united 8.6
capital 8.5
church 8.3
sign 8.3
pattern 8.2
success 8.1
icon 7.9
masterpiece 7.9
economics 7.8
architecture 7.8
debt 7.7
spirituality 7.7
england 7.6
museum 7.6
ideas 7.5
letter 7.3
history 7.2
envelope 7.1

Google
created on 2019-10-29

Photograph 94.8
Vintage clothing 78.2
Illustration 75.9
Art 67.7
Stock photography 66.6
Circle 59.7
Picture frame 56.2
Painting 51.9

Microsoft
created on 2019-10-29

text 98.6
human face 97.3
baby 92.4
person 91.1
book 90.3
drawing 84.1
clothing 76.5
painting 69.1
sketch 53
different 36

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Female, 96.6%
Angry 0%
Confused 0.1%
Happy 0.1%
Disgusted 0%
Sad 3.1%
Fear 0%
Surprised 0%
Calm 96.6%

AWS Rekognition

Age 35-51
Gender Male, 84.8%
Happy 0%
Fear 0.3%
Disgusted 0%
Angry 0.1%
Sad 90.6%
Surprised 0%
Confused 0.2%
Calm 8.7%

AWS Rekognition

Age 3-9
Gender Female, 56.7%
Angry 0%
Happy 0%
Disgusted 0%
Confused 0%
Fear 0%
Surprised 0%
Sad 0%
Calm 99.9%

AWS Rekognition

Age 2-8
Gender Female, 53.3%
Fear 45%
Happy 45.7%
Disgusted 45%
Calm 54.3%
Sad 45%
Angry 45%
Surprised 45%
Confused 45%

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97%
Painting 75.9%

Categories

Imagga

paintings art 100%

Captions