Human Generated Data

Title

Nativity
Date

1696
People

Artist: Demetrius Foscari,

Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Sheldon Keck, Class of 1932, 1998.228

Human Generated Data

Title

Nativity

People

Artist: Demetrius Foscari,

Date

1696

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Sheldon Keck, Class of 1932, 1998.228

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Person 99.4
Human 99.4
Person 97.8
Person 97.7
Person 96.7
Person 92
Person 91.7
Art 91.3
Drawing 90.4
Person 87.8
Person 87.5
Painting 84.2
Text 82.3
Person 80.9
Person 76.1
Person 70.2
Person 68.6
Person 62.3
Sketch 56.3
Person 56.3
Advertisement 55.5
Person 48.1

Clarifai
created on 2020-04-24

people 100
group 99.8
adult 99.5
print 99.4
many 99.4
man 98.6
illustration 98.2
art 97.8
woman 97
engraving 97
religion 96.1
leader 90.7
veil 89.5
woodcut 89.4
war 89.1
several 89
kneeling 85.6
furniture 85.4
facial hair 84.8
elderly 84.7

Imagga
created on 2020-04-24

sketch 74.1
drawing 55.7
representation 45.2
art 31
decoration 24.4
history 24.2
sculpture 24
money 23.8
architecture 23.4
ancient 23.4
religion 21.5
currency 20.6
culture 19.7
statue 18.3
cash 18.3
comic book 17.6
banking 17.5
graffito 17.3
old 16.7
dollar 16.7
stone 16.5
temple 16.4
church 15.7
bank 15.4
god 15.3
finance 15.2
savings 14.9
carving 14.5
loan 14.4
financial 14.3
dollars 13.5
building 13.5
business 13.4
antique 13.1
paper 12.6
finances 12.5
religious 12.2
monument 12.1
symbol 12.1
famous 12.1
rich 12.1
detail 12.1
economy 12.1
one 12
landmark 11.7
wealth 11.7
holy 11.6
historical 11.3
marble 10.8
bills 10.7
mosaic 10.5
capital 10.4
figure 10.2
historic 10.1
us 9.6
bill 9.5
artwork 9.2
travel 9.2
close 9.1
design 9
museum 9
pattern 8.9
banknotes 8.8
artistic 8.7
spirituality 8.6
pay 8.6
exchange 8.6
face 8.5
decorative 8.4
city 8.3
tourism 8.3
gold 8.2
style 8.2
funds 7.8
column 7.8
hundred 7.8
wall 7.7
painting 7.2
print media 7
facade 7

Google
created on 2020-04-24

People 93.7
Painting 80.8
Art 73.1
Stock photography 69.8
Illustration 68.1
Photography 62.4
History 57.6

Microsoft
created on 2020-04-24

text 99.9
drawing 99.6
sketch 99.1
painting 96.3
book 92.8
cartoon 92.5
person 87.4
illustration 84.5
man 67.9
posing 67.9
clothing 62.7
several 12

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 20-32
Gender Male, 52.3%
Angry 45%
Surprised 45%
Fear 45%
Calm 54.5%
Sad 45.2%
Confused 45%
Happy 45.2%
Disgusted 45%

AWS Rekognition

Age 13-25
Gender Female, 54.3%
Disgusted 45%
Surprised 45%
Calm 45.4%
Happy 45%
Fear 45.1%
Confused 45%
Angry 45%
Sad 54.5%

AWS Rekognition

Age 8-18
Gender Female, 53.1%
Sad 54.8%
Happy 45%
Confused 45%
Angry 45%
Calm 45.2%
Surprised 45%
Fear 45.1%
Disgusted 45%

AWS Rekognition

Age 31-47
Gender Male, 51.6%
Fear 45.5%
Disgusted 45%
Confused 45.3%
Angry 45.4%
Happy 45.1%
Calm 46.3%
Surprised 47.7%
Sad 49.6%

AWS Rekognition

Age 21-33
Gender Male, 50.2%
Calm 45.8%
Disgusted 45%
Sad 53.8%
Surprised 45.1%
Confused 45.1%
Angry 45.1%
Fear 45.1%
Happy 45.1%

AWS Rekognition

Age 15-27
Gender Female, 54.5%
Fear 47.5%
Happy 45.4%
Angry 45.6%
Surprised 45.3%
Disgusted 45.1%
Sad 49.9%
Calm 46%
Confused 45.2%

AWS Rekognition

Age 22-34
Gender Female, 50.2%
Surprised 45.7%
Confused 45.1%
Sad 46.1%
Disgusted 45.2%
Happy 45.1%
Angry 45.1%
Calm 45.1%
Fear 52.7%

AWS Rekognition

Age 22-34
Gender Male, 52%
Calm 48.6%
Happy 45%
Fear 45.8%
Sad 50.1%
Disgusted 45%
Confused 45.1%
Surprised 45.2%
Angry 45.1%

AWS Rekognition

Age 39-57
Gender Male, 54.8%
Angry 45%
Confused 45%
Disgusted 45%
Fear 45%
Sad 45.4%
Calm 54.4%
Happy 45.1%
Surprised 45%

AWS Rekognition

Age 24-38
Gender Female, 54.5%
Calm 54.6%
Sad 45.2%
Angry 45%
Disgusted 45%
Fear 45.1%
Happy 45.1%
Confused 45%
Surprised 45.1%

AWS Rekognition

Age 21-33
Gender Male, 53.6%
Angry 45.1%
Sad 49%
Happy 45.1%
Fear 45.1%
Confused 45.1%
Surprised 45.2%
Disgusted 45%
Calm 50.5%

AWS Rekognition

Age 36-54
Gender Female, 50.5%
Disgusted 45.5%
Fear 46.2%
Surprised 45.7%
Angry 45.4%
Happy 45%
Calm 46.9%
Confused 46.3%
Sad 49%

AWS Rekognition

Age 24-38
Gender Male, 54.6%
Fear 45.1%
Confused 51.9%
Calm 45.5%
Disgusted 45.3%
Sad 45.6%
Happy 45%
Surprised 45.3%
Angry 46.3%

AWS Rekognition

Age 22-34
Gender Female, 53.3%
Happy 45%
Calm 45.4%
Disgusted 45%
Surprised 45%
Confused 45%
Angry 45%
Fear 45%
Sad 54.5%

AWS Rekognition

Age 17-29
Gender Female, 51.8%
Fear 45.1%
Sad 49.2%
Disgusted 45%
Happy 45%
Confused 45.1%
Calm 50.4%
Surprised 45.1%
Angry 45.1%

AWS Rekognition

Age 20-32
Gender Female, 50.7%
Fear 45.9%
Sad 47.3%
Surprised 48.2%
Disgusted 45%
Calm 48.1%
Happy 45.1%
Angry 45.2%
Confused 45.2%

AWS Rekognition

Age 39-57
Gender Male, 52.8%
Disgusted 45%
Sad 46.1%
Happy 45%
Angry 45%
Confused 45.1%
Surprised 46.2%
Fear 52.3%
Calm 45.2%

AWS Rekognition

Age 15-27
Gender Male, 50.3%
Sad 45.1%
Confused 45%
Disgusted 45%
Happy 45.9%
Fear 45%
Calm 53.8%
Surprised 45.1%
Angry 45.1%

AWS Rekognition

Age 31-47
Gender Female, 54.4%
Calm 46.3%
Happy 45%
Sad 52.9%
Angry 45.3%
Disgusted 45%
Confused 45%
Surprised 45%
Fear 45.2%

AWS Rekognition

Age 34-50
Gender Male, 52.3%
Angry 45.1%
Surprised 45.1%
Fear 45.6%
Calm 45.4%
Sad 53.6%
Confused 45.1%
Happy 45%
Disgusted 45%

AWS Rekognition

Age 21-33
Gender Male, 54.3%
Fear 45.1%
Calm 48.4%
Sad 47.8%
Confused 47.7%
Disgusted 45.1%
Happy 45.1%
Angry 45.8%
Surprised 45.1%

AWS Rekognition

Age 16-28
Gender Male, 52.7%
Fear 45.2%
Happy 45.3%
Confused 45.4%
Sad 48.2%
Angry 45.8%
Surprised 45.6%
Disgusted 45.2%
Calm 49.4%

Feature analysis

Amazon

Person 99.4%
Painting 84.2%

Categories

Imagga

paintings art 73.8%
streetview architecture 25.5%

Text analysis

Amazon

HTXXV.
TeNNHGic.
NIONAG
ALiCIL
atg

Google

TENNHCIC. Ateicik AKAS
TENNHCIC.
Ateicik
AKAS