Human Generated Data

Title

Aurora

Date

17th century

People

Artist: Unidentified Artist,

Artist: Cosimo Menghini, Italian

Artist after: Guido Reni, Italian 1575 - 1642

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, 1941.278

Human Generated Data

Title

Aurora

People

Artist: Unidentified Artist,

Artist: Cosimo Menghini, Italian

Artist after: Guido Reni, Italian 1575 - 1642

Date

17th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Person 99.1
Human 99.1
Person 96.9
Poster 96.6
Advertisement 96.6
Person 96
Person 95.5
Person 92.3
Person 91.3
Art 90
Painting 77.1
Mammal 61.4
Horse 61.4
Animal 61.4
Sculpture 56.8
Archaeology 55.3

Clarifai
created on 2020-04-24

people 98.5
art 96.9
group 95.7
adult 94.8
illustration 93.1
man 92.3
many 89
antique 86.5
old 86.1
no person 85.2
engraving 82.9
one 82.1
ornate 82.1
monochrome 80.3
baroque 78.8
retro 78.3
ancient 77.4
desktop 74.6
classic 74.5
picture frame 73.2

Imagga
created on 2020-04-24

web site 64.9
money 33.2
background 31.8
currency 29.6
dollar 28.8
paper 27.4
screen 25.9
finance 25.3
cash 24.7
bank 24.6
business 23.7
old 21.6
vintage 21.5
financial 21.4
banking 21.1
ancient 20.8
stamp 20.5
letter 20.2
mail 20.1
wealth 19.7
postmark 19.7
retro 19.7
art 19.6
dollars 19.3
us 19.3
display 18.8
postage 18.7
rich 18.6
treasury 18
postal 17.7
pay 17.3
savings 16.8
loan 16.3
bill 16.2
history 16.1
philately 15.8
hundred 15.5
exchange 15.3
sculpture 14.6
envelope 14.6
antique 14.3
one 14.2
depository 14.1
circa 13.8
states 13.5
finances 13.5
facility 13.1
franklin 12.8
card 12.7
banknotes 12.7
electronic device 12.7
aged 12.7
close 12.6
closeup 12.1
symbol 12.1
sign 12
bills 11.7
design 11.3
grunge 11.1
note 11
message 11
pattern 10.9
funds 10.8
frame 10.7
banknote 10.7
price 10.6
commerce 10.3
black 9.6
post 9.5
united 9.5
architecture 9.4
investment 9.2
philatelic 8.9
success 8.8
address 8.8
economic 8.7
culture 8.5
capital 8.5
object 8.1
market 8
post office 7.9
shows 7.9
printed 7.9
interest 7.8
debt 7.7
blank 7.7
payment 7.7
temple 7.6
hobby 7.6
drawing 7.6
classic 7.4
economy 7.4
sale 7.4
security 7.3
device 7.3
decoration 7.2
border 7.2
bust 7

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

text 100
book 96.5
person 84.4
player 83.1
cartoon 83
old 78.3
drawing 73.5
art 66.4
posing 62.5
sketch 60.1
vintage 38.2
image 32.5

Face analysis

Amazon

AWS Rekognition

Age 7-17
Gender Female, 54.7%
Surprised 45.1%
Calm 49%
Angry 45.1%
Disgusted 45.1%
Sad 50.1%
Happy 45.1%
Fear 45.2%
Confused 45.2%

AWS Rekognition

Age 12-22
Gender Female, 54.9%
Sad 45%
Confused 45%
Happy 45%
Disgusted 45%
Calm 54.9%
Angry 45%
Surprised 45%
Fear 45%

AWS Rekognition

Age 16-28
Gender Female, 50.3%
Happy 45.3%
Fear 45.2%
Surprised 45.5%
Confused 45.2%
Sad 45.2%
Calm 53.4%
Disgusted 45.1%
Angry 45%

AWS Rekognition

Age 14-26
Gender Male, 51.1%
Fear 45%
Disgusted 45%
Sad 46.5%
Confused 45.6%
Calm 52.5%
Happy 45%
Surprised 45.1%
Angry 45.3%

AWS Rekognition

Age 12-22
Gender Female, 52%
Happy 47.5%
Disgusted 45.1%
Calm 50.1%
Angry 45.3%
Fear 45.1%
Surprised 45.2%
Sad 46.2%
Confused 45.5%

AWS Rekognition

Age 10-20
Gender Female, 54.9%
Happy 45.1%
Disgusted 45%
Confused 45.1%
Surprised 45%
Calm 54.5%
Fear 45%
Angry 45.1%
Sad 45.2%

AWS Rekognition

Age 12-22
Gender Female, 50.4%
Angry 45.1%
Calm 54.3%
Fear 45%
Sad 45.3%
Confused 45.2%
Happy 45%
Surprised 45%
Disgusted 45%

AWS Rekognition

Age 36-52
Gender Male, 52.7%
Happy 45%
Calm 51.9%
Angry 45.4%
Disgusted 45.1%
Fear 45%
Sad 46.9%
Confused 45.7%
Surprised 45.1%

Feature analysis

Amazon

Person 99.1%
Poster 96.6%
Horse 61.4%

Captions

Microsoft

a vintage photo of a person 82.4%
a vintage photo of a person holding a book 57.7%
a vintage photo of a person holding a book 54.2%

Text analysis

Google

0,0.010.O,
OKOOOUIOJOJOIOJUOUD.
00.0.00.0.0010.00
OKOLOIOIGUOUOO 00.0.00.0.0010.00 0,0.010.O, OKOOOUIOJOJOIOJUOUD.
OKOLOIOIGUOUOO