Human Generated Data

Title

Adoration of the Magi

Date

19th century

People

Artist: Johann Nepomuk Strixner, German 1782 - 1855

Artist after: Hans Memling, Flemish 1425-40 - 1494

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R13876

Human Generated Data

Title

Adoration of the Magi

People

Artist: Johann Nepomuk Strixner, German 1782 - 1855

Artist after: Hans Memling, Flemish 1425-40 - 1494

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-06

Art 99.6
Painting 99.6
Human 98.8
Person 98.8
Person 98.4
Person 97.1
Person 96.1
Person 93.5
Person 78.3
Person 70

Clarifai
created on 2019-11-06

people 99.9
art 99.5
group 99.3
illustration 99.3
adult 98.2
woman 97.7
print 97.5
painting 96.4
man 95.9
religion 94.7
gown (clothing) 94.1
saint 93.7
kneeling 93.2
Renaissance 90.6
veil 89.6
wear 89.3
child 88.4
two 88
furniture 88
Mary 87.9

Imagga
created on 2019-11-06

sketch 42.1
art 40.2
drawing 37.4
religion 27.8
representation 27.2
antique 26.8
vintage 26.5
sculpture 24.6
church 23.1
culture 23.1
old 23
ancient 21.6
stamp 21.4
mail 21.1
postmark 20.7
history 20.6
letter 19.3
postage 18.7
postal 18.6
symbol 18.2
architecture 17.8
religious 17.8
post 17.2
museum 16.9
envelope 16.9
printed 16.7
temple 16.4
painter 15.8
renaissance 15.7
painted 15.3
unique 15.2
icon 15
statue 14.6
landmark 14.5
god 14.4
one 14.2
shows 13.8
structure 13.8
book jacket 13.8
global 13.7
historical 13.2
monument 13.1
carving 13
post mail 12.9
zigzag 12.9
masterpiece 12.8
stamps 12.8
paintings 12.7
delivery 12.6
cutting 12.6
paper 12.5
decoration 12.5
communications 12.5
stone 12.2
black 12
fame 11.8
known 11.8
currency 11.7
saint 11.5
building 11.5
fine 11.4
artistic 11.3
famous 11.2
money 11.1
column 11
paint 10.9
altar 10.8
jacket 10.7
retro 10.7
letters 10.6
holy 10.6
travel 10.6
office 10.6
dollar 10.2
closeup 10.1
historic 10.1
gold 9.9
circa 9.9
door 9.7
artist 9.6
comic book 9.6
faith 9.6
window 9.5
wall 9.4
rich 9.3
cash 9.2
texture 9
antiquity 8.8
spirituality 8.6
spiritual 8.6
design 8.6
finance 8.5
city 8.3
banking 8.3
tourism 8.3
ornate 8.2
pattern 8.2
wrapping 8.1
covering 8.1
man 8.1
detail 8
financial 8
canceled 7.9
frame 7.9
baroque 7.8
sacred 7.8
memorial 7.8
prayer 7.7
grunge 7.7
bill 7.6
decorative 7.5
economy 7.4
artwork 7.3
bank 7.2

Google
created on 2019-11-06

Microsoft
created on 2019-11-06

clothing 97.6
person 96.5
text 96.5
old 87.6
drawing 87.1
painting 78.3
woman 74.2
gallery 64.8
cartoon 61
sketch 56.3
room 41.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 33-49
Gender Male, 54.9%
Disgusted 45.4%
Confused 45.3%
Angry 46%
Calm 50%
Sad 47.7%
Fear 45.3%
Happy 45%
Surprised 45.2%

AWS Rekognition

Age 23-35
Gender Female, 53.6%
Fear 45%
Happy 45%
Disgusted 45%
Confused 45%
Surprised 45%
Calm 53.9%
Angry 45.5%
Sad 45.5%

AWS Rekognition

Age 48-66
Gender Male, 54.7%
Disgusted 45.1%
Angry 45.4%
Sad 45.5%
Confused 45%
Happy 45%
Fear 45%
Surprised 45%
Calm 53.9%

AWS Rekognition

Age 21-33
Gender Male, 54.3%
Angry 45.3%
Surprised 45.2%
Happy 45.2%
Sad 45.2%
Calm 53.7%
Confused 45.1%
Fear 45.2%
Disgusted 45.1%

AWS Rekognition

Age 22-34
Gender Male, 53.8%
Angry 45%
Disgusted 45%
Happy 45%
Calm 55%
Sad 45%
Confused 45%
Surprised 45%
Fear 45%

AWS Rekognition

Age 22-34
Gender Male, 54.7%
Calm 52%
Fear 45%
Sad 45.4%
Confused 45.1%
Happy 45%
Angry 47.3%
Disgusted 45%
Surprised 45.1%

AWS Rekognition

Age 20-32
Gender Male, 53%
Calm 54.9%
Angry 45%
Surprised 45%
Fear 45%
Happy 45%
Disgusted 45%
Confused 45%
Sad 45.1%

AWS Rekognition

Age 23-37
Gender Male, 53.8%
Fear 45%
Happy 47.6%
Calm 52.4%
Surprised 45%
Confused 45%
Angry 45%
Sad 45%
Disgusted 45%

AWS Rekognition

Age 22-34
Gender Male, 50.2%
Confused 49.5%
Angry 49.5%
Calm 50.5%
Disgusted 49.5%
Sad 49.5%
Happy 49.5%
Fear 49.5%
Surprised 49.5%

AWS Rekognition

Age 34-50
Gender Male, 52%
Fear 47.2%
Calm 45.4%
Sad 45.3%
Angry 48%
Confused 45.1%
Surprised 45.4%
Disgusted 45.2%
Happy 48.4%

AWS Rekognition

Age 0-3
Gender Male, 51.8%
Surprised 45%
Calm 54.4%
Fear 45%
Happy 45%
Disgusted 45%
Sad 45.3%
Angry 45.2%
Confused 45%

AWS Rekognition

Age 34-50
Gender Male, 50.5%
Disgusted 50.1%
Confused 49.5%
Calm 49.7%
Fear 49.5%
Happy 49.5%
Angry 49.6%
Sad 49.5%
Surprised 49.5%

AWS Rekognition

Age 20-32
Gender Male, 50.5%
Surprised 49.5%
Angry 49.7%
Disgusted 49.6%
Fear 49.6%
Calm 49.6%
Confused 49.5%
Happy 49.6%
Sad 49.7%

AWS Rekognition

Age 11-21
Gender Male, 50.1%
Sad 50.4%
Calm 49.5%
Surprised 49.5%
Angry 49.5%
Fear 49.5%
Happy 49.5%
Confused 49.5%
Disgusted 49.5%

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.6%
Person 98.8%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 73.6%
a vintage photo of a group of people in a room 73.5%
a vintage photo of a group of people posing for a picture 73.4%