Human Generated Data

Title

The King Drinks

Date

18th century

People

Artist: Ephraim Gottlieb Krüger, German 1756 - 1834

Artist after: Jacques Jordaens, Flemish 1593 - 1678

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R9186

Human Generated Data

Title

The King Drinks

People

Artist: Ephraim Gottlieb Krüger, German 1756 - 1834

Artist after: Jacques Jordaens, Flemish 1593 - 1678

Date

18th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 98.3
Person 98.3
Art 98.1
Person 98.1
Person 97.3
Person 96.9
Person 94.9
Person 86.7
Painting 82.5
Person 75.2
Person 71.3
Art Gallery 56

Clarifai
created on 2019-11-16

people 99.7
art 98.3
painting 98.2
group 97.7
adult 97.6
portrait 97.5
woman 95.8
illustration 94.7
man 94.5
museum 93
picture frame 92.9
retro 92.1
two 91.6
wear 91.6
child 90.3
print 89.9
one 86.8
leader 86.1
exhibition 85.8
desktop 85.3

Imagga
created on 2019-11-16

money 31.5
currency 30.5
paper 26.7
cash 26.5
vintage 26.5
brass 25.4
finance 22.8
blackboard 22.5
bill 21.9
old 21.6
memorial 21.6
drawing 21
envelope 21
art 20.7
sketch 20.5
bank 19.7
structure 19.2
dollar 18.6
banking 18.4
financial 17.8
business 17.6
stamp 17.6
wealth 17.1
savings 16.8
retro 16.4
design 15.4
grunge 15.3
frame 15.2
representation 14.7
letter 14.7
antique 14
ancient 13.8
note 13.8
binding 13.8
close 13.7
banknote 13.6
us 13.5
symbol 13.5
one 13.4
history 13.4
exchange 12.4
pattern 12.3
rich 12.1
texture 11.8
postage 11.8
dollars 11.6
pay 11.5
mail 11.5
post 11.4
black 11.4
blank 11.1
economy 11.1
aged 10.9
postmark 10.8
postal 10.8
sculpture 10.8
wallpaper 10.7
insulating material 10.7
container 10.2
investment 10.1
gold 9.9
banknotes 9.8
sign 9.8
hundred 9.7
loan 9.6
profit 9.6
global 9.1
border 9
decoration 8.9
object 8.8
states 8.7
payment 8.7
notes 8.6
culture 8.5
museum 8.3
artwork 8.2
paint 8.1
building material 8
office 8
decor 8
salary 7.9
face 7.8
bills 7.8
golden 7.7
communications 7.7
fine 7.6
concepts 7.1

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

scene 100
gallery 100
room 99.9
drawing 99.1
indoor 96
sketch 93.7
art 92.2
person 89.5
text 74.2
man 65.6
museum 64.8
human face 63.1
old 60.6
picture frame 51.6
painting 50.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-67
Gender Female, 50.5%
Happy 45.1%
Confused 45.2%
Calm 45.4%
Fear 46.1%
Angry 46.9%
Surprised 45.1%
Disgusted 45%
Sad 51.1%

AWS Rekognition

Age 22-34
Gender Female, 54.4%
Fear 45.4%
Angry 46.1%
Calm 48.6%
Surprised 48%
Happy 46.3%
Confused 45.2%
Sad 45.3%
Disgusted 45.1%

AWS Rekognition

Age 11-21
Gender Female, 50.8%
Confused 45.1%
Disgusted 45%
Surprised 45.4%
Calm 51.8%
Angry 45.1%
Sad 45.3%
Happy 46.7%
Fear 45.6%

AWS Rekognition

Age 15-27
Gender Female, 54%
Surprised 51.6%
Calm 45.5%
Happy 45.1%
Angry 45.1%
Fear 45.4%
Sad 45%
Confused 47%
Disgusted 45.1%

AWS Rekognition

Age 17-29
Gender Male, 54.7%
Angry 46.1%
Surprised 53.2%
Confused 45.1%
Disgusted 45%
Sad 45%
Happy 45.1%
Calm 45.3%
Fear 45.3%

AWS Rekognition

Age 20-32
Gender Female, 50.9%
Surprised 51.2%
Happy 45.1%
Confused 45.8%
Sad 45.1%
Angry 45.6%
Fear 46.5%
Disgusted 45.1%
Calm 45.6%

AWS Rekognition

Age 45-63
Gender Male, 54.9%
Happy 45.3%
Angry 46%
Fear 45.7%
Surprised 48.6%
Calm 48.5%
Sad 45.2%
Disgusted 45.2%
Confused 45.4%

AWS Rekognition

Age 26-42
Gender Female, 53%
Confused 45.1%
Happy 45.5%
Disgusted 45%
Calm 47.3%
Angry 45.4%
Sad 45.4%
Surprised 45.3%
Fear 51.1%

AWS Rekognition

Age 26-40
Gender Male, 54.5%
Confused 45%
Surprised 45%
Sad 53.4%
Calm 46%
Disgusted 45%
Happy 45.5%
Fear 45%
Angry 45%

AWS Rekognition

Age 42-60
Gender Female, 50.4%
Confused 45.1%
Angry 45.4%
Surprised 45.2%
Calm 48.3%
Disgusted 45.1%
Fear 47%
Sad 48.9%
Happy 45.1%

Microsoft Cognitive Services

Age 68
Gender Male

Microsoft Cognitive Services

Age 39
Gender Female

Microsoft Cognitive Services

Age 71
Gender Male

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Painting 82.5%

Captions

Microsoft

a vintage photo of a painting 66.2%
a painting hanging on a wall 66.1%
a painting of a person 66%

Text analysis

Amazon

BOIT:
ko
L4 ko BOIT:
L4