Human Generated Data

Title

Actors

Date

1941-1942

People

Artist: Max Beckmann, German 1884 - 1950

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Lois Orswell, 1955.174.A-C

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

Actors

People

Artist: Max Beckmann, German 1884 - 1950

Date

1941-1942

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Comics 98.4
Book 98.4
Human 97.1
Person 97.1
Person 94.7
Person 94.5
Person 91.4
Person 87.8
Person 86
Person 82.2
Person 65
Person 62
Poster 59.2
Advertisement 59.2
Person 52.5

Clarifai
created on 2018-03-16

illustration 99.6
art 99.4
painting 99
people 98.8
religion 98.7
man 98.1
god 97.5
aura 97.5
kneeling 96.5
saint 96.3
gown (clothing) 95
book 94.5
Mary 94.5
woman 94.1
adult 93.5
church 92.5
veil 91.4
holy 88.6
print 88.2
woodcut 86.6

Imagga
created on 2018-03-16

comic book 100
print media 67
church 31.4
art 29.3
religion 26
pinball machine 24.1
window 21.2
game equipment 19.3
faith 18.2
saint 17.3
cathedral 17.3
glass 17.1
religious 16.9
old 16.7
stained 16.3
god 16.3
stamp 15.5
vintage 14.9
prayer 14.5
holy 14.4
mail 14.4
colorful 14.3
postmark 13.8
letter 13.8
bible 13.7
color 12.8
postage 12.8
catholic 12.6
pray 12.6
retro 12.3
equipment 11.9
printed 11.8
symbol 11.4
culture 11.1
icon 11.1
stained glass 10.9
shows 10.8
black 10.8
postal 10.8
envelope 10.7
spiritual 10.6
post 10.5
design 10.2
money 10.2
card 10.2
catholicism 9.8
sacred 9.7
artistic 9.6
antique 9.5
ancient 9.5
paper 9.4
painting 9
detail 8.9
interior 8.8
belief 8.8
man 8.7
painted 8.6
cash 8.2
paint 8.1
currency 8.1
philately 7.9
stamps 7.9
circa 7.9
spirituality 7.7
unique 7.6
decoration 7.5
object 7.3
artwork 7.3
graphic 7.3

Google
created on 2018-03-16

Microsoft
created on 2018-03-16

posing 68.1
various 46.2
different 42.6
several 11.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-53
Gender Male, 97%
Surprised 0.2%
Sad 0.2%
Happy 0.1%
Disgusted 0.2%
Angry 0.1%
Calm 99.1%
Confused 0.1%

AWS Rekognition

Age 26-43
Gender Male, 56.8%
Happy 0.3%
Disgusted 0.2%
Confused 0.8%
Calm 89.3%
Sad 7.3%
Angry 1.2%
Surprised 0.8%

AWS Rekognition

Age 23-38
Gender Male, 99.7%
Calm 77.9%
Confused 4.2%
Surprised 1.2%
Disgusted 0.9%
Happy 0.6%
Angry 4.3%
Sad 10.9%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Calm 65.8%
Sad 22.8%
Confused 1.5%
Happy 0.3%
Disgusted 1.3%
Angry 4.3%
Surprised 4.1%

AWS Rekognition

Age 26-43
Gender Male, 86.4%
Calm 70.8%
Disgusted 0.7%
Angry 13.6%
Happy 0.9%
Confused 1.2%
Sad 11.2%
Surprised 1.5%

AWS Rekognition

Age 20-38
Gender Male, 54.9%
Disgusted 45%
Surprised 45%
Sad 45.3%
Calm 54%
Angry 45.4%
Happy 45.1%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 92.8%
Confused 8.1%
Surprised 11.3%
Calm 50.9%
Happy 3.4%
Angry 8.2%
Sad 15.6%
Disgusted 2.5%

AWS Rekognition

Age 45-63
Gender Female, 57.4%
Calm 56.4%
Angry 31.1%
Happy 1.9%
Disgusted 1.1%
Sad 5.5%
Surprised 2.3%
Confused 1.8%

AWS Rekognition

Age 20-38
Gender Female, 61.5%
Happy 0%
Disgusted 0.2%
Angry 1.8%
Surprised 0.4%
Sad 3.2%
Calm 94.2%
Confused 0.2%

AWS Rekognition

Age 23-38
Gender Female, 64%
Confused 4.4%
Sad 18%
Surprised 5.1%
Calm 41%
Happy 19.8%
Disgusted 3.7%
Angry 8%

AWS Rekognition

Age 23-38
Gender Male, 53.6%
Calm 45.5%
Sad 46.2%
Confused 45%
Disgusted 45%
Happy 45.1%
Surprised 45.1%
Angry 53.1%

AWS Rekognition

Age 23-38
Gender Female, 62.4%
Happy 3.3%
Confused 1.4%
Sad 32.5%
Angry 3.6%
Calm 56.9%
Disgusted 0.9%
Surprised 1.4%

Microsoft Cognitive Services

Age 23
Gender Male

Microsoft Cognitive Services

Age 21
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 70
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.1%
Poster 59.2%

Captions

Microsoft

a group of people posing for a photo 51.1%
a group of kids posing for a photo 19.6%
a group of men posing for a photo 19.5%

Text analysis

Amazon

M
tork
NM tork
LTU
NM
Aoi LTU M
Aoi
PSE
s