Human Generated Data

Title

Dance Orchestra

Date

c. 1930

People

Artist: Jeanne Mammen, German 1890 - 1976

Classification

Drawings

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Robert Paul Mann, BR73.57

Copyright

© Mammen-Gesellschaft e. V. / Artists Rights Society (ARS), New York / VG Bild-Kunst, Germany

Human Generated Data

Title

Dance Orchestra

People

Artist: Jeanne Mammen, German 1890 - 1976

Date

c. 1930

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 97.5
Person 97.5
Person 95.2
Art 95.2
Painting 95.2
Person 89.4
Person 87
Person 81.5
Person 76.2
Text 75.5
Crowd 69.8
Face 68.8
Drawing 64
Person 63.4
Musical Instrument 57.3
Musician 57.3
Leisure Activities 55.1
Person 49.7

Clarifai
created on 2018-03-20

people 99.8
man 99
adult 98.6
group 97.9
war 96.7
woman 96.2
painting 96.1
military 95.2
many 94.1
administration 93.7
art 91.6
illustration 89.3
soldier 88.4
battle 87.3
religion 87.1
army 86.1
crowd 85.7
portrait 84.6
skirmish 83.8
leader 82.7

Imagga
created on 2018-03-20

comic book 94.4
currency 62
money 60.4
cash 54.9
finance 49
dollar 47.4
bank 46.6
print media 37.7
banking 37.7
wealth 36.8
financial 34.8
business 31
dollars 30.9
bill 29.5
paper 29
savings 28.9
economy 24.1
note 22.1
exchange 22
banknotes 20.6
banknote 20.4
pay 20.1
us 19.3
investment 19.3
hundred 18.4
bills 17.5
loan 17.3
notes 17.3
graffito 16.2
decoration 16
funds 14.7
payment 14.4
profit 14.4
market 14.2
rich 14
close 13.7
finances 13.5
capital 13.3
paying 12.6
debt 12.5
sketch 12.2
stock 12.2
commerce 12.1
monetary 11.7
drawing 11.7
fortune 11.6
change 11.5
united 11.4
buy 11.3
art 11.2
pattern 10.9
representation 10.7
states 10.6
pound 10.6
save 10.4
shopping 10.1
franklin 9.8
twenty 9.8
wages 9.8
design 9.8
economic 9.7
success 9.7
trade 9.6
newspaper 9.4
currencies 8.9
closeup 8.8
income 8.8
crisis 8.7
credit 8.7
nobody 8.6
map 8.5
number 8.4
vintage 8.3
one 8.2
economics 7.8
product 7.8
antique 7.8
rate 7.8
travel 7.7
coins 7.7
old 7.7
expensive 7.7
international 7.6
texture 7.6
coin 7.6
sign 7.5
mosaic 7.3
global 7.3
group 7.3
creation 7.2

Google
created on 2018-03-20

art 92.3
painting 74.1
human behavior 68
modern art 64.8
illustration 59.7
artwork 53.8
paint 50.2

Microsoft
created on 2018-03-20

indoor 87.9

Face analysis

Amazon

Google

AWS Rekognition

Age 15-25
Gender Female, 52%
Happy 6.9%
Disgusted 1.2%
Angry 1.8%
Surprised 1.2%
Sad 4.2%
Calm 83.1%
Confused 1.7%

AWS Rekognition

Age 20-38
Gender Female, 99.5%
Surprised 9.1%
Sad 35.7%
Happy 18.9%
Disgusted 2.8%
Angry 8%
Calm 19.3%
Confused 6.3%

AWS Rekognition

Age 35-52
Gender Male, 95.3%
Sad 20.4%
Calm 63.2%
Confused 4.3%
Disgusted 1.7%
Surprised 4.7%
Happy 3.1%
Angry 2.7%

AWS Rekognition

Age 23-38
Gender Female, 87.1%
Angry 12.7%
Sad 34.3%
Calm 13.7%
Confused 13.5%
Surprised 7.1%
Happy 12.8%
Disgusted 5.8%

AWS Rekognition

Age 23-38
Gender Female, 98.9%
Angry 8.3%
Surprised 5.8%
Happy 14.7%
Sad 48.2%
Calm 5.6%
Disgusted 7%
Confused 10.3%

AWS Rekognition

Age 11-18
Gender Male, 53.6%
Confused 4.5%
Sad 17.6%
Surprised 2.2%
Calm 2.9%
Happy 0.8%
Disgusted 67.4%
Angry 4.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.5%
Painting 95.2%

Captions

Microsoft

a group of stuffed animals 44.2%
a group of stuffed animals on display 44.1%
a bunch of stuffed animals 37.5%

Text analysis

Amazon

Mammin
Pd
AOU
pexcer
Pd AY
AY