Human Generated Data

Title

Prisoners in an Orchard, Sketch for the Rikers Island Mural

Date

1934

People

Artist: Lou Block, American 1895 - 1969

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Malu Nay Block and Fayette Block Watkis, 1998.164

Human Generated Data

Title

Prisoners in an Orchard, Sketch for the Rikers Island Mural

People

Artist: Lou Block, American 1895 - 1969

Date

1934

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2020-05-02

Human 98
Person 98
Person 97.7
Person 97.5
Art 97.1
Person 93.6
Painting 84.4
Person 77.4
Canvas 71.8

Clarifai
created on 2020-05-02

art 99.1
painting 98.2
illustration 98
people 94.3
color 90.9
vintage 89.6
man 88.8
wall 88.5
old 87
indoors 86.2
landscape 85.8
street 84.3
image 84.2
museum 84
woman 83.9
picture frame 83.7
sport 83.4
window 81.9
inside 81
bill 80.6

Imagga
created on 2020-05-02

screen 39.6
background 37.4
laptop 37.4
computer 34.2
display 26.7
billboard 24
monitor 20.9
office 20.8
television 19.3
work 18.8
signboard 18.7
man 18.1
business 17
working 16.8
home 15.9
notebook 15.8
people 15.6
technology 15.6
electronic device 15.4
person 14.9
desk 14.4
structure 14.3
student 13.7
hand 13.7
classroom 13.3
equipment 13.1
communication 12.6
device 12.6
keyboard 12.4
education 12.1
interior 11.5
male 11.3
happy 11.3
room 11.1
house 10.9
broadcasting 10.8
book 10.6
electronic equipment 10.6
table 10.5
adult 10.5
smiling 10.1
indoor 10
telecommunication 10
school 9.9
job 9.7
businesswoman 9.1
businessman 8.8
portable computer 8.7
sitting 8.6
smile 8.5
casual 8.5
finance 8.4
old 8.4
color 8.3
case 8.3
confident 8.2
looking 8
information 8
hair 7.9
professional 7.8
modern 7.7
studying 7.7
wireless 7.6
learn 7.6
senior 7.5
frame 7.5
study 7.5
lifestyle 7.2
black 7.2
team 7.2
personal computer 7.1
portrait 7.1
worker 7.1

Google
created on 2020-05-02

Microsoft
created on 2020-05-02

text 99.8
painting 99.4
drawing 96.4
cartoon 88.6
art 84.8
person 71.2
electronics 66.8
child art 61.1
poster 51.8
picture frame 51.1
different 50.9
display 43
computer 37.4
screenshot 20.1
colored 13.5

Face analysis

Amazon

AWS Rekognition

Age 9-19
Gender Female, 51.3%
Surprised 45%
Confused 45%
Disgusted 45%
Calm 54.2%
Angry 45%
Happy 45%
Fear 45%
Sad 45.8%

AWS Rekognition

Age 23-37
Gender Male, 54.9%
Surprised 45.1%
Disgusted 45%
Angry 49.5%
Fear 45.2%
Calm 49.6%
Confused 45%
Happy 45%
Sad 45.5%

Feature analysis

Amazon

Person 98%
Painting 84.4%

Captions

Microsoft

a screenshot of a computer 51.9%
a screen shot of a computer 51.8%
a screenshot of a computer screen 47.6%

Text analysis

Amazon

FAC
uebew

Google

S/Color
S/Color esTS KOU DVK
KOU
DVK
esTS