Human Generated Data

Title

Socialism: Germany. Socialist Leaders: Bebel; Marx

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2635

Human Generated Data

Title

Socialism: Germany. Socialist Leaders: Bebel; Marx

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-04

Human 96.9
Person 96.9
Person 95.8
Text 95.1
Art 88
Face 85.6
Head 77.9
Poster 77.4
Advertisement 77.4
Painting 72
Photography 69
Photo 69
Portrait 66.1

Clarifai
created on 2019-06-04

people 97.5
illustration 90.3
adult 89.5
paper 88.2
art 87.7
retro 86.9
man 86.8
print 86.5
one 84.8
no person 82.3
desktop 81.7
group 80.1
text 79.4
vintage 78.5
old 77.7
wear 77.2
woman 72.1
business 71.4
education 70.4
design 69.1

Imagga
created on 2019-06-04

mug shot 29.7
representation 28.5
photograph 26
drawing 23.3
sketch 21.4
design 20.9
paper 19.7
card 19
envelope 18.3
vintage 17.4
art 15.3
retro 14.7
jersey 14.5
symbol 14.1
creation 13.9
cartoon 12.5
stamp 12
graphic 11.7
pattern 11.6
black 11.4
shirt 11.2
style 11.1
note 11
insulating material 10.7
fashion 10.6
sign 10.5
old 10.5
celebration 10.4
grunge 10.2
romantic 9.8
hearts 9.7
garment 9.7
icon 9.5
money 9.4
pink 9.4
shape 9.3
greeting 9.3
coffee 9.3
elegance 9.2
template 9.2
silhouette 9.1
texture 9
container 8.7
love 8.7
holiday 8.6
post 8.6
menu 8.6
set 8.5
element 8.3
playing 8.2
man 8.2
building material 8.1
collection 8.1
romance 8
business 7.9
colorful 7.9
poker 7.9
casino 7.8
decoration 7.8
cards 7.8
portrait 7.8
blank 7.7
elegant 7.7
attractive 7.7
wallpaper 7.7
frame 7.6
fun 7.5
brown 7.4
heart 7.4
clothing 7.4
banner 7.4
person 7.3
people 7.3
currency 7.2
cute 7.2
smile 7.1
face 7.1
happiness 7.1
model 7

Google
created on 2019-06-04

Microsoft
created on 2019-06-04

scene 99.9
room 99.9
gallery 99.8
wall 97.9
drawing 96.9
man 95.7
person 95.4
human face 95.1
clothing 94.3
indoor 85.9
sketch 85.8
art 81
posing 71.9
old 45.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-63
Gender Male, 54.9%
Disgusted 45.1%
Happy 45.1%
Confused 45.3%
Sad 45.4%
Angry 45.2%
Surprised 45.1%
Calm 53.8%

AWS Rekognition

Age 38-57
Gender Male, 52.5%
Disgusted 48.3%
Calm 46.7%
Surprised 45.3%
Sad 46.3%
Confused 45.4%
Angry 46.9%
Happy 46.1%

Microsoft Cognitive Services

Age 51
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.9%
Poster 77.4%

Captions

Microsoft

a group of men posing for a photo 29.3%
August Bebel et al. posing for a photo 29.2%

Text analysis

Amazon

sase
0333000
d sase
d
AR39.111.3

Google

er
Cder
Eu
duce
er Cder wrdiniat Eu C duce
wrdiniat
C