Human Generated Data

Title

Pedestrians

Date

20th century

People

Artist: Raphael Soyer, American 1899 - 1987

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Louise E. Bettens Fund, M14643

Human Generated Data

Title

Pedestrians

People

Artist: Raphael Soyer, American 1899 - 1987

Date

20th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Louise E. Bettens Fund, M14643

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Art 99.1
Human 96.3
Person 96.3
Painting 93.4
Drawing 92.3
Sketch 89.8
Person 87.5
Person 82.1

Clarifai
created on 2019-10-29

people 99.5
art 99.4
painting 99.4
adult 99.4
illustration 99.1
print 99
wear 98.8
portrait 97.4
woman 97.2
two 97
man 94.7
vintage 93.3
group 92.8
one 92.6
retro 92.3
lithograph 92
veil 91.1
bill 86.9
son 86
girl 85

Imagga
created on 2019-10-29

sketch 100
drawing 95.4
representation 75.3
grunge 54.5
antique 41.9
texture 41.7
aged 41.6
vintage 41.4
old 37.6
paper 30.7
retro 27.9
frame 27.7
art 27.5
grungy 26.6
dirty 25.3
wallpaper 25.3
worn 24.8
ancient 24.2
floral 22.1
pattern 21.9
flower 21.5
design 20.9
page 20.4
stain 20.2
paint 19.9
graphic 19.7
border 19
material 18.8
decay 18.3
artistic 18.3
grain 17.5
text 17.5
damaged 17.2
blank 17.1
brown 16.9
grime 16.6
detailed 16.4
leaf 16.4
decorative 15.9
silhouette 15.7
space 15.5
rough 15.5
aging 15.3
old fashioned 15.2
edge 14.4
parchment 14.4
structure 14.3
canvas 14.2
plants 13.9
mottled 13.7
fracture 13.6
obsolete 13.4
wall 12.9
smudged 12.8
shabby 12.8
color 12.2
empty 12
crumpled 11.7
crack 11.6
decoration 11.6
textured 11.4
textures 11.4
painterly 10.9
distressed 10.8
rust 10.6
surface 10.6
dirt 10.5
detail 10.5
forest 10.5
artwork 10.1
backgrounds 9.7
creative 9.7
torn 9.7
style 9.7
black 9.6
stained 9.6
architecture 9.4
album 8.8
messy 8.7
ornament 8.6
rusty 8.6
document 8.4
foliage 8.3
letter 8.3
ornate 8.2
effect 8.2
painting 8.1
yellow 8
surrounding 7.9
manuscript 7.8
stains 7.8
burnt 7.8
cardboard 7.7
weathered 7.6
stucco 7.6
plant 7.5
book 7.5
element 7.4
landscape 7.4
leaves 7

Google
created on 2019-10-29

Art 86.5
Illustration 85.3
Text 85.2
Drawing 84.1
Printmaking 68
Painting 66.8
Room 65.7
Sketch 65.6
Visual arts 62.5
Artwork 61
Modern art 56.4

Microsoft
created on 2019-10-29

drawing 99.6
sketch 99.2
gallery 96.4
text 92.7
painting 87.5
scene 83.3
room 83.2
child art 76.1
illustration 64.4
cartoon 62.6
human face 58.9
person 54.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 88.9%
Confused 1.1%
Fear 0.2%
Sad 1.8%
Disgusted 0.2%
Calm 95.5%
Happy 0.3%
Angry 0.7%
Surprised 0.2%

AWS Rekognition

Age 23-37
Gender Female, 84.1%
Calm 0.5%
Sad 0.1%
Disgusted 0%
Surprised 85%
Happy 0%
Angry 0.1%
Fear 11.6%
Confused 2.8%

AWS Rekognition

Age 20-32
Gender Female, 97.2%
Happy 0.3%
Fear 0.9%
Angry 3.3%
Surprised 0.3%
Disgusted 0.1%
Sad 13.6%
Confused 0.5%
Calm 80.9%

AWS Rekognition

Age 17-29
Gender Female, 98%
Fear 11.1%
Happy 0.8%
Confused 1.7%
Sad 4.3%
Calm 56.6%
Surprised 17.4%
Disgusted 3.3%
Angry 4.8%

AWS Rekognition

Age 19-31
Gender Female, 52%
Confused 45%
Fear 45%
Surprised 45%
Calm 54.8%
Disgusted 45%
Angry 45%
Sad 45%
Happy 45%

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 33
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 96.3%

Categories

Imagga

paintings art 99.7%

Captions

Text analysis

Amazon

RahaeSou