Human Generated Data

Title

The Last Victim

Date

1918

People

Artist: George Wesley Bellows, American 1882 - 1925

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Diane and Michael Maher, M25782

Human Generated Data

Title

The Last Victim

People

Artist: George Wesley Bellows, American 1882 - 1925

Date

1918

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Diane and Michael Maher, M25782

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Painting 99.2
Art 99.2
Person 98.8
Human 98.8
Person 98.7
Person 66.1

Clarifai
created on 2023-10-29

people 99.9
art 99.8
portrait 99.5
adult 99.2
woman 98.9
painting 98.3
furniture 96.7
girl 96.4
man 96.2
two 95.3
child 95.1
print 94.5
one 92.4
vintage 92.2
family 92
baby 91.2
group 89.5
book bindings 89.5
wear 88.4
sepia 87.7

Imagga
created on 2022-02-26

sax 23.9
person 21.6
musical instrument 17.8
black 17.3
wind instrument 17.1
man 16.8
statue 16.4
people 16.2
adult 16
male 14.9
old 13.2
sculpture 13
dress 12.6
art 12.2
dance 12.1
dancer 11.5
building 11.3
cadaver 11.2
performer 11.2
ruler 11.2
dark 10.9
silhouette 10.8
posing 10.7
world 10.6
fashion 10.6
water 10
religion 9.9
horror 9.7
action 9.4
clothing 9.4
human 9
symbol 8.8
costume 8.7
keyboard instrument 8.7
fear 8.7
architecture 8.6
religious 8.4
portrait 8.4
accordion 8.4
one 8.2
women 7.9
face 7.8
death 7.7
dancing 7.7
motion 7.7
mystery 7.7
performance 7.7
faith 7.7
balance 7.6
elegance 7.6
city 7.5
holding 7.4
style 7.4
sensuality 7.3
fitness 7.2
body 7.2
sunset 7.2
hair 7.1
modern 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

drawing 98.4
wall 97.2
text 96.7
sketch 95.9
person 91.6
clothing 89.8
indoor 86.4
gallery 68.4
woman 55.6
room 47.1
old 45.9
painting 34.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 6-16
Gender Female, 97.6%
Sad 40.7%
Calm 27.5%
Fear 13.8%
Surprised 6.7%
Angry 6.4%
Disgusted 2%
Happy 1.7%
Confused 1.2%

AWS Rekognition

Age 25-35
Gender Male, 98.5%
Calm 98.4%
Sad 1.1%
Happy 0.1%
Surprised 0.1%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 22-30
Gender Male, 99.4%
Angry 37.9%
Fear 27%
Disgusted 11.4%
Happy 6.6%
Surprised 6.1%
Calm 5.7%
Sad 3.3%
Confused 1.9%

AWS Rekognition

Age 23-31
Gender Male, 98.9%
Calm 57.8%
Happy 34.7%
Surprised 3.3%
Confused 1.5%
Fear 1.1%
Disgusted 0.7%
Angry 0.5%
Sad 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting
Person
Painting 99.2%
Person 98.8%
Person 98.7%
Person 66.1%

Categories

Captions

Microsoft
created on 2022-02-26

a painting of a person 79.5%
a painting of a person 74.9%
a painting of a boy 41.6%