Human Generated Data

Title

Pietà

Date

18th century

People

Artist: Francesco Rosaspina, Italian 1762 - c. 1841

Artist after: Correggio (Antonio Allegri), Italian c. 1489 - 1534

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G3454

Human Generated Data

Title

Pietà

People

Artist: Francesco Rosaspina, Italian 1762 - c. 1841

Artist after: Correggio (Antonio Allegri), Italian c. 1489 - 1534

Date

18th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G3454

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Painting 99.1
Art 99.1
Human 97
Person 97
Person 97
Person 96.3
Person 89.5
Person 87.4
Person 66.5
Photo 59.9
Portrait 59.9
Face 59.9
Photography 59.9
Person 54.4

Clarifai
created on 2019-10-29

people 100
group 99.6
adult 99.6
art 99.4
two 99.2
man 99.2
furniture 99
portrait 99
woman 98.6
print 97.9
one 97.4
elderly 96.3
illustration 96.3
three 96.3
family 94.6
painting 93.3
seat 92.6
nude 92.5
reclining 92.5
room 92.3

Imagga
created on 2019-10-29

sculpture 24.8
sofa 20
art 18.3
man 18.2
kin 17
carving 16.5
person 16.4
portrait 16.2
statue 16
people 15.6
one 14.9
studio couch 14.8
attractive 14
love 12.6
couch 12.6
happy 12.5
model 12.4
adult 12.3
face 12.1
convertible 11.8
sketch 11.5
fashion 11.3
old 11.1
architecture 10.9
representation 10.6
book jacket 10.5
armchair 10.2
figure 9.9
male 9.9
vintage 9.9
religion 9.9
room 9.5
sitting 9.4
culture 9.4
decoration 9.4
cute 9.3
black 9
sexy 8.8
home 8.8
couple 8.7
ancient 8.6
smile 8.5
money 8.5
religious 8.4
drawing 8.3
antique 8.2
jacket 8.1
currency 8.1
creation 8.1
history 8
lifestyle 7.9
business 7.9
pretty 7.7
design 7.7
stone 7.6
house 7.5
passion 7.5
human 7.5
close 7.4
historic 7.3
cash 7.3
lady 7.3
detail 7.2
looking 7.2
hair 7.1
family 7.1
product 7

Google
created on 2019-10-29

Microsoft
created on 2019-10-29

text 99.9
painting 99
book 98.9
drawing 98.7
sketch 97.1
art 92.5
person 87.3
museum 75.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 8-18
Gender Female, 95.3%
Fear 1.4%
Sad 98.3%
Disgusted 0%
Happy 0%
Angry 0.1%
Confused 0.1%
Surprised 0%
Calm 0.2%

AWS Rekognition

Age 13-25
Gender Female, 98.9%
Calm 5.6%
Happy 0.7%
Confused 2.5%
Fear 5.2%
Disgusted 2%
Surprised 0.6%
Sad 22.9%
Angry 60.5%

AWS Rekognition

Age 22-34
Gender Male, 92.2%
Fear 5.6%
Angry 3.3%
Disgusted 6.8%
Calm 34.8%
Confused 25.7%
Surprised 6.1%
Sad 16.6%
Happy 1.1%

AWS Rekognition

Age 9-19
Gender Female, 90.8%
Surprised 0.1%
Sad 94.5%
Happy 0.2%
Angry 0.4%
Confused 0.3%
Calm 3.5%
Disgusted 0.2%
Fear 0.8%

AWS Rekognition

Age 22-34
Gender Female, 53.5%
Confused 45.2%
Fear 45.5%
Calm 51.7%
Angry 45.6%
Surprised 45.5%
Sad 46.1%
Happy 45.2%
Disgusted 45.1%

AWS Rekognition

Age 43-61
Gender Male, 87%
Happy 2.4%
Surprised 0.7%
Sad 36%
Calm 52.8%
Fear 4.3%
Angry 2.3%
Disgusted 0.5%
Confused 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.1%
Person 97%

Categories

Imagga

paintings art 85.9%
pets animals 13.9%

Captions

Microsoft
created on 2019-10-29

a group of people posing for a photo 67.1%
an old photo of a man 67%
old photo of a man 66.9%