Human Generated Data

Title

Untitled (studio portrait of two women in rain scene)
Date

c. 1875
People

Artist: Raimund von Stillfried-Ratenicz, Austrian 1839 - 1911
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.367.18

Human Generated Data

Title

Untitled (studio portrait of two women in rain scene)

People

Artist: Raimund von Stillfried-Ratenicz, Austrian 1839 - 1911

Date

c. 1875

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.367.18

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 98.5
Human 98.5
Art 96.3
Person 93.3
Painting 81.3
Person 80.5
Clothing 66.5
Apparel 66.5

Clarifai
created on 2018-03-16

people 99.4
print 99.3
art 99.1
illustration 98.8
wear 97.6
adult 97.5
painting 96.6
one 96.1
woman 94.9
veil 92.8
man 92.7
lithograph 92.5
gown (clothing) 91.9
religion 86.8
portrait 84
music 80.9
cape 79.8
lid 77.3
god 74.4
two 73.1

Imagga
created on 2018-03-16

graffito 100
decoration 81.4
grunge 21.3
vintage 17.4
old 16
art 15.2
retro 14.7
wall 14.5
man 14.1
black 13.2
drawing 13.1
ancient 12.1
dirty 11.7
antique 11.2
people 11.1
paper 11
design 10.8
male 10.6
frame 10
sport 9.9
sketch 9.8
body 9.6
aged 9
texture 9
artistic 8.7
person 8.6
card 8.5
portrait 8.4
room 8.2
symbol 8.1
model 7.8
adult 7.8
travel 7.7
empty 7.7
elegance 7.6
book jacket 7.4
competition 7.3
graphic 7.3
women 7.1
architecture 7

Google
created on 2018-03-16

art 75.7
picture frame 69.1
painting 57.7
artwork 53.8

Microsoft
created on 2018-03-16

picture frame 20.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 55%
Disgusted 45.1%
Confused 45%
Calm 45.3%
Surprised 45%
Angry 45.1%
Sad 54.4%
Happy 45.1%

AWS Rekognition

Age 14-25
Gender Male, 52%
Calm 49.7%
Sad 49.5%
Confused 45.1%
Happy 45.1%
Disgusted 45.1%
Angry 45.5%
Surprised 45.1%

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 15
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Painting 81.3%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2018-03-16

an old photo of a person 66.5%
a person taking a selfie 51.9%
a person posing for a picture 51.8%

Text analysis

Amazon

PIIONT
4n