Human Generated Data

Title

Untitled (two women in bright floral dresses, holding hands)
Date

c. 1844-1853
People

Artist: Augustus Washington, American 1820/1821 - 1875
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.86

Human Generated Data

Title

Untitled (two women in bright floral dresses, holding hands)

People

Artist: Augustus Washington, American 1820/1821 - 1875

Date

c. 1844-1853

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Person 99.3
Human 99.3
Person 98.6
Painting 98.2
Art 98.2
Apparel 83.9
Clothing 83.9
Text 66.9
Advertisement 61.2

Clarifai
created on 2018-10-18

people 99.3
art 98.6
painting 98.2
print 98
illustration 95.8
two 95.4
portrait 94.7
retro 94.7
woman 94.4
vintage 93.8
adult 93.1
old 91.5
one 89.8
religion 89.3
antique 88.2
man 87.1
wear 87.1
three 85.5
group 79.5
child 78.9

Imagga
created on 2018-10-18

prayer rug 95.6
rug 76.2
furnishing 58.1
floor cover 57.6
covering 46.1
vintage 38.9
stamp 37.7
mail 36.4
postmark 35.5
art 32.8
postage 32.4
letter 32.1
old 30.6
postal 28.5
post 27.7
envelope 27.5
printed 26.6
ancient 25.9
retro 25.4
shows 24.6
culture 23.9
religion 22.4
antique 22.3
museum 21.7
church 20.3
circa 19.7
gold 18.9
paintings 18.6
masterpiece 17.8
philately 17.8
stamps 17.7
painter 17.6
icon 17.4
aged 17.2
frame 17
delivery 16.5
cutting 16.4
global 16.4
communications 16.3
painted 16.2
unique 16.1
history 16.1
book jacket 16
post mail 15.8
zigzag 15.8
symbol 15.5
office 15.3
fine 15.3
fame 14.8
known 14.8
renaissance 14.7
decoration 14.6
one 13.4
paper 13.3
design 13.1
canceled 12.9
historic 12.8
jacket 12.8
card 12.7
artist 12.5
god 12.4
religious 12.2
sculpture 12.1
golden 12
black 12
message 11.9
architecture 11.7
letters 11.6
saint 10.6
money 10.2
face 9.9
currency 9.9
travel 9.9
close 9.7
holy 9.6
temple 9.6
spirituality 9.6
pattern 9.6
wrapping 9.5
closeup 9.4
ornate 9.1
texture 9
collection 9
interior 8.8
bible 8.8
man 8.7
prayer 8.7
spiritual 8.6
grunge 8.5
decorative 8.3
style 8.2
paint 8.2
painting 8.1
detail 8
palace 7.8
sacred 7.8
portrait 7.8
blank 7.7
carving 7.7
statue 7.6
historical 7.5
mosaic 7.5
traditional 7.5
dollar 7.4
economy 7.4
banking 7.3
cash 7.3
business 7.3

Google
created on 2018-10-18

picture frame 88.6
art 85.2
painting 80.4
portrait 76.8
modern art 69.4
history 58.5
monarch 58.3
artwork 54.8
antique 50.3

Microsoft
created on 2018-10-18

indoor 93.1
black 69.2
old 63.7
picture frame 54
painting 20.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-36
Gender Female, 91.4%
Sad 4.6%
Happy 1.5%
Angry 2.9%
Disgusted 1.2%
Calm 79.5%
Surprised 0.9%
Confused 9.4%

AWS Rekognition

Age 26-43
Gender Female, 99.7%
Confused 18.2%
Happy 0.7%
Disgusted 0.3%
Calm 72.9%
Surprised 3.5%
Sad 1.3%
Angry 3.3%

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 44
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Painting 98.2%

Captions

Microsoft

a painting of a person 85.5%
a painting of a person 80.1%
an old photo of a person 80%