Human Generated Data

Title

Untitled (five photographs clockwise from top left, Mrs. Bulkley; Hon. Catherine Stonor; Lady Diana Beauclerk; Miss Towneley; center, Miss Lydia Hibbert)

Date

1862-1888

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.8

Human Generated Data

Title

Untitled (five photographs clockwise from top left, Mrs. Bulkley; Hon. Catherine Stonor; Lady Diana Beauclerk; Miss Towneley; center, Miss Lydia Hibbert)

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Date

1862-1888

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Text 99.7
Label 99.7
Poster 96
Advertisement 96
Collage 96
Human 90.5
Person 90.5
Sticker 77.9
Word 69.8
Drawing 68.8
Art 68.8
Paper 66.7
Home Decor 59.4
Linen 59.4
Page 55.8

Clarifai
created on 2018-04-19

retro 98.2
paper 96.8
old 95.8
vintage 95
people 92.9
collection 92.4
antique 91.9
no person 89.9
woman 89.9
art 88.7
painting 88.1
man 88
illustration 87.7
ancient 86.6
museum 85.6
travel 83.1
religion 82.7
card 79.8
post 79.7
democracy 79.7

Google
created on 2018-04-19

collection 64.6
font 61.6

Microsoft
created on 2018-04-19

posing 49.8
various 49.7
different 39.8
several 11.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-27
Gender Male, 57.3%
Disgusted 1.1%
Confused 6.2%
Sad 7.3%
Surprised 2.6%
Calm 75.4%
Angry 6.8%
Happy 0.7%

AWS Rekognition

Age 23-38
Gender Female, 55%
Confused 45.1%
Disgusted 45.3%
Surprised 45.3%
Calm 50.1%
Happy 46.5%
Sad 47.3%
Angry 45.4%

AWS Rekognition

Age 27-44
Gender Female, 50.4%
Calm 50.4%
Angry 49.5%
Happy 49.5%
Surprised 49.5%
Disgusted 49.5%
Sad 49.5%
Confused 49.5%

AWS Rekognition

Age 38-57
Gender Female, 50%
Disgusted 49.5%
Confused 49.6%
Calm 49.6%
Happy 49.7%
Sad 49.9%
Surprised 49.5%
Angry 49.6%

Microsoft Cognitive Services

Age 44
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 90.5%

Captions

Microsoft

a group of people posing for a photo 35.4%
a group of men posing for a photo 26.2%
a group of kids posing for a photo 11.5%

Text analysis

Amazon

ly
Inly
eaveli
ho
Sif Inly ho r eaveli
hut
dra
r
Itr
Sif
L s ly dra Car Itr
r bd hut
Car
bd
L
s