Human Generated Data

Title

Untitled (seven photographs, clockwise from upper left, Alfred (2 photos); Albert Edward; unidentifed man, seated holding book; unidentified man in uniform; Edward Saxe-Weimar, center, Augusta of Saxe Weimar)

Date

1862-1888

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.74

Human Generated Data

Title

Untitled (seven photographs, clockwise from upper left, Alfred (2 photos); Albert Edward; unidentifed man, seated holding book; unidentified man in uniform; Edward Saxe-Weimar, center, Augusta of Saxe Weimar)

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Date

1862-1888

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Human 99.6
Person 99.6
Person 99.1
Person 99
Person 98.6
Poster 93.2
Collage 93.2
Advertisement 93.2
Art 92.3
Person 92.1
Person 90.6
Painting 74.8
Person 70.2
Apparel 65.5
Clothing 65.5

Clarifai
created on 2018-04-19

people 99.9
print 99.8
painting 99
adult 98.7
group 98.7
art 98.5
portrait 97.9
illustration 97.1
man 96.7
one 96.6
leader 95.6
woman 94.3
lithograph 92.7
two 90.3
no person 90.2
royalty 89.6
wear 88.1
many 87.3
museum 87.1
retro 85.8

Imagga
created on 2018-04-19

bookmark 98.2
vintage 36
old 33.4
art 22.6
antique 20.8
ancient 19.9
texture 19.4
door 19
wall 18.8
paper 18.8
architecture 17.2
building 16.8
frame 16.6
stamp 16.3
grunge 16.2
religion 16.1
letter 15.6
mail 15.3
structure 14.9
retro 14.7
aged 14.5
postage 13.7
culture 13.7
church 12.9
postmark 12.8
design 12.6
history 12.5
wood 12.5
post 12.4
travel 12
sculpture 11.9
decoration 11.9
envelope 11.8
entrance 11.6
carving 11.6
symbol 11.4
historic 11
pattern 10.9
traditional 10.8
tourism 10.7
wooden 10.5
religious 10.3
blank 10.3
wallpaper 9.9
museum 9.9
printed 9.8
brown 9.6
altar 9.5
temple 9.5
historical 9.4
house 9.2
icon 8.7
stain 8.6
ornament 8.6
holiday 8.6
painted 8.6
page 8.3
one 8.2
global 8.2
dirty 8.1
detail 8
stone 8
shows 7.9
renaissance 7.8
postal 7.8
painter 7.8
gate 7.8
rustic 7.7
worn 7.6
city 7.5
town 7.4
gold 7.4
rough 7.3
paint 7.2
landmark 7.2
collection 7.2
material 7.1

Google
created on 2018-04-19

Microsoft
created on 2018-04-19

text 99.4
different 89.4
various 88.6
bunch 76.3
gallery 72.9
many 60.9
posing 43.2
several 17.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 52.7%
Disgusted 45.4%
Happy 45.4%
Surprised 48.9%
Angry 45.5%
Calm 48.9%
Confused 45.5%
Sad 45.4%

AWS Rekognition

Age 30-47
Gender Male, 53.3%
Angry 46%
Calm 50.8%
Sad 45.7%
Disgusted 46.1%
Surprised 45.6%
Confused 45.3%
Happy 45.4%

AWS Rekognition

Age 35-52
Gender Male, 53.8%
Sad 45.4%
Calm 52.5%
Angry 46%
Surprised 45.3%
Happy 45.3%
Confused 45.3%
Disgusted 45.1%

AWS Rekognition

Age 35-52
Gender Male, 54.8%
Sad 45.2%
Confused 45.2%
Disgusted 45%
Calm 53.8%
Surprised 45.2%
Happy 45.1%
Angry 45.5%

AWS Rekognition

Age 35-55
Gender Male, 54.3%
Disgusted 45.1%
Confused 45.1%
Sad 46.4%
Surprised 45.1%
Calm 52.6%
Angry 45.6%
Happy 45.1%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Surprised 49.5%
Disgusted 49.5%
Happy 49.5%
Sad 49.7%
Calm 49.8%
Angry 49.9%
Confused 49.5%

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a bunch of items that are posing for a photo 72.5%
a bunch of items that are posing for a mirror picture 59.2%
a bunch of items that are posing for a picture 59.1%

Text analysis

Amazon

Ca
seiar
Ca lav(sier seiar
lav(sier
lupwtlane
lupwtlane ima
ima
reras
rerus
1p0
Aa lu reras rerus
Aa
lu