Human Generated Data

Title

Untitled (gem tintype of two girls, half-length view)
Date

c. 1858 - c. 1910
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.12880

Human Generated Data

Title

Untitled (gem tintype of two girls, half-length view)

People

Artist: Unidentified Artist,

Date

c. 1858 - c. 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-24

Human 99.2
Person 99.2
Person 96.2
Hole 87.4
Window 68.5
Text 66.1
Art 57.8
Porthole 55.9

Imagga
created on 2022-01-24

timepiece 100
clock 100
wall clock 100
measuring instrument 79
instrument 44.6
old 41.1
antique 35.5
grunge 31.5
vintage 31.4
texture 29.2
aged 26.2
dirty 26.2
retro 25.4
time 23.8
paper 23.5
ancient 21.6
wall 21.4
pattern 18.5
worn 18.1
rough 17.3
empty 17.2
design 16.9
wallpaper 16.1
material 16.1
textured 15.8
art 15
brown 14.7
watch 14.4
grungy 14.2
surface 14.1
page 13.9
blank 13.7
detail 12.9
hour 12.7
parchment 12.5
decorative 11.7
dial 11.7
damaged 11.4
text 11.4
circle 11.2
document 11.1
closeup 10.8
minute 10.8
cardboard 10.6
number 10.3
stain 9.6
artistic 9.6
card 9.4
close 9.1
color 8.9
second 8.8
decay 8.7
age 8.6
old fashioned 8.6
canvas 8.5
space 8.5
south 8.4
wood 8.3
grain 8.3
book 8.2
symbol 8.1
object 8.1
hours 7.9
deadline 7.8
round 7.8
crumpled 7.8
aging 7.7
money 7.7
rusty 7.6
weathered 7.6
backdrop 7.4
natural 7.4
letter 7.3
business 7.3
decoration 7.2

Google
created on 2022-01-24

Wood 82.4
Rectangle 81.7
Circle 73.7
Font 68.1
Metal 66
Paper product 65
Art 64.5
Paper 63.6
Visual arts 63.6
History 61.6
Illustration 53.8
Still life photography 52.7
Book 52
Square 50.5

Microsoft
created on 2022-01-24

text 89.9
human face 71.3
drawing 68.5
letter 66.5
envelope 49.8
box 35.8

Face analysis

Amazon

Google

AWS Rekognition

Age 2-8
Gender Female, 100%
Sad 78.4%
Angry 13.5%
Calm 5%
Fear 2%
Surprised 0.5%
Disgusted 0.3%
Confused 0.2%
Happy 0.1%

AWS Rekognition

Age 6-12
Gender Female, 100%
Angry 73.3%
Calm 23%
Sad 2.3%
Fear 0.5%
Confused 0.4%
Surprised 0.2%
Disgusted 0.2%
Happy 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a close up of a box 58.2%
graffiti on the side of a building 28.3%
graffiti on a wall 28.2%