Human Generated Data

Title

Untitled (portrait of girl in formal clothes seated against rocks)

Date

c. 1856 - c. 1910

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.13161

Human Generated Data

Title

Untitled (portrait of girl in formal clothes seated against rocks)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-24

Person 99.7
Human 99.7
Soil 95.2
Clothing 87.3
Apparel 87.3
Rock 80.4
Ground 76.3
Archaeology 75.7
Shorts 72.6
Face 68.3
Brick 59.3

Imagga
created on 2022-01-24

child 28.4
grunge 22.1
old 21.6
wall 21.5
decoration 19.7
tattoo 18.3
ancient 18.2
dirty 16.3
design 14.5
aged 14.5
antique 13.9
texture 12.5
stone 12.3
portrait 12.3
art 11.9
vintage 11.6
sill 11.5
grungy 11.4
support 11.1
man 10.8
face 10.7
textured 10.5
black 10.3
culture 10.3
pattern 10.3
mother 10.2
decorative 10
retro 9.8
lady 9.7
plaything 9.6
concrete 9.6
people 9.5
empty 9.4
historical 9.4
architecture 9.4
world 9.3
graffito 9.2
rough 9.1
male 9.1
parent 9
religion 9
history 8.9
brown 8.8
surface 8.8
body 8.8
person 8.8
structural member 8.6
statue 8.6
weathered 8.5
stucco 8.4
color 8.3
makeup 8.2
sand 8.2
currency 8.1
detail 8
sexy 8
swing 8
step 8
device 7.9
building 7.9
sepia 7.8
sculpture 7.7
aging 7.7
costume 7.6
old fashioned 7.6
head 7.6
closeup 7.4
cash 7.3
dress 7.2
paper 7.1
look 7
model 7

Google
created on 2022-01-24

Microsoft
created on 2022-01-24

wall 98
text 97.4
sitting 96.2
clothing 95.8
toddler 93.8
human face 93.4
person 92.5
baby 88.5
old 77.8
boy 57.8
posing 53.7
child 53
curb 8.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-22
Gender Male, 98%
Angry 96.5%
Sad 1.4%
Calm 1.4%
Confused 0.3%
Happy 0.1%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%

Microsoft Cognitive Services

Age 6
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a person sitting on a bench posing for the camera 75.9%
a person sitting on a bench posing for the camera 75.8%
a person sitting on a bench posing for a photo 66.9%