Human Generated Data

Title

Social Settlements: Hawaii. Wailuku. Alexander House: Alexander House, Wailuku, Hawaii: A Chinese mother wearing American shoes; baby wears American cap.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2742.5

Human Generated Data

Title

Social Settlements: Hawaii. Wailuku. Alexander House: Alexander House, Wailuku, Hawaii: A Chinese mother wearing American shoes; baby wears American cap.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 98.5
Hug 98.5
Person 98.4
Clothing 97.6
Apparel 97.6
Female 88.2
Face 81.4
Woman 78.4
Dress 76.7
Photo 66.2
Photography 66.2
Girl 63.6
Portrait 61.4
Baby 58.7
Coat 57.5
Man 56.1

Clarifai
created on 2019-06-05

people 99.7
portrait 97.2
two 96.7
child 95.7
baby 93.9
adult 93.2
wear 92.8
woman 92.5
affection 90.5
son 90
love 86.4
man 85.8
one 85
offspring 83.7
interaction 83.6
family 82.2
facial expression 78.6
lid 77.4
embrace 77.1
retro 76.8

Imagga
created on 2019-06-05

trench coat 49.6
statue 43.7
raincoat 39.6
coat 35.2
sculpture 32.7
clothing 24.9
art 24.5
old 24.4
ancient 22.5
garment 22.2
religion 21.5
monument 21.5
military uniform 20.3
marble 18.8
antique 17.4
detail 16.9
stone 16.9
uniform 16.6
history 16.1
catholic 15.7
face 15.6
architecture 15.6
ruler 15.2
travel 14.8
god 14.4
portrait 14.2
religious 14.1
person 14
culture 13.7
historic 12.8
people 12.8
holy 12.5
saint 12.5
vintage 12.4
tourism 12.4
decoration 12.3
robe 12
head 11.8
historical 11.3
church 11.1
bathrobe 11.1
landmark 10.8
spirituality 10.6
city 10
dress 10
fashion 9.8
faith 9.6
love 9.5
symbol 9.4
man 9.4
figure 9.2
roman 8.9
angel 8.8
closeup 8.8
sepia 8.7
pray 8.7
spiritual 8.6
model 8.6
child 8.5
design 8.4
adult 8.4
famous 8.4
decorative 8.4
mother 8.1
hair 7.9
color 7.8
empty 7.7
luxury 7.7
outdoor 7.7
traditional 7.5
park 7.4
cover 7.4
male 7.4
wedding 7.4
tourist 7.3
building 7.1
women 7.1
column 7.1

Google
created on 2019-06-05

Photograph 97.2
Standing 89.5
Snapshot 85.2
Child 82
Vintage clothing 75.7
Photography 67.8
Smile 64.1
Gesture 60.7
Mother 54.9
Hug 54.7
Family 53.7

Microsoft
created on 2019-06-05

person 99.7
outdoor 99.4
baby 98
ground 97.6
toddler 96.5
human face 96.4
clothing 92
child 57.8
smile 54.3
old 44.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 20-38
Gender Female, 99.9%
Calm 30.1%
Surprised 4.5%
Happy 34.6%
Disgusted 4.4%
Angry 4.3%
Sad 6.4%
Confused 15.7%

AWS Rekognition

Age 1-5
Gender Female, 98.7%
Surprised 1.8%
Happy 4.9%
Confused 2.4%
Calm 20.5%
Disgusted 3.3%
Sad 63.6%
Angry 3.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Coat 57.5%

Captions

Microsoft

a black and white photo of a girl 88.5%
a little girl standing in front of a building 80.1%
an old photo of a girl 80%