Human Generated Data

Title

Social Settlements: Hawaii. Wailuku. Alexander House: Alexander House, Wailuku, Hawaii: Japanese nurse girls.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2743.2

Human Generated Data

Title

Social Settlements: Hawaii. Wailuku. Alexander House: Alexander House, Wailuku, Hawaii: Japanese nurse girls.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2743.2

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 99.1
Human 99.1
Person 98.6
Apparel 98.2
Clothing 98.2
Outdoors 79.2
Plant 74.4
People 72.2
Hat 67.1
Face 65.6
Tree 63.4
Nature 61.4
Photography 60.9
Portrait 60.9
Photo 60.9
Child 59.6
Kid 59.6
Bonnet 59.2
Porch 57.7
Grass 55.1

Clarifai
created on 2019-06-05

people 100
child 99.8
group 99.2
two 98.7
wear 98.6
adult 98.5
woman 96.5
one 94.5
group together 94.3
offspring 93.5
three 92.5
sibling 92
home 91.8
boy 91.7
several 91
many 89.9
music 89.5
portrait 89.4
administration 88.8
recreation 86.4

Imagga
created on 2019-06-05

statue 29.5
sculpture 26.1
musical instrument 25.8
art 21
wind instrument 20.6
old 19.5
accordion 17.9
child 17.9
antique 17.3
portrait 16.8
man 16.8
person 16.5
religion 16.1
face 15.6
ancient 15.6
culture 15.4
detail 15.3
world 14.7
stone 14.5
people 14.5
keyboard instrument 14.3
architecture 13.3
monument 13.1
historic 12.8
adult 12.6
history 12.5
god 12.4
building 12.3
religious 12.2
male 12.1
marble 11.6
mask 11.1
head 10.9
dress 10.8
decoration 10.3
famous 10.2
city 10
free-reed instrument 9.9
theater 9.8
vintage 9.1
human 9
closeup 8.8
catholic 8.8
concertina 8.6
fur coat 8.6
classical 8.6
historical 8.5
costume 8.4
dark 8.3
church 8.3
traditional 8.3
fashion 8.3
tourism 8.3
makeup 8.2
coat 8.2
style 8.2
romantic 8
hair 7.9
look 7.9
disguise 7.9
travel 7.7
golden 7.7
men 7.7
attractive 7.7
faith 7.7
outdoor 7.6
mother 7.6
decorative 7.5
black 7.4
tourist 7.4
lady 7.3
color 7.2
holiday 7.2
cemetery 7.1
device 7.1
summer 7.1

Google
created on 2019-06-05

Photograph 96.1
People 93.9
Snapshot 86.7
Monochrome 72.4
Tree 68.7
Black-and-white 68.3
Photography 67.8
Child 67.1
Adaptation 67
Vintage clothing 65.4
Family 58.3
Style 51

Microsoft
created on 2019-06-05

outdoor 99.5
clothing 96.2
grass 95.9
person 90.5
dress 66.1
woman 51
footwear 51

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Female, 88.5%
Calm 89.9%
Angry 0.6%
Sad 6%
Happy 1.6%
Confused 0.4%
Surprised 0.6%
Disgusted 0.8%

AWS Rekognition

Age 26-43
Gender Female, 52.5%
Calm 45.1%
Disgusted 45.1%
Angry 45.6%
Happy 45.1%
Sad 54%
Surprised 45.1%
Confused 45.1%

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Categories

Imagga

interior objects 68.1%
paintings art 24.3%
streetview architecture 3.1%
events parties 1.9%

Captions

Microsoft
created on 2019-06-05

a vintage photo of a girl 87.2%
a vintage photo of a person 87.1%
a vintage photo of some people 87%