Human Generated Data

Title

Social Settlements: Hawaii. Wailuku. Alexander House: Alexander House, Wailuku, Hawaii: Kindergarten - boy. Half Chinese, half Japanese
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2741.4

Human Generated Data

Title

Social Settlements: Hawaii. Wailuku. Alexander House: Alexander House, Wailuku, Hawaii: Kindergarten - boy. Half Chinese, half Japanese

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 97.6
Human 97.6
Art 92.8
Drawing 82.7
Painting 78.5
Photo 62.7
Photography 62.7
Sketch 57.7
Portrait 57.3
Face 57.3
Clothing 56.8
Apparel 56.8

Clarifai
created on 2019-06-05

people 99.9
child 98.5
adult 98.4
one 98.4
wear 96.7
portrait 95.3
woman 95.1
two 90.8
group 90.2
man 86.9
son 82.5
girl 82.4
art 80.8
music 79.9
boy 77.6
painting 76
baby 74.4
dress 74.2
retro 73.9
elderly 72

Imagga
created on 2019-06-05

child 39.7
hay 37.8
field 37.7
people 29
summer 28.3
country 27.2
portrait 27.2
adult 26.6
person 25.9
model 23.3
straw 23.2
happiness 22.7
outdoors 22.4
happy 21.3
pretty 21
attractive 21
farm 20.5
rural 20.3
smiling 20.3
outdoor 19.9
women 19.8
youth 19.6
face 18.5
joy 18.4
countryside 18.3
fashion 18.1
fun 17.2
male 17.1
smile 17.1
hair 15.9
grass 15.8
cute 15.8
barn 15.7
cheerful 14.6
lifestyle 14.5
sexy 14.5
posing 14.2
agriculture 14
bales 13.8
wheat 13.8
outside 13.7
human 13.5
meadow 13.5
man 13.4
farming 13.3
relaxation 12.6
autumn 12.3
blond 12.2
lady 12.2
boy 12.2
mother 12
freedom 11.9
gorgeous 11.8
day 11.8
sunny 11.2
girls 10.9
leisure 10.8
family 10.7
parent 10.6
harvest 10.3
rest 10.2
relax 10.1
children 10
smooth 10
dress 9.9
bale 9.9
western 9.7
sun 9.7
brunette 9.6
couple 9.6
kin 9.6
forest 9.6
brown 9.6
jeans 9.6
love 9.5
sitting 9.5
crop 9.4
teenager 9.1
holding 9.1
active 9
one 9
bails 8.9
kid 8.9
cowboy 8.8
umbrella 8.7
natural 8.7
yellow 8.6
golden 8.6
men 8.6
juvenile 8.6
serious 8.6
farmer 8.5
two 8.5
skin 8.5
health 8.3
sky 8.3
joyful 8.3
park 8.2
eye 8
cereal 8
look 7.9
clothing 7.8
groom 7.8
laying 7.8
farmland 7.7
hat 7.7
teenage 7.7
legs 7.6
free 7.5
relaxed 7.5
emotion 7.4
teen 7.4
life 7.3
sensuality 7.3
pose 7.2
looking 7.2
childhood 7.2
canopy 7.1

Google
created on 2019-06-05

Adaptation 74.1
Art 62.5
Picture frame 57.9
Vintage clothing 57
Child 52

Microsoft
created on 2019-06-05

human face 98.2
clothing 97.2
person 97.1
smile 94.4
toddler 86.5
old 71.7
girl 71.6
child 69.4
baby 64.3
posing 41.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-7
Gender Female, 99.6%
Happy 62.3%
Sad 16.2%
Surprised 4.2%
Angry 3.9%
Calm 4.5%
Disgusted 5.1%
Confused 3.7%

Microsoft Cognitive Services

Age 8
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.6%
Painting 78.5%

Captions

Microsoft

an old photo of a person 69%
an old photo of a person 66.1%
an old photo of a girl 48.6%