Human Generated Data

Title

Social Settlements: Philippine Islands. Manila. "Settlement House": Settlement House, Manila, P.I.: Scenes on the Playground.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2752.1

Human Generated Data

Title

Social Settlements: Philippine Islands. Manila. "Settlement House": Settlement House, Manila, P.I.: Scenes on the Playground.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2752.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.6
Person 99.6
Person 99.1
Person 98.9
Apparel 94.4
Clothing 94.4
People 77.5
Shorts 71.7
Face 69.7
Duel 56.2
Sailor Suit 56.1

Clarifai
created on 2019-06-05

people 100
group 98.9
adult 98.5
group together 98.2
wear 97
two 96.8
leader 95.7
man 95.6
three 95.5
several 95.2
administration 94.7
five 93.4
many 93.1
military 91.8
four 90.8
war 86.5
portrait 86.2
child 84.4
veil 84.3
outfit 83.2

Imagga
created on 2019-06-05

kin 38.1
couple 26.1
grandma 25.8
statue 22.6
old 21.6
grandfather 20.9
man 20.2
sculpture 19.7
senior 19.7
male 19.2
people 19
happiness 16.4
religion 15.2
home 15.2
women 15
art 14.5
mother 14.5
dress 14.4
elderly 14.4
love 14.2
adult 14.1
monument 14
ancient 13.8
happy 13.8
history 13.4
culture 12.8
smiling 12.3
portrait 12.3
stone 12.1
men 12
person 11.9
two 11.9
marble 11.6
family 11.6
bride 11.5
church 11.1
face 10.6
groom 10.5
wife 10.4
architecture 10.2
husband 10.1
lifestyle 10.1
wedding 10.1
historic 10.1
travel 9.9
together 9.6
retirement 9.6
antique 9.5
mature 9.3
smile 9.3
tourism 9.1
park 9.1
aged 9
indoors 8.8
retired 8.7
married 8.6
god 8.6
religious 8.4
camera 8.3
outdoors 8.2
lady 8.1
catholic 8
70s 7.9
memorial 7.8
room 7.8
sibling 7.7
health 7.6
marriage 7.6
bouquet 7.5
historical 7.5
gown 7.5
traditional 7.5
clothing 7.5
vintage 7.4
tourist 7.3
day 7.1
look 7

Google
created on 2019-06-05

Photograph 97
People 95
Standing 94.1
Snapshot 85.4
Vintage clothing 71.2
Photography 62.4
Family 62.3
Black-and-white 56.4
Gesture 55.8

Microsoft
created on 2019-06-05

person 100
clothing 99.3
posing 97.4
standing 96.7
old 94.5
smile 93
human face 91.6
black 89.3
outdoor 86.2
group 85.2
white 71.1
boy 64
man 60.8
people 57.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-36
Gender Female, 74.7%
Sad 91.3%
Disgusted 1.5%
Confused 0.8%
Happy 1%
Calm 1.5%
Surprised 0.5%
Angry 3.4%

AWS Rekognition

Age 15-25
Gender Male, 98.5%
Surprised 0.8%
Angry 2.6%
Disgusted 1.2%
Happy 0.9%
Calm 34.3%
Sad 57.2%
Confused 3%

AWS Rekognition

Age 23-38
Gender Male, 70.5%
Calm 25.6%
Sad 52%
Surprised 3.5%
Disgusted 3.9%
Happy 3%
Angry 5.8%
Confused 6.2%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 11
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Likely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Categories

Imagga

paintings art 81.7%
streetview architecture 10.8%
people portraits 7.2%

Text analysis

Amazon

swu
swu U
U