Human Generated Data

Title

Social Settlements: Philippine Islands. Manila. "Settlement House": Settlement House, Manila, P.I.: Scenes on the Playground.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2752.3

Human Generated Data

Title

Social Settlements: Philippine Islands. Manila. "Settlement House": Settlement House, Manila, P.I.: Scenes on the Playground.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2752.3

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 99.8
Human 99.8
Person 99.7
Person 99.6
Person 98.3
Person 97.7
Person 96.8
Person 95.6
Apparel 92.2
Clothing 92.2
Person 87.3
Boy 83.9
Person 72.6
Helmet 72
Hardhat 72
Sailor Suit 70.2
Shorts 69.5
People 68.1
Person 67.4
Face 65.8
Child 64.8
Kid 64.8
Urban 61.8
Soil 61.4
Building 57.5
Outdoors 55.7
Person 48.6
Person 44.7

Clarifai
created on 2019-06-05

people 100
group 99.5
child 98.6
group together 98.3
adult 97.6
many 96.7
several 96.6
war 96.1
military 94.2
administration 93.5
man 92.2
five 91.7
wear 91.6
three 90.1
boy 89.9
leader 89.7
uniform 89.2
education 87.2
soldier 86.7
four 86.5

Imagga
created on 2019-06-05

kin 90.8
man 24.9
world 22.3
people 20.1
male 19.9
person 16.4
portrait 14.9
old 13.2
religion 12.5
statue 12.5
adult 12.4
happiness 11.7
men 11.2
family 10.7
to 10.6
child 10.3
face 9.9
history 9.8
sepia 9.7
mask 9.6
couple 9.6
room 9.5
ancient 9.5
happy 9.4
mother 9.4
outdoor 9.2
vintage 9.1
dress 9
outdoors 9
memorial 8.7
love 8.7
antique 8.7
stone 8.6
work 8.6
bride 8.6
day 8.6
sculpture 8.6
religious 8.4
groom 8.4
historic 8.3
suit 8.1
businessman 7.9
boy 7.8
architecture 7.8
art 7.8
travel 7.7
war 7.7
uniform 7.6
hand 7.6
city 7.5
monument 7.5
park 7.4
church 7.4
wedding 7.4
sibling 7.3
new 7.3
protection 7.3
smiling 7.2
black 7.2

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

clothing 99.4
posing 98.9
old 98.8
person 97.4
smile 95.2
human face 94.6
group 91.9
child 87.1
outdoor 86.4
boy 85.2
man 76.9
black 71.5
vintage 64.6
school 62.5
team 35.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-9
Gender Female, 98.6%
Surprised 1.8%
Sad 84%
Calm 4.5%
Happy 2.2%
Disgusted 2.6%
Confused 0.6%
Angry 4.4%

AWS Rekognition

Age 4-9
Gender Female, 79.9%
Sad 94%
Calm 1.4%
Disgusted 0.9%
Confused 0.7%
Angry 1.7%
Surprised 0.7%
Happy 0.7%

AWS Rekognition

Age 4-9
Gender Female, 78.8%
Calm 2.2%
Confused 1.7%
Sad 5.9%
Surprised 1.5%
Happy 4.7%
Disgusted 1.6%
Angry 82.5%

AWS Rekognition

Age 26-43
Gender Female, 54.2%
Angry 49.5%
Disgusted 45.5%
Sad 46.4%
Happy 45.5%
Confused 45.4%
Surprised 45.4%
Calm 47.3%

AWS Rekognition

Age 20-38
Gender Female, 54.9%
Happy 45.8%
Disgusted 45.3%
Calm 45.9%
Sad 49.6%
Confused 45.2%
Surprised 45.3%
Angry 47.9%

AWS Rekognition

Age 6-13
Gender Female, 55%
Angry 46.1%
Sad 46.2%
Calm 48.6%
Surprised 45.6%
Confused 45.8%
Disgusted 46.5%
Happy 46.1%

AWS Rekognition

Age 29-45
Gender Female, 52.6%
Angry 45.7%
Calm 50.4%
Disgusted 46%
Happy 45.3%
Confused 45.1%
Sad 47%
Surprised 45.4%

AWS Rekognition

Age 35-52
Gender Female, 54.2%
Calm 45.1%
Angry 45.1%
Sad 54.6%
Confused 45%
Surprised 45%
Happy 45%
Disgusted 45.1%

AWS Rekognition

Age 35-52
Gender Female, 53.6%
Surprised 45.2%
Happy 45.2%
Confused 45.2%
Calm 49.7%
Disgusted 45.3%
Sad 48.5%
Angry 45.9%

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 15
Gender Male

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 3
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Categories

Imagga

people portraits 99.1%

Text analysis

Amazon

su

Google

Su
Su