Human Generated Data

Title

Social Settlements: United States. Illinois. Quincy. "Cheerful Home Settlement": Cheerful Home Settlement, Quincy, Ill.: Kindergarten.
Date

c. 1908
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2905.2

Human Generated Data

Title

Social Settlements: United States. Illinois. Quincy. "Cheerful Home Settlement": Cheerful Home Settlement, Quincy, Ill.: Kindergarten.

People

Artist: Unidentified Artist,

Date

c. 1908

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2905.2

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 98.8
Person 98.8
Person 98.8
Person 98.5
Person 98
Person 97.8
Person 97.6
Person 97.6
Person 97.2
Person 96.9
Person 94
Clothing 92.9
Apparel 92.9
Person 92.7
Person 91.9
Painting 90.6
Art 90.6
Person 88.1
People 86.6
Person 85.8
Person 81.8
Person 78.4
Coat 64.9
Funeral 64.2
Overcoat 55.6
Person 54.1
Person 42.5

Clarifai
created on 2019-06-05

people 100
group 99.7
many 99.6
adult 98.4
group together 97.8
leader 96.9
administration 96.7
wear 95.8
child 95.3
woman 93.8
outfit 90.8
royalty 90.2
man 90
offspring 88.5
several 85.8
sibling 76.9
elderly 76.7
military 76.6
monarch 75.3
crowd 75.3

Imagga
created on 2019-06-05

kin 89.1
art 19.1
cemetery 18.5
people 17.3
person 15.2
silhouette 14.9
black 14.8
dress 14.4
religion 14.3
old 13.9
happiness 13.3
traditional 13.3
decoration 13.2
couple 13.1
party 12.9
happy 12.5
design 12.4
man 12.2
celebration 11.9
bride 11.9
family 11.6
groom 11.3
style 11.1
portrait 11
fashion 10.5
fun 10.5
statue 10.4
love 10.2
dark 10
performer 9.8
color 9.4
bouquet 9.4
grunge 9.4
male 9.2
wedding 9.2
vintage 9.1
ceremony 8.7
adult 8.7
holiday 8.6
monument 8.4
sport 8.2
dance 8.1
group 8.1
detail 8
light 8
sculpture 8
hair 7.9
women 7.9
flowers 7.8
bridal 7.8
fear 7.7
window 7.7
culture 7.7
card 7.6
elegance 7.5
clothing 7.5
historical 7.5
mother 7.4
tradition 7.4
costume 7.3
sexy 7.2
outfit 7.2
history 7.1
night 7.1

Google
created on 2019-06-05

People 96.4
Photograph 95
Vintage clothing 74
Family 71.4
History 54.1
Collection 54

Microsoft
created on 2019-06-05

posing 99.8
person 99.8
group 99.1
old 98.8
clothing 98.7
smile 90.2
standing 89.7
woman 83.7
black 81.6
man 76.1
human face 75.6
white 65
team 50.7
vintage 37.7
clothes 22.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Female, 50.6%
Happy 45.1%
Surprised 45.1%
Angry 45.2%
Sad 47.4%
Confused 45.1%
Disgusted 45.1%
Calm 51.9%

AWS Rekognition

Age 4-9
Gender Female, 54.8%
Calm 47.8%
Surprised 45.6%
Disgusted 45.4%
Confused 45.3%
Sad 45.8%
Happy 49.4%
Angry 45.6%

AWS Rekognition

Age 27-44
Gender Female, 51.6%
Disgusted 45.1%
Sad 47.8%
Calm 50.7%
Happy 45.1%
Confused 45.4%
Surprised 45.3%
Angry 45.6%

AWS Rekognition

Age 4-9
Gender Female, 54.9%
Sad 45.1%
Disgusted 45.1%
Surprised 45.2%
Angry 45.2%
Happy 53.8%
Calm 45.4%
Confused 45.1%

AWS Rekognition

Age 4-9
Gender Female, 50.2%
Angry 52.8%
Happy 45%
Disgusted 45%
Sad 47%
Confused 45%
Calm 45%
Surprised 45%

AWS Rekognition

Age 10-15
Gender Female, 53.1%
Happy 45%
Disgusted 45%
Confused 45%
Angry 45.1%
Surprised 45.1%
Sad 45.7%
Calm 54%

AWS Rekognition

Age 4-9
Gender Female, 52.6%
Disgusted 45%
Confused 45.3%
Angry 45.3%
Calm 52.7%
Surprised 45.3%
Happy 45%
Sad 46.4%

AWS Rekognition

Age 1-5
Gender Female, 50%
Calm 50.5%
Surprised 45.2%
Disgusted 45.1%
Confused 45.6%
Happy 45.2%
Angry 46.6%
Sad 46.8%

AWS Rekognition

Age 4-9
Gender Female, 54.8%
Disgusted 45.1%
Confused 45.1%
Angry 45.2%
Calm 45.9%
Surprised 45.1%
Happy 45.2%
Sad 53.4%

AWS Rekognition

Age 2-5
Gender Male, 53.3%
Surprised 45.2%
Confused 45.2%
Sad 46.3%
Disgusted 45.1%
Calm 52.3%
Angry 46%
Happy 45%

AWS Rekognition

Age 4-9
Gender Male, 52.6%
Sad 48%
Angry 46.4%
Calm 48.2%
Confused 45.4%
Happy 46.1%
Surprised 45.4%
Disgusted 45.6%

AWS Rekognition

Age 11-18
Gender Female, 53.5%
Disgusted 45.9%
Surprised 48.8%
Confused 46%
Sad 47.8%
Angry 45.7%
Calm 45.4%
Happy 45.4%

AWS Rekognition

Age 19-36
Gender Female, 53.7%
Disgusted 45%
Happy 45%
Confused 45%
Sad 54.7%
Angry 45.2%
Surprised 45%
Calm 45%

AWS Rekognition

Age 4-9
Gender Female, 50.8%
Surprised 45.3%
Happy 45.1%
Confused 45.8%
Sad 48.7%
Calm 48.6%
Disgusted 45.1%
Angry 46.5%

AWS Rekognition

Age 10-15
Gender Female, 54.9%
Happy 49.3%
Disgusted 45.5%
Sad 45.7%
Confused 45.5%
Angry 46.2%
Surprised 46%
Calm 46.9%

AWS Rekognition

Age 4-9
Gender Male, 50.6%
Calm 50.8%
Angry 45.4%
Disgusted 45.1%
Sad 47.5%
Surprised 45.3%
Happy 45.3%
Confused 45.5%

AWS Rekognition

Age 1-5
Gender Female, 54.9%
Confused 47.6%
Calm 45.9%
Angry 45.6%
Sad 46.9%
Happy 48.2%
Disgusted 45.2%
Surprised 45.6%

AWS Rekognition

Age 2-5
Gender Female, 54.1%
Confused 45.8%
Disgusted 45.1%
Happy 45.1%
Calm 46.2%
Surprised 45.2%
Sad 50.3%
Angry 47.3%

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 15
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 16
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 41
Gender Female

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Painting 90.6%

Categories

Imagga

people portraits 96.5%
events parties 1.9%
paintings art 1.1%