Human Generated Data

Title

Social Settlements: United States. Alabama. Calhoun. "Calhoun Colored School": Calhoun Colored School, Calhoun, Ala.: A Family.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.404.2

Human Generated Data

Title

Social Settlements: United States. Alabama. Calhoun. "Calhoun Colored School": Calhoun Colored School, Calhoun, Ala.: A Family.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.404.2

Machine Generated Data

Tags

Amazon
created on 2019-06-05

People 99.7
Family 99.7
Human 99.7
Person 99
Person 98.9
Person 98.9
Person 98.7
Person 98.6
Person 98.2
Person 97.9
Person 97.3
Person 93.9
Person 93.4
Art 74.6
Painting 74.6
Apparel 63.8
Clothing 63.8

Clarifai
created on 2019-06-05

people 99.9
child 99.8
group 99.5
family 96.7
wear 96.3
group together 95.9
sibling 95.3
son 95.2
adult 95.1
offspring 94.5
many 93.9
four 93.5
five 93.1
sit 92.3
several 91.4
education 90.4
woman 89.5
man 89.1
facial expression 87.4
three 86.9

Imagga
created on 2019-06-05

kin 87.6
mother 59.4
family 45.4
parent 41.5
child 38.4
happy 37
people 35.7
couple 34.8
male 34
home 32.7
man 32.3
happiness 30.6
father 30.2
love 27.6
smiling 27.5
together 26.3
adult 25.6
lifestyle 23.9
daughter 23.7
boy 22.6
room 22.4
dad 21.8
couch 21.3
casual 20.3
indoors 20.2
husband 20.2
cheerful 19.5
smile 19.2
portrait 18.8
person 18
fun 18
senior 17.8
kid 17.7
women 16.6
two 16.1
mature 15.8
sitting 15.5
wife 15.2
cute 15.1
son 14.9
interior 14.1
20s 13.7
indoor 13.7
30s 13.5
playing 11.9
children 11.8
old 11.8
parents 11.7
house 11.7
holding 11.6
elderly 11.5
loving 11.4
face 11.4
laughing 11.3
togetherness 11.3
attractive 11.2
relaxing 10.9
joy 10.9
aged 10.9
caring 10.8
living room 10.8
mom 10.7
little 10.6
group 10.5
living 10.4
life 10.3
relationship 10.3
care 9.9
childhood 9.9
grandfather 9.8
parenthood 9.8
brother 9.7
retired 9.7
hug 9.7
adults 9.5
sit 9.5
men 9.4
kids 9.4
adorable 9.2
girls 9.1
dress 9
grandmother 8.8
thirties 8.8
clothing 8.7
day 8.6
laugh 8.6
nurse 8.6
play 8.6
emotion 8.3
romance 8
handsome 8
medical 7.9
pensioner 7.9
brown hair 7.8
boys 7.8
affection 7.7
youth 7.7
sofa 7.7
females 7.6
friends 7.5
baby 7.5
offspring 7.4
teen 7.4
new 7.3
domestic 7.2
color 7.2
looking 7.2
romantic 7.1

Google
created on 2019-06-05

Photograph 96.5
People 95.9
Snapshot 87.4
Room 71.4
Child 69.3
Adaptation 67
Family 65.2
Sitting 62.5
Photography 62.4

Microsoft
created on 2019-06-05

wall 97.8
clothing 97.2
person 96.1
baby 95.8
toddler 93.9
human face 93.3
child 90.8
smile 90.6
posing 82.7
boy 80.9
group 70.3
photograph 69.9
woman 54.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 51.7%
Sad 45.1%
Angry 45.1%
Calm 45.1%
Confused 45%
Happy 45%
Disgusted 54.7%
Surprised 45%

AWS Rekognition

Age 35-53
Gender Female, 50.6%
Disgusted 45.8%
Confused 45.3%
Happy 45.3%
Calm 45.7%
Surprised 45.2%
Sad 52.3%
Angry 45.4%

AWS Rekognition

Age 57-77
Gender Male, 53.7%
Disgusted 48%
Surprised 45.2%
Sad 46.4%
Angry 47.1%
Happy 45.2%
Confused 45.8%
Calm 47.3%

AWS Rekognition

Age 48-68
Gender Female, 51.8%
Confused 45.3%
Happy 45.7%
Sad 47.7%
Disgusted 47.2%
Angry 46%
Calm 47.6%
Surprised 45.4%

AWS Rekognition

Age 48-68
Gender Female, 51.6%
Happy 45.1%
Disgusted 45.1%
Angry 45.1%
Confused 45.1%
Calm 45.1%
Surprised 45%
Sad 54.5%

AWS Rekognition

Age 26-43
Gender Female, 54.9%
Surprised 45.3%
Sad 50.8%
Disgusted 45.3%
Calm 45.3%
Happy 47.7%
Angry 45.3%
Confused 45.4%

AWS Rekognition

Age 10-15
Gender Female, 54.9%
Disgusted 45.5%
Confused 45.4%
Calm 45.2%
Surprised 45.3%
Happy 45.6%
Sad 51.5%
Angry 46.7%

AWS Rekognition

Age 12-22
Gender Female, 54.6%
Confused 45.3%
Calm 46.2%
Disgusted 45.3%
Sad 51.7%
Happy 45.5%
Angry 45.7%
Surprised 45.3%

AWS Rekognition

Age 27-44
Gender Female, 53%
Surprised 45%
Happy 45.1%
Confused 45.1%
Calm 45.1%
Disgusted 45.1%
Angry 45.3%
Sad 54.2%

AWS Rekognition

Age 17-27
Gender Female, 54%
Calm 45.5%
Sad 54.1%
Surprised 45.1%
Angry 45.1%
Happy 45.1%
Confused 45.1%
Disgusted 45.1%

AWS Rekognition

Age 23-38
Gender Female, 54.7%
Angry 45.6%
Calm 45.3%
Disgusted 45.5%
Surprised 45.4%
Sad 48.5%
Happy 49.4%
Confused 45.4%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 16
Gender Male

Microsoft Cognitive Services

Age 25
Gender Male

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Painting 74.6%

Categories

Imagga

people portraits 58.5%
paintings art 15.2%
events parties 14.9%
food drinks 4.5%
interior objects 3.4%
pets animals 2.4%

Text analysis

Amazon

A
A Family.
Family.

Google

Fomily A
Fomily
A