Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "Neighborhood House": Neighborhood House, Chicago, Ill.: Cooking Class at Table.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2879.2

Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "Neighborhood House": Neighborhood House, Chicago, Ill.: Cooking Class at Table.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2879.2

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 99.2
Human 99.2
Person 98.5
Person 97
Person 96.7
Person 95.8
Person 95.5
Person 94.1
Furniture 93.2
Person 93
Art 91
Painting 91
People 87.4
Table 84.8
Room 81.6
Indoors 81.6
Dining Table 81.6
Food 70.2
Person 70
Person 65.2
Meal 59.4
Restaurant 57.3
Family 56.8
Food Court 56.7
Dining Room 56.6
Tablecloth 55.5

Clarifai
created on 2019-06-05

people 100
group 99.6
many 98
adult 97.6
administration 97.5
several 96.6
group together 95.8
child 94.9
leader 94.4
man 93.1
five 92.9
four 91
war 90.6
woman 88.6
furniture 87.9
room 86.7
education 85.9
sit 84.7
home 83.5
three 82.8

Imagga
created on 2019-06-05

person 31.5
adult 30.2
teacher 28.5
people 28.4
home 27.1
man 26.9
couple 25.3
room 22.5
educator 21.1
male 20
family 19.6
women 19
professional 18.6
portrait 18.1
sitting 18
senior 17.8
happiness 17.2
indoors 16.7
lifestyle 15.9
love 15.8
nurse 15.6
lady 15.4
dress 15.4
happy 15
old 13.9
two 13.5
house 13.4
interior 13.3
married 12.5
elderly 12.4
smiling 12.3
grandfather 12.2
men 12
aged 11.8
bride 11.5
luxury 11.1
smile 10.7
life 10.7
husband 10.6
couch 10.6
mother 10.6
cheerful 10.6
fashion 10.5
human 10.5
hospital 10.5
looking 10.4
mature 10.2
model 10.1
kin 10.1
child 10.1
face 9.9
sculpture 9.8
romance 9.8
health 9.7
retired 9.7
together 9.6
retirement 9.6
holding 9.1
color 8.9
celebration 8.8
two people 8.7
bouquet 8.6
loving 8.6
casual 8.5
monument 8.4
pretty 8.4
inside 8.3
wedding 8.3
care 8.2
retro 8.2
relaxing 8.2
pensioner 8.1
groom 8
romantic 8
to 8
patient 7.9
standing 7.8
antique 7.8
ancient 7.8
statue 7.7
attractive 7.7
wife 7.6
relaxation 7.5
decoration 7.3
girls 7.3
classroom 7.2
bright 7.1
father 7.1
medical 7.1
modern 7
student 7

Google
created on 2019-06-05

Photograph 95.8
People 93.4
Snapshot 83.9
Room 71.4
Family 64.1
Vintage clothing 60.9

Microsoft
created on 2019-06-05

clothing 97.9
human face 96.1
woman 95.4
person 94.5
table 86.7
man 78.4
smile 74.5
old 68.9
group 62.8
tableware 62.1
people 57.5
older 22.9
family 17.9
dining table 16

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Female, 54.8%
Angry 45.3%
Happy 45.5%
Disgusted 45.1%
Confused 45.1%
Surprised 45.2%
Sad 46.8%
Calm 52%

AWS Rekognition

Age 15-25
Gender Male, 90.6%
Sad 5.1%
Confused 0.9%
Calm 90%
Disgusted 0.7%
Happy 0.5%
Angry 1.4%
Surprised 1.4%

AWS Rekognition

Age 35-52
Gender Male, 51.4%
Disgusted 45.3%
Surprised 45.8%
Angry 47.7%
Confused 45.8%
Sad 46.5%
Calm 48.7%
Happy 45.2%

AWS Rekognition

Age 20-38
Gender Female, 52.4%
Disgusted 45.2%
Happy 45.3%
Surprised 46.8%
Angry 45.8%
Confused 45.5%
Calm 50.3%
Sad 46.2%

AWS Rekognition

Age 23-38
Gender Female, 50.1%
Sad 50.6%
Happy 45.5%
Disgusted 45.4%
Calm 46.6%
Angry 46%
Confused 45.5%
Surprised 45.4%

AWS Rekognition

Age 35-52
Gender Male, 53.7%
Calm 45.8%
Confused 45.7%
Angry 46.1%
Surprised 46.1%
Disgusted 46.3%
Sad 48.6%
Happy 46.4%

AWS Rekognition

Age 10-15
Gender Female, 51.7%
Angry 46.3%
Disgusted 45.4%
Confused 45.1%
Calm 45.3%
Happy 45.1%
Surprised 45.1%
Sad 52.8%

AWS Rekognition

Age 20-38
Gender Male, 52.3%
Surprised 45.1%
Confused 45.3%
Sad 45.4%
Disgusted 45.1%
Calm 53.8%
Angry 45.2%
Happy 45.1%

AWS Rekognition

Age 35-52
Gender Female, 54.8%
Angry 45.2%
Disgusted 45.1%
Sad 46.8%
Confused 45.4%
Happy 45.8%
Surprised 45.5%
Calm 51.2%

AWS Rekognition

Age 35-52
Gender Female, 53.1%
Disgusted 45.6%
Confused 45.7%
Happy 47%
Calm 49.9%
Surprised 45.7%
Sad 45.6%
Angry 45.5%

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 16
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 91%

Categories

Imagga

people portraits 89.7%
events parties 9.1%

Text analysis

Amazon

ST5

Google

ST
ST