Human Generated Data

Title

Social Settlements: United States. District of Columbia. Washington. Noel House: Noel House, Washington, D.C.: A cooking lesson.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.396.1

Human Generated Data

Title

Social Settlements: United States. District of Columbia. Washington. Noel House: Noel House, Washington, D.C.: A cooking lesson.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.1
Person 99.1
Person 99
Person 97.7
Person 94.4
Person 92.5
Person 85.2
Person 78.3
People 74.9
Workshop 74.1
Room 74.1
Indoors 74.1
School 73.9
Lab 67.8
Building 66.2
Classroom 59.9
Cafeteria 57.4
Restaurant 57.4
Apparel 55.7
Clothing 55.7

Clarifai
created on 2019-06-05

people 100
group 99.7
adult 98.5
many 98.2
several 97.8
group together 96.4
leader 95.7
five 95.5
woman 94.7
administration 94.3
man 94.2
sit 92.9
furniture 91.3
child 90.7
three 90.5
two 87.3
wear 86.8
four 85.7
medical practitioner 83.1
offspring 82.5

Imagga
created on 2019-06-05

home 39.1
man 34.9
person 33.4
adult 32
people 30.1
room 29.3
male 28.4
indoors 27.2
happy 23.8
sitting 23.2
couple 22.6
smiling 21.7
lifestyle 21.7
senior 17.8
interior 17.7
computer 17.6
looking 17.6
happiness 17.2
casual 16.9
clothing 16.8
indoor 16.4
laptop 16.4
house 15.9
portrait 15.5
elderly 15.3
desk 14.7
men 14.6
smile 14.2
women 14.2
adults 14.2
teacher 14.1
mature 13.9
color 13.9
classroom 13.9
camera 13.9
cheerful 13.8
chair 13.6
mid adult 13.5
living 13.3
together 13.1
face 12.8
life 12.8
relaxing 12.7
couch 12.6
old 12.5
scholar 12.3
table 12.2
education 12.1
office 12.1
20s 11.9
two 11.9
leisure 11.6
family 11.6
business 11.5
nurse 11.5
retirement 11.5
groom 11.1
love 11
alone 11
horizontal 10.9
retired 10.7
mother 10.4
book 10.1
aged 9.9
cup 9.9
intellectual 9.8
brown hair 9.8
businessman 9.7
older 9.7
domestic 9.7
professional 9.6
boy 9.6
age 9.5
day 9.4
attractive 9.1
pensioner 8.8
two people 8.7
30s 8.7
loving 8.6
floor 8.4
student 8.3
child 8.1
new 8.1
handsome 8
husband 8
25 30 years 7.8
casual clothing 7.8
shop 7.8
pretty 7.7
work 7.6
relax 7.6
sit 7.6
relaxation 7.5
fun 7.5
one 7.5
kin 7.3
school 7.3
lady 7.3
children 7.3
group 7.3
suit 7.2
world 7.1
to 7.1
modern 7

Google
created on 2019-06-05

Photograph 96.6
Snapshot 86
Room 76.5
Vintage clothing 69.4
Adaptation 67
History 66.1
Photography 62.4
Retro style 61.5
Stock photography 59.4
Family 59.2
Art 58.1

Microsoft
created on 2019-06-05

person 98.6
clothing 98.5
old 85.1
table 83.3
furniture 81.9
people 80
box 75.1
woman 74.2
photograph 68
group 66.8
smile 61.8
posing 39.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-55
Gender Male, 54.5%
Calm 46.5%
Disgusted 45%
Surprised 45.1%
Confused 45.1%
Angry 45.1%
Sad 48.1%
Happy 50%

AWS Rekognition

Age 16-27
Gender Male, 50.3%
Angry 45.6%
Sad 49.7%
Disgusted 45.4%
Happy 45.2%
Confused 45.8%
Calm 48%
Surprised 45.3%

AWS Rekognition

Age 26-43
Gender Female, 54%
Disgusted 45.3%
Surprised 45.3%
Sad 49.9%
Angry 48.6%
Happy 45.3%
Confused 45.3%
Calm 45.3%

AWS Rekognition

Age 17-27
Gender Female, 53.9%
Surprised 45.2%
Happy 45.4%
Confused 45.4%
Calm 47.7%
Disgusted 45.2%
Sad 50.7%
Angry 45.4%

AWS Rekognition

Age 27-44
Gender Male, 53.4%
Confused 45.5%
Sad 47.8%
Disgusted 45.1%
Angry 45.6%
Happy 46.1%
Calm 49.7%
Surprised 45.3%

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 43
Gender Male

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a vintage photo of a group of people sitting at a table 88.7%
a vintage photo of a group of people sitting around a table 87.4%
an old photo of a group of people sitting at a table 87.3%

Text analysis

Amazon

A
Cooking
A Cooking LeSSoN
LeSSoN

Google

A
Cooking
A Cooking Lesson.
Lesson.