Human Generated Data

Title

Social Settlements: United States. Massachusetts, Northampton. "Home Culture Club": The Home Culture Clubs, Northampton, Mass.: Home-Culture Clubs. Carnegie House.: A Reading Class, Room 17.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.229.3

Human Generated Data

Title

Social Settlements: United States. Massachusetts, Northampton. "Home Culture Club": The Home Culture Clubs, Northampton, Mass.: Home-Culture Clubs. Carnegie House.: A Reading Class, Room 17.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Human 99.8
Person 99.8
Person 99.6
Person 94.5
Person 87.9
Crowd 81.9
Person 81.7
Indoors 68.2
Room 68.2
Bowl 62.4
Text 60
Art 59.8
Sitting 55.1

Imagga
created on 2022-06-25

man 37
couple 30.5
people 29.6
male 28.9
happy 27.6
home 26.3
adult 24.3
smiling 23.9
table 23.6
sitting 23.2
meeting 22.6
restaurant 22.6
indoors 22
grandfather 21.8
office 20.9
business 20.1
happiness 19.6
men 18.9
cheerful 18.7
women 18.2
family 17.8
person 17.5
smile 17.1
group 16.9
meal 16.9
dinner 16.8
eating 16.8
room 16.2
lifestyle 15.9
businessman 15.9
love 15.8
child 15.7
lunch 14.9
together 14.9
holding 14.9
food 14.7
businesswoman 14.6
drink 14.2
dad 14.2
attractive 14
couch 13.5
mother 13.4
adults 13.3
togetherness 13.2
laptop 13.1
senior 13.1
corporate 12.9
kin 12.6
father 12.3
executive 12.3
color 12.2
boy 12.2
coffee 12.1
parent 11.9
work 11.8
team 11.7
desk 11.5
kitchen 11.2
suit 11
indoor 11
cup 10.9
30s 10.6
groom 10.6
elderly 10.5
businesspeople 10.4
waiter 10.4
friends 10.3
face 10
two people 9.7
having 9.7
looking 9.6
talking 9.5
day 9.4
teamwork 9.3
breakfast 9.3
20s 9.2
beverage 9.1
children 9.1
fun 9
celebration 8.8
partners 8.8
husband 8.7
glass 8.7
married 8.6
dining 8.6
wine 8.5
two 8.5
enjoyment 8.5
portrait 8.4
presentation 8.4
mature 8.4
romantic 8
working 8
20 24 years 7.9
businesswomen 7.9
daughter 7.9
brunette 7.8
brown hair 7.8
domestic 7.8
discussion 7.8
clothing 7.7
pretty 7.7
expression 7.7
four 7.7
drinking 7.7
wife 7.6
computer 7.6
kids 7.5
alcohol 7.5
son 7.5
leisure 7.5
emotion 7.4
friendly 7.3
success 7.2
worker 7.1
kid 7.1
brother 7

Google
created on 2022-06-25

Microsoft
created on 2022-06-25

person 99.9
wall 98.7
table 98.6
indoor 97.9
sitting 97.6
human face 96.6
clothing 94.1
man 86.8
people 75.7
group 74.3
text 62.6
smile 60.6
meal 17.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-14
Gender Female, 100%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0%
Confused 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 47-53
Gender Male, 99.2%
Fear 39.6%
Angry 36.6%
Calm 19.9%
Surprised 7.1%
Sad 3%
Confused 2.7%
Disgusted 1.1%
Happy 0.8%

AWS Rekognition

Age 28-38
Gender Female, 54.4%
Sad 79.9%
Fear 29.9%
Calm 22.5%
Surprised 10.7%
Angry 2.2%
Disgusted 1.9%
Confused 0.9%
Happy 0.7%

Microsoft Cognitive Services

Age 15
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of people sitting at a table 98.2%
a group of people sitting around a table 98.1%
a group of people sitting at a table eating food 93.6%

Text analysis

Amazon

SDt21

Google

S9