Human Generated Data

Title

Social Settlements: United States. Massachusetts, Northampton. "Home Culture Club": The Home Culture Clubs, Northampton, Mass.: Home-Culture Clubs. Carnegie House.: A Class in American History.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.229.2

Human Generated Data

Title

Social Settlements: United States. Massachusetts, Northampton. "Home Culture Club": The Home Culture Clubs, Northampton, Mass.: Home-Culture Clubs. Carnegie House.: A Class in American History.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Person 99.4
Human 99.4
Person 99
Person 98.2
Person 98.1
Tie 92.6
Accessories 92.6
Accessory 92.6
Indoors 88.1
Room 87.8
Reading 87.2
Suit 79.1
Clothing 79.1
Coat 79.1
Overcoat 79.1
Apparel 79.1
Suit 76.8
Court 72.4
Suit 69.1
Furniture 62.4

Imagga
created on 2022-06-25

laptop 54.9
office 45.2
business 44.4
computer 43.5
man 38.5
person 38
work 37.7
businesswoman 36.4
people 36.3
businessman 35.3
male 34.2
adult 31.4
scholar 31.2
working 30.1
meeting 28.3
notebook 27
happy 27
professional 26.6
executive 25.9
sitting 25.8
intellectual 24.9
job 24.8
corporate 24.1
desk 24.1
room 23.4
table 22.8
group 22.6
team 22.4
worker 22.2
businesspeople 21.8
smiling 21.7
teamwork 19.5
smile 19.2
men 18.9
technology 17.8
communication 17.6
indoors 17.6
women 17.4
indoor 17.4
looking 16.8
manager 16.8
home 16.8
success 16.1
attractive 16.1
together 15.8
talking 15.2
suit 14.8
call 14.7
successful 14.6
confident 14.6
casual 14.4
face 14.2
cheerful 13.8
classroom 13.6
portrait 13.6
career 13.3
lifestyle 13
newspaper 12.8
paper 12.7
colleagues 12.6
handsome 12.5
wireless 12.4
couple 12.2
coffee 12
discussing 11.8
conference 11.7
discussion 11.7
workplace 11.4
contemporary 11.3
modern 11.2
occupation 11
happiness 11
holding 10.7
30s 10.6
females 10.4
student 10.3
mature 10.2
telephone 10
consultant 9.7
using 9.6
serious 9.5
reading 9.5
company 9.3
finance 9.3
horizontal 9.2
employee 9
product 8.9
good mood 8.8
portable computer 8.7
corporation 8.7
child 8.6
expression 8.5
smart 8.5
house 8.4
glasses 8.3
20s 8.2
clothing 8.1
interior 8
book 7.9
black 7.8
education 7.8
color 7.8
partners 7.8
couch 7.7
partner 7.7
mid adult 7.7
busy 7.7
pretty 7.7
talk 7.7
teacher 7.7
sofa 7.7
formal 7.6
two 7.6
living 7.6
leisure 7.5
one 7.5
presentation 7.4
phone 7.4
world 7.1

Google
created on 2022-06-25

Table 94.3
Photograph 94.2
Black 89.8
Desk 79.1
Monochrome 75.2
Snapshot 74.3
Event 71.7
Vintage clothing 70.9
Sharing 68.8
Monochrome photography 67.8
Conversation 66.7
Sitting 66
Room 62.7
History 62
Publication 61.5
Chair 61.2
Fun 57.9
Folk instrument 53.8
Toddler 52.7
Reading 52.2

Microsoft
created on 2022-06-25

person 99.2
sitting 96.9
book 93.4
clothing 93
indoor 90.8
human face 89.7
black and white 77.5
man 71.7
text 66.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Calm 47.2%
Surprised 17.3%
Confused 13.2%
Happy 10.6%
Fear 7.2%
Angry 5.5%
Disgusted 4.3%
Sad 3.1%

AWS Rekognition

Age 14-22
Gender Male, 99.5%
Calm 98.1%
Surprised 6.4%
Fear 6%
Sad 2.2%
Angry 0.5%
Confused 0.3%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 18-24
Gender Female, 89%
Happy 38.4%
Calm 34%
Sad 19%
Surprised 8%
Fear 6.2%
Confused 4.6%
Angry 1.2%
Disgusted 1.2%

AWS Rekognition

Age 23-31
Gender Male, 99.5%
Calm 88.8%
Fear 7.3%
Surprised 6.7%
Angry 6%
Sad 2.2%
Confused 0.3%
Happy 0.2%
Disgusted 0.2%

Microsoft Cognitive Services

Age 19
Gender Male

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Tie 92.6%
Suit 79.1%

Captions

Microsoft

a group of people sitting at a table 95.3%
a group of people sitting around a table 94.9%
a group of people sitting on a table 92.3%