Human Generated Data

Title

Social Settlements: United States. Massachusetts. Northampton. "Home Culture Club": The Home Culture Clubs, Northampton, Mass.: Home-Culture Clubs, Northampton, Mass.: A Class in Algebra, Room 13.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3096.2

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Northampton. "Home Culture Club": The Home Culture Clubs, Northampton, Mass.: Home-Culture Clubs, Northampton, Mass.: A Class in Algebra, Room 13.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3096.2

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Clothing 100
Apparel 100
Human 99.7
Person 99.7
Person 99.5
Person 99.2
Person 96.7
Hat 90.7
Cowboy Hat 89.4
Sun Hat 85

Clarifai
created on 2019-06-06

people 99.7
group 98.4
man 96.7
adult 96.4
woman 95.4
group together 93.6
several 91.9
three 91.1
administration 91
child 90.8
four 90.5
sit 88.1
five 88
wear 87.3
outfit 86.4
war 86
two 82.9
book series 82.7
recreation 81.1
music 80.6

Imagga
created on 2019-06-06

man 41
male 35.5
people 34.6
person 32.4
office 30.3
newspaper 29.1
meeting 27.3
business 26.7
home 24.7
businessman 23.8
desk 22.8
adult 22.6
group 22.6
professional 22.5
team 22.4
sitting 22.3
table 21.7
product 21.1
kin 20.1
computer 20
happy 18.2
smiling 18.1
work 18
corporate 18
men 18
room 17.3
laptop 17.3
businesswoman 17.3
couple 16.5
creation 16.4
senior 15.9
job 15.9
executive 15.9
together 15.8
teacher 15.5
classroom 15.2
businesspeople 15.2
education 14.7
working 14.1
colleagues 13.6
suit 13.6
smile 13.5
talking 13.3
worker 12.5
indoors 12.3
teamwork 12.1
life 11.8
communication 11.8
child 11.6
family 11.6
patient 11.4
manager 11.2
casual 11
portrait 11
occupation 11
discussion 10.7
women 10.3
mature 10.2
lifestyle 10.1
indoor 10
school 10
handsome 9.8
parent 9.8
conference 9.8
interior 9.7
looking 9.6
book 9.5
workplace 9.5
reading 9.5
tie 9.5
adults 9.5
paper 9.4
happiness 9.4
friends 9.4
jacket 9.4
glasses 9.3
attractive 9.1
old 9.1
cheerful 8.9
student 8.9
to 8.8
father 8.8
case 8.8
partners 8.7
retired 8.7
pen 8.7
boss 8.6
show 8.5
grandfather 8.5
document 8.4
black 8.4
presentation 8.4
dad 8.3
mother 8
debate 7.9
husband 7.9
client 7.8
40s 7.8
color 7.8
class 7.7
elderly 7.7
nurse 7.6
two 7.6
writing 7.6
career 7.6
phone 7.4
successful 7.3
scholar 7.3
confident 7.3
success 7.2
spectator 7.2
love 7.1

Google
created on 2019-06-06

Photograph 95.9
Snapshot 85.4
Art 62.5
Photography 62.4

Microsoft
created on 2019-06-06

wall 96.2
sitting 95.7
clothing 93.8
person 89.3
text 88.1
man 84.8
black 76.8
book 71.6
old 61.1
newspaper 58.1
human face 52.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 11-18
Gender Male, 99.3%
Angry 37.2%
Surprised 1.7%
Disgusted 6.2%
Sad 17.5%
Happy 1.2%
Confused 9.9%
Calm 26.3%

AWS Rekognition

Age 26-43
Gender Male, 94.3%
Confused 14.5%
Sad 21.4%
Disgusted 12.9%
Angry 21.1%
Happy 2.7%
Calm 17.1%
Surprised 10.4%

AWS Rekognition

Age 35-52
Gender Male, 93.6%
Disgusted 3.6%
Surprised 3.1%
Sad 8.5%
Angry 9.4%
Happy 1.6%
Confused 2.5%
Calm 71.3%

Microsoft Cognitive Services

Age 25
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Categories

Imagga

paintings art 59.9%
food drinks 28.3%
people portraits 8.7%

Captions

Microsoft
created on 2019-06-06

a vintage photo of a man 88.5%
a black and white photo of a man 83.9%
an old photo of a man 83.8%

Text analysis

Amazon

A
in
Algebro,
A C'less in Algebro, 0om3.
C'less
0om3.

Google

A Class 1n Algebro, Room 13
A
Class
1n
Algebro,
Room
13