Human Generated Data

Title

Social Settlements: United States. Massachusetts, Northampton. "Home Culture Club": The Home Culture Clubs, Northampton, Mass.: Home-Culture Clubs. Carnegie House.: Six Small Classes in the Art Room.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.229.4

Human Generated Data

Title

Social Settlements: United States. Massachusetts, Northampton. "Home Culture Club": The Home Culture Clubs, Northampton, Mass.: Home-Culture Clubs. Carnegie House.: Six Small Classes in the Art Room.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Human 99.6
Person 99.6
Person 94.6
Person 93.5
Person 91.1
Clock Tower 89.5
Building 89.5
Architecture 89.5
Tower 89.5
Restaurant 89.3
Person 86.8
Indoors 84.9
Room 84.9
Person 84.2
Person 78.3
Furniture 69.3
Cafeteria 64.7
Person 63.8
Cafe 60.5
Classroom 58.8
School 58.8
Clinic 57
Chair 55.7

Imagga
created on 2022-06-25

shop 100
barbershop 100
mercantile establishment 84.7
place of business 56.6
man 39
room 30.3
establishment 28.3
people 27.3
male 24.8
chair 22.7
person 22.6
classroom 21.6
indoors 19.3
men 17.2
smiling 16.6
business 16.4
adult 16.3
hairdresser 15.7
education 14.7
table 14.7
interior 14.1
work 14.1
office 13.8
teacher 13.1
group 12.9
occupation 12.8
computer 12.8
student 12.7
board 12.6
school 12.6
working 12.4
lifestyle 12.3
sitting 12
home 12
back 11.9
class 11.6
senior 11.2
restaurant 10.7
businessman 10.6
studying 10.5
mature 10.2
black 10.2
inside 10.1
happy 10
furniture 10
modern 9.8
teenager 9.1
holding 9.1
seat 9
to 8.8
students 8.8
together 8.8
professional 8.7
couple 8.7
happiness 8.6
barber chair 8.6
college 8.5
study 8.4
blackboard 8.1
hands 7.8
teaching 7.8
portrait 7.8
corporate 7.7
uniform 7.7
old 7.7
adults 7.6
communication 7.6
meeting 7.5
human 7.5
phone 7.4
worker 7.3
indoor 7.3
girls 7.3
family 7.1
job 7.1
employee 7

Google
created on 2022-06-25

Microsoft
created on 2022-06-25

person 92.2
table 91.7
outdoor 91
furniture 89.1
clothing 87.3
text 79.2
chair 77.5
group 70.4
white 61.9
old 51.6
restaurant 31.5

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Male, 99.5%
Calm 82.1%
Surprised 20.1%
Fear 5.9%
Sad 2.3%
Confused 0.8%
Angry 0.5%
Happy 0.4%
Disgusted 0.3%

AWS Rekognition

Age 48-54
Gender Female, 90.6%
Calm 82%
Happy 10.4%
Surprised 6.6%
Fear 6%
Confused 3.9%
Sad 2.7%
Angry 0.5%
Disgusted 0.4%

AWS Rekognition

Age 6-16
Gender Female, 96.8%
Sad 97.4%
Angry 38.7%
Surprised 6.5%
Fear 6.1%
Calm 4.5%
Happy 2.6%
Disgusted 0.5%
Confused 0.4%

AWS Rekognition

Age 18-24
Gender Female, 66.7%
Calm 97.4%
Surprised 6.6%
Fear 6%
Sad 2.4%
Happy 0.3%
Disgusted 0.3%
Angry 0.2%
Confused 0.1%

AWS Rekognition

Age 20-28
Gender Male, 98.2%
Calm 96.8%
Surprised 6.3%
Fear 6%
Sad 2.6%
Confused 0.7%
Angry 0.3%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 16-22
Gender Male, 62%
Calm 56.3%
Disgusted 25%
Happy 12.9%
Surprised 6.6%
Fear 6%
Sad 2.6%
Confused 2.5%
Angry 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.6%
Clock Tower 89.5%
Chair 55.7%

Captions

Microsoft

a group of people standing in front of a building 87.3%
a group of people standing in a room 87.2%
a group of people standing in front of a restaurant 87.1%

Text analysis

Amazon

SD422

Google

5952