Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. Hale House: Hale House, Boston, Mass.: In the Country.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.413.2

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. Hale House: Hale House, Boston, Mass.: In the Country.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.4
Person 99.4
Person 98.4
Person 97
Person 96.9
Person 90.3
Person 90.2
Person 88
Person 85.9
Advertisement 84.5
Poster 84.5
Person 84.3
People 77.4
Person 71
Person 70.9
Art 69.9
Meal 66.7
Food 66.7
Leisure Activities 64.6
Text 57.9
Apparel 57.8
Clothing 57.8
Plant 57.5
Tree 57.5
Archaeology 55.9
Painting 55.4

Clarifai
created on 2019-06-05

people 99.7
picture frame 98.8
museum 98.4
art 98.2
portrait 98
album 98
painting 97.8
exhibition 97.6
nostalgia 97.1
retro 95.7
memory 95.5
snapshot 95.2
vintage 94.9
adult 94.7
child 93.5
old 93.5
group 93.3
moment 93.1
man 92.8
wear 92.1

Imagga
created on 2019-06-05

television 30.8
child 28.2
dad 25.9
people 25.1
man 24.8
parent 24.4
father 23.7
telecommunication system 21.4
male 20.7
adult 17.5
happy 15.7
happiness 14.9
outdoors 14.3
love 14.2
family 13.3
day 12.5
person 12.2
couple 12.2
two 11.9
old 11.8
portrait 11.6
park 11.5
mother 11
boy 10.4
kin 10.3
black 10.2
cute 10
kid 9.7
summer 9.6
grass 9.5
smiling 9.4
youth 9.4
smile 9.3
life 9.2
dark 9.2
outdoor 9.2
holding 9.1
vacation 9
together 8.8
head 8.4
fun 8.2
symbol 8.1
childhood 8.1
hair 7.9
world 7.9
face 7.8
newspaper 7.7
sad 7.7
relaxation 7.5
one 7.5
light 7.3
daughter 7.3
lake 7.3
cheerful 7.3
girls 7.3
dirty 7.2
looking 7.2
art 7.2
swing 7.1
businessman 7.1

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

gallery 99.9
room 99.9
scene 99.7
person 97.6
clothing 96.3
tree 76.3
man 75.3
photograph 73.5
woman 64
old 61.7
posing 60.7
picture frame 38.1
painting 36.4
vintage 30.4

Face analysis

Amazon

AWS Rekognition

Age 38-59
Gender Female, 54%
Angry 45.5%
Happy 45.5%
Calm 45.2%
Confused 45.1%
Sad 53.4%
Disgusted 45.1%
Surprised 45.1%

AWS Rekognition

Age 4-7
Gender Female, 52.7%
Surprised 45.4%
Sad 49.1%
Disgusted 45.6%
Calm 48.2%
Happy 45.1%
Angry 46.1%
Confused 45.5%

AWS Rekognition

Age 45-63
Gender Female, 54.2%
Angry 45.2%
Happy 48.5%
Calm 45.3%
Confused 45.2%
Sad 50.3%
Disgusted 45.2%
Surprised 45.3%

AWS Rekognition

Age 16-27
Gender Female, 54.2%
Happy 45.4%
Sad 53.2%
Confused 45.4%
Calm 45.5%
Angry 45.2%
Disgusted 45.1%
Surprised 45.1%

AWS Rekognition

Age 45-65
Gender Female, 50.3%
Angry 49.5%
Disgusted 49.5%
Confused 49.5%
Calm 49.5%
Happy 50.3%
Surprised 49.5%
Sad 49.7%

AWS Rekognition

Age 49-69
Gender Female, 50.4%
Angry 49.5%
Confused 49.5%
Calm 49.5%
Surprised 49.5%
Sad 49.5%
Happy 50.4%
Disgusted 49.5%

AWS Rekognition

Age 29-45
Gender Female, 54.4%
Angry 45.1%
Confused 45.1%
Calm 45.9%
Surprised 45%
Sad 53.8%
Happy 45.1%
Disgusted 45%

AWS Rekognition

Age 48-68
Gender Female, 50.5%
Angry 49.5%
Disgusted 49.5%
Surprised 49.5%
Calm 49.5%
Sad 49.5%
Happy 50.4%
Confused 49.5%

AWS Rekognition

Age 29-45
Gender Male, 50.4%
Calm 49.8%
Confused 49.6%
Happy 49.6%
Surprised 49.6%
Angry 49.6%
Disgusted 49.6%
Sad 49.7%

AWS Rekognition

Age 20-38
Gender Female, 54.6%
Angry 45.4%
Surprised 45.4%
Disgusted 47.4%
Calm 47%
Sad 48.8%
Happy 45.2%
Confused 45.8%

AWS Rekognition

Age 19-36
Gender Female, 50.4%
Angry 49.7%
Sad 49.7%
Disgusted 49.5%
Happy 49.6%
Confused 49.5%
Calm 49.9%
Surprised 49.5%

AWS Rekognition

Age 29-45
Gender Female, 50.7%
Sad 47.2%
Surprised 45.5%
Confused 45.4%
Angry 45.3%
Happy 45.4%
Calm 50.3%
Disgusted 46%

Feature analysis

Amazon

Person 99.4%
Poster 84.5%

Captions

Microsoft

a vintage photo of a person 76.5%
a vintage photo of some people in a room 76.4%
a vintage photo of a person 75.7%