Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: Living rooms in the boys' and girls' cottages.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.293.1

Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: Living rooms in the boys' and girls' cottages.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Room 99.9
Classroom 99.9
Indoors 99.9
School 99.9
Human 99.4
Person 99.4
Person 99.2
Person 98.8
Person 96.6
Person 95.2
Person 94.7
Furniture 93.5
Chair 93.5
Person 92.2
Person 92.2
Person 91.1
Person 89.5
Person 81.3
Person 78.9
Person 78.5
Person 75.4
Person 67.5
Person 65.4
Person 65.3
Person 63.4
Restaurant 57.3
Cafeteria 57.3
Waiting Room 56.6
Person 55.4

Clarifai
created on 2019-06-07

people 99.9
group 99.2
many 99.2
group together 99
adult 98.3
chair 97.7
furniture 97.7
woman 96.7
education 93.3
leader 93.1
room 93
man 92.6
administration 92
seat 91.3
several 90.1
military 90.1
music 86.5
musician 85.5
school 83.1
child 81.5

Imagga
created on 2019-06-07

room 64.2
interior 62.8
table 37.7
furniture 37
chair 36.7
home 35.9
house 35.1
salon 34
decor 33.6
restaurant 29.9
indoor 27.4
modern 25.9
classroom 25.7
design 23.1
shop 22.9
window 22.4
luxury 21.4
architecture 21.1
indoors 20.2
barbershop 19.9
floor 19.5
inside 19.3
wood 18.3
chairs 17.6
decoration 17.4
elegant 17.1
dining 17.1
kitchen 16.7
living 16.1
mercantile establishment 15.6
style 15.6
light 14.7
cafeteria 14.6
comfortable 14.3
lamp 14.3
building 14.2
contemporary 14.1
people 13.9
apartment 13.4
residential 13.4
sofa 13.4
dinner 12.8
carpet 12.6
glass 12.4
hotel 12.4
tables 11.8
elegance 11.7
hall 11.6
couch 11.6
structure 11.4
wooden 10.5
teacher 10.5
expensive 10.5
place of business 10.5
decorate 10.5
wall 10.4
seat 10.2
life 10.2
lifestyle 10.1
man 10.1
domestic 10
cabinet 9.9
food 9.9
rug 9.9
person 9.8
family 9.8
residence 9.7
estate 9.5
counter 9.5
empty 9.4
musical instrument 9.3
dining room 8.9
lighting 8.7
stringed instrument 8.7
day 8.6
space 8.5
chandelier 8.2
celebration 8
urban 7.9
tile 7.8
nobody 7.8
3d 7.7
vase 7.7
party 7.7
real 7.6
city 7.5
plant 7.5
classic 7.4
service 7.4
adult 7.2
women 7.1

Google
created on 2019-06-07

Photograph 95.1
Snapshot 83.6
Room 83.5
Stock photography 59.4
Building 53.4

Microsoft
created on 2019-06-07

wall 98.1
indoor 96.7
furniture 96.4
table 95.9
person 95.5
ceiling 94.4
chair 90.7
group 87.5
house 87.3
people 83.2
clothing 78.6
old 62.5

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 51.2%
Confused 45.4%
Calm 46.4%
Happy 45.5%
Disgusted 45.6%
Sad 51.1%
Angry 45.7%
Surprised 45.3%

AWS Rekognition

Age 26-43
Gender Female, 50%
Angry 49.6%
Confused 49.6%
Disgusted 49.7%
Surprised 49.5%
Calm 49.8%
Sad 49.7%
Happy 49.6%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Surprised 49.5%
Confused 49.5%
Disgusted 50.1%
Angry 49.6%
Calm 49.6%
Happy 49.6%
Sad 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Angry 49.6%
Surprised 49.5%
Confused 49.6%
Sad 49.6%
Disgusted 49.7%
Happy 49.5%
Calm 49.9%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Surprised 49.6%
Disgusted 49.6%
Sad 50.1%
Angry 49.6%
Confused 49.6%
Calm 49.6%
Happy 49.6%

AWS Rekognition

Age 12-22
Gender Female, 50.2%
Surprised 49.5%
Angry 50.1%
Confused 49.5%
Sad 49.6%
Calm 49.6%
Disgusted 49.5%
Happy 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Disgusted 49.6%
Surprised 49.6%
Happy 49.8%
Calm 49.7%
Angry 49.5%
Sad 49.7%
Confused 49.6%

AWS Rekognition

Age 35-52
Gender Female, 50.1%
Sad 49.8%
Angry 49.6%
Happy 49.6%
Disgusted 49.5%
Calm 49.9%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 11-18
Gender Female, 50.5%
Happy 49.5%
Sad 49.6%
Surprised 49.6%
Angry 49.5%
Calm 50%
Disgusted 49.5%
Confused 49.7%

AWS Rekognition

Age 38-59
Gender Female, 50.1%
Sad 49.7%
Angry 49.5%
Happy 50.2%
Disgusted 49.5%
Calm 49.6%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 6-13
Gender Female, 50.4%
Surprised 49.5%
Disgusted 49.5%
Sad 50%
Angry 49.5%
Calm 49.7%
Happy 49.7%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Angry 49.5%
Sad 49.6%
Surprised 49.5%
Confused 49.5%
Happy 50.1%
Calm 49.7%
Disgusted 49.5%

AWS Rekognition

Age 16-27
Gender Female, 50.5%
Angry 49.7%
Surprised 49.6%
Confused 49.7%
Sad 49.8%
Disgusted 49.5%
Happy 49.5%
Calm 49.6%

Feature analysis

Amazon

Person 99.4%
Chair 93.5%

Captions

Microsoft

a group of people standing in a room 96.8%
a group of people in a room 96.7%
an old photo of a group of people in a room 96.1%

Text analysis

Amazon

BB