Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York

Date

c. 1912

People

Artist: Wolfson, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.343

Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York

People

Artist: Wolfson, American

Date

c. 1912

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-04

Human 99.9
Crowd 99.9
Audience 99.9
Person 98.8
Person 98.7
Person 98.4
Person 98.4
Person 97.2
Indoors 96.9
Room 95.4
Lecture 94.3
Speech 94.3
Person 91.9
Person 86.1
Hall 85.6
Person 79.7
People 76.5
Seminar 67.6
School 67.6
Classroom 67.6
Person 66.1
Person 58.1
Tablecloth 57.7
Person 45

Imagga
created on 2022-06-04

web site 62.5
business 19.4
people 17.3
man 15.4
frame 15.2
design 14.1
paper 13.7
grunge 13.6
old 13.2
vintage 13.2
education 13
male 12.8
room 12.6
drawing 12.3
blackboard 11.6
retro 11.5
classroom 11.2
pattern 10.9
interior 10.6
graphic 10.2
film 10.2
space 10.1
student 10
person 9.9
dirty 9.9
human 9.7
group 9.7
monitor 9.4
happy 9.4
board 9.3
office 9.2
transport 9.1
hand 9.1
silhouette 9.1
school 9.1
teacher 9
black 9
technology 8.9
businessman 8.8
class 8.7
card 8.6
letter 8.2
border 8.1
computer 8.1
teaching 7.8
3d 7.7
modern 7.7
texture 7.6
finance 7.6
writing 7.5
sign 7.5
adult 7.5
symbol 7.4
digital 7.3
transportation 7.2
science 7.1
desk 7.1
sky 7

Google
created on 2022-06-04

Chair 89.4
Table 88.3
Font 80.1
Art 76.6
Event 74
Monochrome photography 71.4
Suit 70.2
Room 68.9
History 65.1
Monochrome 62.7
Stock photography 61.8
Vehicle 59.9
Collection 57.2
Painting 54.8
Tablecloth 54.6
Rectangle 53.4
Visual arts 53.1
Building 52.4
Rehearsal dinner 52

Microsoft
created on 2022-06-04

text 99.8
person 96.9
wall 95
indoor 94.1
ceiling 91.6
clothing 89
man 68.1
poster 61.8
screenshot 54.3
several 12.7

Face analysis

Amazon

Google

AWS Rekognition

Age 18-26
Gender Female, 99.9%
Sad 55.6%
Disgusted 32.5%
Calm 20.7%
Confused 9.5%
Surprised 7.9%
Fear 6.6%
Angry 3.7%
Happy 0.6%

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 38.2%
Confused 25.4%
Disgusted 12.6%
Sad 12%
Surprised 9.2%
Fear 7.1%
Happy 2%
Angry 1.2%

AWS Rekognition

Age 16-22
Gender Female, 94.4%
Sad 94.9%
Fear 22.3%
Calm 11.5%
Surprised 10.4%
Disgusted 5.3%
Angry 3.6%
Confused 1.7%
Happy 1.6%

AWS Rekognition

Age 20-28
Gender Male, 99.5%
Happy 54.8%
Calm 14.4%
Surprised 9.6%
Disgusted 8.5%
Confused 7%
Fear 6.3%
Sad 4.4%
Angry 3.6%

AWS Rekognition

Age 9-17
Gender Male, 69%
Calm 73.3%
Fear 10.5%
Surprised 7.3%
Sad 5.2%
Angry 3.8%
Disgusted 2.8%
Confused 1.2%
Happy 1.2%

AWS Rekognition

Age 14-22
Gender Male, 78.2%
Calm 95.8%
Surprised 6.4%
Fear 6.1%
Sad 2.7%
Angry 0.9%
Disgusted 0.4%
Happy 0.4%
Confused 0.2%

AWS Rekognition

Age 16-24
Gender Male, 83.4%
Sad 28.6%
Calm 28.3%
Angry 20.5%
Surprised 16.2%
Fear 8%
Confused 6.8%
Disgusted 4.5%
Happy 2.3%

AWS Rekognition

Age 2-10
Gender Female, 98%
Sad 80.4%
Calm 37.7%
Fear 14.6%
Surprised 6.9%
Disgusted 4.3%
Angry 2.1%
Confused 1.6%
Happy 1.6%

AWS Rekognition

Age 16-22
Gender Male, 99.9%
Calm 83.6%
Surprised 9.4%
Confused 7.1%
Fear 6%
Sad 2.3%
Angry 2.1%
Happy 0.7%
Disgusted 0.5%

AWS Rekognition

Age 16-22
Gender Male, 97.6%
Calm 74.5%
Fear 8%
Confused 7.6%
Surprised 6.9%
Sad 5.1%
Angry 3.4%
Disgusted 1.4%
Happy 0.6%

AWS Rekognition

Age 19-27
Gender Female, 63.9%
Sad 99.3%
Calm 23.6%
Fear 9.5%
Surprised 6.8%
Confused 2%
Happy 1.6%
Angry 1.2%
Disgusted 1%

AWS Rekognition

Age 10-18
Gender Male, 90.2%
Calm 92.5%
Fear 7.2%
Surprised 6.5%
Sad 2.5%
Disgusted 1.6%
Happy 0.5%
Angry 0.3%
Confused 0.2%

AWS Rekognition

Age 18-26
Gender Male, 77.9%
Calm 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.1%
Angry 0.1%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 10-18
Gender Male, 99.3%
Calm 81.9%
Sad 7.4%
Surprised 6.9%
Fear 6.2%
Angry 2.9%
Happy 2.2%
Disgusted 1.1%
Confused 0.9%

AWS Rekognition

Age 1-7
Gender Male, 98.3%
Calm 82.8%
Fear 6.9%
Surprised 6.9%
Sad 4.1%
Happy 2.6%
Disgusted 2.2%
Confused 2%
Angry 1.9%

AWS Rekognition

Age 19-27
Gender Male, 81.8%
Sad 28.4%
Calm 26.5%
Fear 20.8%
Surprised 17.5%
Disgusted 8.1%
Angry 6.1%
Confused 3%
Happy 1.3%

AWS Rekognition

Age 16-24
Gender Male, 99.8%
Calm 82.9%
Angry 8.6%
Fear 7.4%
Surprised 6.5%
Sad 2.7%
Disgusted 0.9%
Happy 0.8%
Confused 0.8%

AWS Rekognition

Age 20-28
Gender Male, 90.5%
Sad 32.9%
Confused 23.8%
Calm 22.6%
Disgusted 13.6%
Angry 9.7%
Surprised 9%
Fear 6.6%
Happy 2.1%

AWS Rekognition

Age 16-22
Gender Male, 97.7%
Calm 98%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Angry 0.5%
Happy 0.5%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 12-20
Gender Male, 100%
Calm 96.8%
Surprised 6.3%
Fear 6%
Sad 2.3%
Angry 1.4%
Confused 0.4%
Happy 0.3%
Disgusted 0.3%

AWS Rekognition

Age 16-24
Gender Male, 99.7%
Calm 67.1%
Angry 11.3%
Fear 7.8%
Surprised 7%
Happy 6.5%
Disgusted 4.3%
Sad 3.3%
Confused 1.7%

AWS Rekognition

Age 7-17
Gender Male, 99.8%
Calm 78.5%
Sad 7%
Surprised 6.5%
Fear 6.3%
Angry 4.7%
Disgusted 4.3%
Happy 1.6%
Confused 0.5%

AWS Rekognition

Age 23-31
Gender Male, 74.5%
Fear 46.2%
Calm 35%
Sad 8.5%
Surprised 7.5%
Disgusted 5.5%
Confused 3.3%
Angry 2.9%
Happy 1.8%

AWS Rekognition

Age 13-21
Gender Male, 99.7%
Calm 78.8%
Confused 10.9%
Surprised 7.5%
Fear 6.1%
Sad 3.3%
Happy 2.3%
Angry 1.1%
Disgusted 0.8%

AWS Rekognition

Age 18-26
Gender Male, 89.4%
Calm 64.9%
Happy 24%
Surprised 7.1%
Fear 6.5%
Sad 3%
Disgusted 2.7%
Confused 1.6%
Angry 1.4%

AWS Rekognition

Age 20-28
Gender Male, 99%
Sad 75.5%
Calm 53.4%
Surprised 6.7%
Fear 6.4%
Confused 4.2%
Angry 2.2%
Disgusted 1.9%
Happy 1.5%

AWS Rekognition

Age 16-22
Gender Male, 63.5%
Calm 79.4%
Sad 17.9%
Surprised 6.6%
Fear 6%
Angry 2.6%
Disgusted 0.3%
Happy 0.2%
Confused 0.2%

AWS Rekognition

Age 19-27
Gender Male, 99.8%
Calm 86.5%
Fear 6.6%
Surprised 6.5%
Angry 3.9%
Sad 3.5%
Confused 2.6%
Disgusted 0.6%
Happy 0.6%

AWS Rekognition

Age 7-17
Gender Female, 50%
Calm 66.4%
Angry 18.7%
Surprised 7.1%
Fear 6.3%
Sad 4.8%
Confused 2.6%
Happy 2%
Disgusted 1.8%

AWS Rekognition

Age 18-24
Gender Male, 55.3%
Calm 92.5%
Surprised 6.4%
Fear 6.1%
Sad 2.8%
Angry 2.7%
Confused 1%
Happy 0.6%
Disgusted 0.4%

AWS Rekognition

Age 10-18
Gender Male, 86.6%
Sad 69.5%
Calm 38.4%
Happy 17.2%
Surprised 7.3%
Fear 6.9%
Disgusted 3%
Confused 2.3%
Angry 2.1%

AWS Rekognition

Age 16-22
Gender Female, 79%
Calm 79.5%
Angry 14.9%
Surprised 6.4%
Fear 6%
Sad 3.8%
Happy 0.5%
Confused 0.3%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%

Captions

Microsoft

a group of people in a room 68.3%
a group of people in a store 36.9%
a group of people standing in a room 36.8%

Text analysis

Amazon

York
Orphan
Hebrew
Asylum
Hebrew Sheltering Guardian Society Orphan Asylum
part
Guardian
Society
Sheltering
the
The
New
and
on
before
religious
Pleasantville, New York
cottage
Ch
Sabboth
Pleasantville,
integral
G
integral part or the school.
the Sabboth 3ve.
The cottage 199 that *blesses the lights* before the neal on
neal
lights*
school.
In
*blesses
Hebrew and religious instruction. The ahapel In an
G Ch 11.75.02
or
3ve.
instruction.
that
ahapel
199
an
11.75.02

Google

Pleasantville
,
Hebrew
in
an
the
lights
before
meal
D
Guardian
Society
and
instruction
chapel
mother
Babboth
Eve
Hebrew Sheltering Guardian Society Orphan Asylum Pleasantville, New York. Hebrew and religious instruction. The chapel in an integral part of the school. GENE sem The cottage mother "blesses the lights before the meal on the Babboth Eve. & Ch 11.15.46 D
Asylum
.
religious
The
part
sem
cottage
blesses
&
Ch
Orphan
of
school
"
on
Sheltering
New
York
integral
GENE
11.15.46