Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: The Boys' Republic Council in weekly session.

Date

c. 1900

People

Artist: Wolfson, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.345.1

Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: The Boys' Republic Council in weekly session.

People

Artist: Wolfson, American

Date

c. 1900

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Person 99
Human 99
Person 98.8
Chair 98.7
Furniture 98.7
Person 98.4
Person 98.1
Person 97.7
Person 97.7
Person 97.7
Person 97.1
Room 95.2
Indoors 95.2
Person 94.6
Person 94.2
Person 91.1
Person 90.3
Person 83.5
Classroom 81.7
School 81.7
Person 80.2
Sitting 78.6
Person 77.5
Person 72.9
Restaurant 71.1
Cafeteria 71.1
Table 70.9
Dining Table 63.4
Workshop 60
Housing 57.7
Building 57.7

Imagga
created on 2022-06-25

classroom 97.3
room 93.6
teacher 36.8
table 34.8
person 31.9
people 30.7
man 28.2
male 27.7
meeting 26.4
group 25
women 24.5
professional 24.1
office 24
interior 23.9
indoors 23.7
smiling 22.4
sitting 22.3
business 21.9
work 21.2
educator 21.1
team 20.6
businessman 20.3
adult 19.8
home 19.2
chair 19
modern 18.9
happy 18.8
restaurant 18.4
together 17.5
education 17.3
conference 16.6
men 16.3
desk 16.1
communication 16
smile 15.7
businesswoman 15.5
suit 15.3
lifestyle 15.2
student 15.1
presentation 14.9
teamwork 14.8
corporate 14.6
laptop 14.6
talking 14.3
computer 13.6
happiness 13.3
working 13.3
executive 13.3
holding 13.2
hospital 13.2
togetherness 12.3
indoor 11.9
school 11.7
couple 11.3
portrait 11
board 10.9
cheerful 10.6
workplace 10.5
success 10.5
learning 10.3
manager 10.3
worker 10.2
coffee 10.2
house 10
20 24 years 9.8
family 9.8
colleagues 9.7
class 9.7
enjoyment 9.4
mature 9.3
child 9.3
occupation 9.2
food 9.1
design 9
color 8.9
kid 8.9
job 8.9
leisure activity 8.8
looking 8.8
teaching 8.8
two people 8.8
boy 8.7
glass 8.6
businesspeople 8.5
friends 8.5
study 8.4
meal 8.3
children 8.2
kitchen 8.2
to 8
hall 7.9
love 7.9
seminar 7.9
casual clothing 7.8
students 7.8
life 7.8
discussion 7.8
full length 7.8
furniture 7.7
diversity 7.7
drinking 7.7
drink 7.5
showing 7.5
friendship 7.5
mother 7.4
technology 7.4
service 7.4
training 7.4
lady 7.3
girls 7.3
new 7.3
nurse 7.1

Google
created on 2022-06-25

Microsoft
created on 2022-06-25

indoor 99.7
wall 99.7
table 99.1
furniture 98.6
floor 97.7
chair 96.4
person 92.8
clothing 86
room 79.9
man 71.7
classroom 69.6
desk 60.7
library 55.3
restaurant 15.5
several 11.5
dining room 6.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-24
Gender Female, 64.5%
Calm 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Confused 0%
Angry 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 26-36
Gender Male, 95.4%
Sad 99.6%
Calm 15.3%
Confused 11.7%
Surprised 6.6%
Fear 6.2%
Angry 3.6%
Disgusted 1.2%
Happy 0.5%

AWS Rekognition

Age 16-24
Gender Female, 87.3%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 18-26
Gender Male, 98.9%
Calm 99.1%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Happy 0.2%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 19-27
Gender Female, 98.4%
Calm 94.4%
Surprised 6.5%
Fear 5.9%
Sad 3.8%
Angry 0.3%
Disgusted 0.2%
Confused 0.2%
Happy 0.1%

AWS Rekognition

Age 26-36
Gender Male, 97%
Calm 96.7%
Surprised 6.4%
Fear 6%
Sad 2.5%
Confused 0.9%
Angry 0.4%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 22-30
Gender Female, 98.4%
Calm 65%
Sad 43.1%
Surprised 6.5%
Fear 6.1%
Angry 5.5%
Confused 2.4%
Disgusted 0.6%
Happy 0.5%

AWS Rekognition

Age 16-24
Gender Female, 98%
Calm 97.5%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Confused 1.5%
Angry 0.2%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 19-27
Gender Female, 87.1%
Calm 71.8%
Sad 33.8%
Surprised 6.5%
Fear 6.1%
Confused 3.6%
Angry 0.7%
Disgusted 0.6%
Happy 0.2%

AWS Rekognition

Age 27-37
Gender Female, 74.5%
Calm 50.1%
Disgusted 22.6%
Surprised 8.9%
Happy 8.1%
Fear 6.5%
Confused 5.2%
Angry 4.6%
Sad 3.5%

AWS Rekognition

Age 18-26
Gender Male, 99.3%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 18-26
Gender Female, 95.6%
Calm 96.1%
Surprised 6.3%
Fear 5.9%
Sad 3.4%
Confused 0.4%
Angry 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 19-27
Gender Male, 85.8%
Calm 57.1%
Fear 33.9%
Surprised 8.4%
Sad 3.1%
Angry 1.9%
Disgusted 1.7%
Happy 1%
Confused 0.5%

AWS Rekognition

Age 21-29
Gender Female, 77.3%
Calm 94%
Surprised 6.6%
Fear 6%
Sad 2.9%
Disgusted 1.6%
Confused 0.6%
Angry 0.6%
Happy 0.3%

AWS Rekognition

Age 11-19
Gender Male, 86%
Calm 95.2%
Surprised 7.6%
Fear 5.9%
Sad 2.2%
Confused 1.6%
Happy 0.2%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 16-24
Gender Male, 86.6%
Sad 99.3%
Confused 10.6%
Angry 9.9%
Calm 9.4%
Surprised 7.4%
Fear 7.4%
Disgusted 2%
Happy 0.8%

AWS Rekognition

Age 18-24
Gender Female, 87.2%
Calm 50.2%
Sad 32.5%
Fear 12.7%
Surprised 7.7%
Confused 5.2%
Angry 3%
Happy 2.9%
Disgusted 1.9%

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Chair 98.7%

Captions

Microsoft

a group of people sitting at a table in a room 96.1%
a group of people sitting at desks in a room 96%
a group of people sitting in a room 95.9%

Text analysis

Amazon

HS
GS
BOYS
BOYS REPUBLIC
REPUBLIC
WINNERS
DE
DIENDIST DE
DIENDIST

Google

BOYS REPUBLIC HS GS WINNERS FIFNSIST OF
BOYS
REPUBLIC
HS
GS
WINNERS
FIFNSIST
OF