Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: The Boys' Republic Council in weekly session.
Date

c. 1900
People

Artist: Wolfson, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.345.1

Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: The Boys' Republic Council in weekly session.

People

Artist: Wolfson, American

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.345.1

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Person 99
Human 99
Person 98.8
Chair 98.7
Furniture 98.7
Person 98.4
Person 98.1
Person 97.7
Person 97.7
Person 97.7
Person 97.1
Room 95.2
Indoors 95.2
Person 94.6
Person 94.2
Person 91.1
Person 90.3
Person 83.5
Classroom 81.7
School 81.7
Person 80.2
Sitting 78.6
Person 77.5
Person 72.9
Restaurant 71.1
Cafeteria 71.1
Table 70.9
Dining Table 63.4
Workshop 60
Housing 57.7
Building 57.7

Clarifai
created on 2025-01-10

people 99.9
group 99.7
group together 98.7
administration 96.7
adult 96.6
room 96.3
many 95.2
leader 94.6
man 94.4
furniture 94.1
desk 93.3
education 93.1
woman 92.9
meeting 86.4
sit 86.2
classroom 85.3
war 84.6
several 83.8
teacher 81.6
school 80.3

Imagga
created on 2022-06-25

classroom 97.3
room 93.6
teacher 36.8
table 34.8
person 31.9
people 30.7
man 28.2
male 27.7
meeting 26.4
group 25
women 24.5
professional 24.1
office 24
interior 23.9
indoors 23.7
smiling 22.4
sitting 22.3
business 21.9
work 21.2
educator 21.1
team 20.6
businessman 20.3
adult 19.8
home 19.2
chair 19
modern 18.9
happy 18.8
restaurant 18.4
together 17.5
education 17.3
conference 16.6
men 16.3
desk 16.1
communication 16
smile 15.7
businesswoman 15.5
suit 15.3
lifestyle 15.2
student 15.1
presentation 14.9
teamwork 14.8
corporate 14.6
laptop 14.6
talking 14.3
computer 13.6
happiness 13.3
working 13.3
executive 13.3
holding 13.2
hospital 13.2
togetherness 12.3
indoor 11.9
school 11.7
couple 11.3
portrait 11
board 10.9
cheerful 10.6
workplace 10.5
success 10.5
learning 10.3
manager 10.3
worker 10.2
coffee 10.2
house 10
20 24 years 9.8
family 9.8
colleagues 9.7
class 9.7
enjoyment 9.4
mature 9.3
child 9.3
occupation 9.2
food 9.1
design 9
color 8.9
kid 8.9
job 8.9
leisure activity 8.8
looking 8.8
teaching 8.8
two people 8.8
boy 8.7
glass 8.6
businesspeople 8.5
friends 8.5
study 8.4
meal 8.3
children 8.2
kitchen 8.2
to 8
hall 7.9
love 7.9
seminar 7.9
casual clothing 7.8
students 7.8
life 7.8
discussion 7.8
full length 7.8
furniture 7.7
diversity 7.7
drinking 7.7
drink 7.5
showing 7.5
friendship 7.5
mother 7.4
technology 7.4
service 7.4
training 7.4
lady 7.3
girls 7.3
new 7.3
nurse 7.1

Google
created on 2022-06-25

Furniture 93.3
Table 93.1
Chair 90.7
Black 89.7
Black-and-white 84.5
Picture frame 84.5
Style 83.9
Social group 82.3
Monochrome 75.6
Desk 75.2
Event 74.1
Monochrome photography 73
Suit 71.5
Sitting 65.7
Room 64.6
Class 64.1
Conversation 61.6
Vintage clothing 60.8
History 60
Education 57

Microsoft
created on 2022-06-25

indoor 99.7
wall 99.7
table 99.1
furniture 98.6
floor 97.7
chair 96.4
person 92.8
clothing 86
room 79.9
man 71.7
classroom 69.6
desk 60.7
library 55.3
restaurant 15.5
several 11.5
dining room 6.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-24
Gender Female, 64.5%
Calm 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Confused 0%
Angry 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 26-36
Gender Male, 95.4%
Sad 99.6%
Calm 15.3%
Confused 11.7%
Surprised 6.6%
Fear 6.2%
Angry 3.6%
Disgusted 1.2%
Happy 0.5%

AWS Rekognition

Age 16-24
Gender Female, 87.3%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 18-26
Gender Male, 98.9%
Calm 99.1%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Happy 0.2%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 19-27
Gender Female, 98.4%
Calm 94.4%
Surprised 6.5%
Fear 5.9%
Sad 3.8%
Angry 0.3%
Disgusted 0.2%
Confused 0.2%
Happy 0.1%

AWS Rekognition

Age 26-36
Gender Male, 97%
Calm 96.7%
Surprised 6.4%
Fear 6%
Sad 2.5%
Confused 0.9%
Angry 0.4%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 22-30
Gender Female, 98.4%
Calm 65%
Sad 43.1%
Surprised 6.5%
Fear 6.1%
Angry 5.5%
Confused 2.4%
Disgusted 0.6%
Happy 0.5%

AWS Rekognition

Age 16-24
Gender Female, 98%
Calm 97.5%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Confused 1.5%
Angry 0.2%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 19-27
Gender Female, 87.1%
Calm 71.8%
Sad 33.8%
Surprised 6.5%
Fear 6.1%
Confused 3.6%
Angry 0.7%
Disgusted 0.6%
Happy 0.2%

AWS Rekognition

Age 27-37
Gender Female, 74.5%
Calm 50.1%
Disgusted 22.6%
Surprised 8.9%
Happy 8.1%
Fear 6.5%
Confused 5.2%
Angry 4.6%
Sad 3.5%

AWS Rekognition

Age 18-26
Gender Male, 99.3%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 18-26
Gender Female, 95.6%
Calm 96.1%
Surprised 6.3%
Fear 5.9%
Sad 3.4%
Confused 0.4%
Angry 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 19-27
Gender Male, 85.8%
Calm 57.1%
Fear 33.9%
Surprised 8.4%
Sad 3.1%
Angry 1.9%
Disgusted 1.7%
Happy 1%
Confused 0.5%

AWS Rekognition

Age 21-29
Gender Female, 77.3%
Calm 94%
Surprised 6.6%
Fear 6%
Sad 2.9%
Disgusted 1.6%
Confused 0.6%
Angry 0.6%
Happy 0.3%

AWS Rekognition

Age 11-19
Gender Male, 86%
Calm 95.2%
Surprised 7.6%
Fear 5.9%
Sad 2.2%
Confused 1.6%
Happy 0.2%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 16-24
Gender Male, 86.6%
Sad 99.3%
Confused 10.6%
Angry 9.9%
Calm 9.4%
Surprised 7.4%
Fear 7.4%
Disgusted 2%
Happy 0.8%

AWS Rekognition

Age 18-24
Gender Female, 87.2%
Calm 50.2%
Sad 32.5%
Fear 12.7%
Surprised 7.7%
Confused 5.2%
Angry 3%
Happy 2.9%
Disgusted 1.9%

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Chair
Person 99%
Person 98.8%
Person 98.4%
Person 98.1%
Person 97.7%
Person 97.7%
Person 97.7%
Person 97.1%
Person 94.6%
Person 94.2%
Person 91.1%
Person 90.3%
Person 83.5%
Person 80.2%
Person 77.5%
Person 72.9%
Chair 98.7%

Categories

Imagga

events parties 93.9%
people portraits 5.5%

Text analysis

Amazon

HS
GS
BOYS
BOYS REPUBLIC
REPUBLIC
WINNERS
DE
DIENDIST DE
DIENDIST

Google

BOYS REPUBLIC HS GS WINNERS FIFNSIST OF
BOYS
REPUBLIC
HS
GS
WINNERS
FIFNSIST
OF