Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: The Committee on Girls' Welfare composed of several cottage mothers and an M. D.
Date

c. 1900
People

Artist: Wolfson, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.163.2

Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: The Committee on Girls' Welfare composed of several cottage mothers and an M. D.

People

Artist: Wolfson, American

Date

c. 1900

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.8
Person 99.8
Person 99.5
Person 99.5
Person 98.8
Sitting 92.2
Crowd 84.3
Art 67.7
Painting 67.7
People 65.9
Indoors 64.7
Room 64.7
Audience 61.5
Clothing 58.6
Apparel 58.6
Classroom 58.2
School 58.2

Clarifai
created on 2019-06-05

people 99.9
music 99
group 98.9
musician 98.8
man 98.1
adult 97.8
woman 97.4
furniture 96.9
group together 96.8
sit 96.4
four 95.8
indoors 95.1
three 92.4
child 91.8
sitting 91.5
room 91.3
several 90.3
administration 89.1
instrument 88.9
desk 86.9

Imagga
created on 2019-06-05

teacher 57.1
man 41
person 39.7
professional 37.9
adult 36.6
educator 36.6
male 32.6
people 30.1
table 27.8
sitting 27.5
office 27.4
businessman 27.4
smiling 26
business 25.5
women 22.9
men 22.3
indoors 22
happy 21.9
together 21
group 21
meeting 20.7
work 20.4
desk 20
couple 19.2
cheerful 18.7
room 18.2
corporate 18
team 17.9
laptop 17.3
talking 17.1
job 16.8
education 16.4
worker 16.4
businesswoman 16.4
student 16.2
communication 15.9
executive 15.9
teamwork 15.8
smile 15.7
happiness 15.7
computer 15.3
home 15.2
togetherness 15.1
lifestyle 14.5
working 14.1
manager 14
classroom 13.8
suit 13.5
colleagues 12.6
modern 12.6
holding 12.4
businesspeople 12.3
chair 12.3
enjoyment 12.2
two 11.9
life 11.4
senior 11.2
color 11.1
director 11
portrait 11
indoor 11
leisure activity 10.8
casual clothing 10.8
teaching 10.7
nurse 10.6
boss 10.5
looking 10.4
technology 10.4
love 10.3
mature 10.2
confident 10
school 9.9
20 24 years 9.8
interior 9.7
two people 9.7
standing 9.6
relationship 9.4
occupation 9.2
waiter 8.9
handsome 8.9
family 8.9
conference 8.8
boy 8.7
class 8.7
leader 8.7
child 8.6
tie 8.5
adults 8.5
outfit 8.5
groom 8.4
study 8.4
employee 8.3
successful 8.2
new 8.1
success 8
to 8
associates 7.9
blackboard 7.8
full length 7.8
content 7.7
finance 7.6
coat 7.5
friends 7.5
friendship 7.5
presentation 7.4
father 7.3
children 7.3
lab coat 7.2
day 7.1
paper 7.1

Google
created on 2019-06-05

Photograph 95.7
Text 85.2
Snapshot 84.5
Room 74.4
Adaptation 67
Photography 62.4
History 57.6
Family 51.8

Microsoft
created on 2019-06-05

wall 99.8
person 97.2
indoor 96.3
clothing 93
old 78.4
man 63.1
table 57.8
posing 46

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-44
Gender Female, 55%
Angry 46.1%
Disgusted 48.6%
Calm 45.6%
Surprised 45.4%
Happy 47%
Sad 46.5%
Confused 45.7%

AWS Rekognition

Age 35-52
Gender Female, 50.4%
Surprised 45.1%
Happy 45%
Confused 45.2%
Calm 46%
Disgusted 45.2%
Angry 52.4%
Sad 46.1%

AWS Rekognition

Age 19-36
Gender Female, 54.3%
Happy 45.1%
Angry 45%
Calm 45%
Confused 45%
Disgusted 45%
Surprised 45%
Sad 54.8%

AWS Rekognition

Age 35-52
Gender Female, 52.4%
Surprised 45.8%
Happy 45.4%
Confused 46%
Calm 49.2%
Disgusted 45.7%
Angry 45.9%
Sad 47.1%

AWS Rekognition

Age 26-43
Gender Female, 54.4%
Happy 46%
Sad 48.2%
Disgusted 45.5%
Angry 46.4%
Surprised 46%
Calm 47.4%
Confused 45.6%

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Painting 67.7%

Captions

Microsoft

a group of people standing in front of a mirror posing for the camera 58.5%
a person standing in front of a mirror posing for the camera 58.4%
a group of people posing for a photo 58.3%

Text analysis

Amazon

several
composed
of
Welfare
The
The Committee on Girls' Welfare composed of several
Girls'
cottage
on
D.
Committee
others
and
an
M.
co cottage mo others and an M. D.
mo
co

Google

The Commi ttee on Girlst Welfare composed of several cottage mo thers and an M. D.
The
Commi
ttee
on
Girlst
Welfare
composed
of
several
cottage
mo
thers
and
an
M.
D.