Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: The high school class of 1915 just before graduation.
Date

1915
People

Artist: Wolfson, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.166.2

Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: The high school class of 1915 just before graduation.

People

Artist: Wolfson, American

Date

1915

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.166.2

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.6
Person 99.6
Person 99.5
Person 99.4
Person 99.2
Person 98.9
Person 98.4
Person 98.2
Person 97.1
Person 97
Person 97
Person 93.6
Person 91.7
Apparel 90.3
Suit 90.3
Coat 90.3
Clothing 90.3
Overcoat 90.3
People 84.1
Chair 65.8
Furniture 65.8
Female 62.4
Girl 62.4
School 62.4
Kid 60.5
Child 60.5
Boy 59.5
Plant 59.4
Vegetation 59.4
Bush 59.4
Sailor Suit 57.6

Clarifai
created on 2019-06-05

group 99.6
people 99.6
group together 98
man 96.4
woman 95.9
many 95.2
adult 93.9
child 93.7
four 92
portrait 91.7
leader 91.5
several 89.9
five 89.5
education 82.8
facial expression 82.3
administration 77.9
wear 75.9
sit 75.6
sibling 75.1
boy 74.7

Imagga
created on 2019-06-05

man 41
people 39
group 37
person 35.1
business 33.4
male 32.7
businessman 32.6
men 30
office 28.5
room 27.5
team 26.9
classroom 26.2
happy 25
women 24.5
meeting 24.5
smiling 21.7
professional 21.7
businesswoman 20.9
laptop 19.9
adult 19.5
teamwork 18.5
work 18
together 17.5
couple 17.4
teacher 17.1
student 16.2
success 16.1
computer 15.6
corporate 15.5
desk 15.3
job 15
friends 15
smile 15
education 14.7
businesspeople 14.2
cheerful 13.8
kin 13.7
sitting 13.7
happiness 13.3
silhouette 13.2
manager 13
lifestyle 13
indoor 12.8
colleagues 12.6
executive 12.4
talking 12.3
communication 11.7
discussion 11.7
working 11.5
indoors 11.4
table 11.4
web site 11.2
portrait 11
occupation 11
girls 10.9
modern 10.5
boy 10.4
school 10.4
females 10.4
looking 10.4
black 10.2
casual 10.2
suit 9.9
child 9.8
blackboard 9.3
planner 9.3
two 9.3
successful 9.1
life 9
family 8.9
coworkers 8.8
standing 8.7
mid adult 8.7
30s 8.7
four 8.6
boss 8.6
world 8.6
youth 8.5
horizontal 8.4
worker 8
love 7.9
finance 7.6
hand 7.6
tie 7.6
career 7.6
learning 7.5
human 7.5
friendship 7.5
new 7.3
home 7.2
night 7.1

Google
created on 2019-06-05

Photograph 97.2
Snapshot 87.2
Team 76.1
Gentleman 70.1
Photography 67.8
History 62.6
Family 60.7

Microsoft
created on 2019-06-05

person 99.6
posing 99.4
clothing 98.7
group 97
standing 94.9
smile 94.8
man 91.1
human face 70.4
old 59.5
people 58.4
clothes 16

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Male, 53.8%
Sad 53.8%
Happy 45%
Surprised 45%
Disgusted 45%
Confused 45.2%
Calm 45.7%
Angry 45.2%

AWS Rekognition

Age 20-38
Gender Female, 54.7%
Sad 48.4%
Confused 46%
Angry 47.1%
Calm 46.9%
Surprised 45.6%
Happy 45.6%
Disgusted 45.4%

AWS Rekognition

Age 15-25
Gender Female, 51%
Calm 45.1%
Disgusted 45%
Surprised 45%
Confused 45.1%
Angry 45.1%
Sad 54.6%
Happy 45%

AWS Rekognition

Age 10-15
Gender Male, 54.3%
Angry 45.1%
Sad 45.5%
Surprised 45.1%
Happy 53.3%
Calm 45.3%
Disgusted 45.4%
Confused 45.2%

AWS Rekognition

Age 17-27
Gender Male, 54.6%
Disgusted 45%
Confused 45.1%
Happy 45.1%
Calm 53.9%
Surprised 45%
Sad 45.9%
Angry 45.1%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Sad 54.8%
Angry 45.1%
Calm 45%
Confused 45%
Happy 45%
Disgusted 45%
Surprised 45%

AWS Rekognition

Age 26-43
Gender Female, 54.1%
Happy 45.1%
Sad 45.5%
Confused 45.4%
Calm 50.7%
Angry 47.8%
Disgusted 45.2%
Surprised 45.2%

AWS Rekognition

Age 23-38
Gender Male, 54.1%
Happy 45.1%
Sad 45.2%
Angry 45%
Surprised 45%
Calm 54.6%
Confused 45%
Disgusted 45%

AWS Rekognition

Age 15-25
Gender Male, 53.8%
Confused 45.3%
Sad 48.9%
Disgusted 45.3%
Angry 45.4%
Happy 47.7%
Calm 47.2%
Surprised 45.3%

AWS Rekognition

Age 9-14
Gender Female, 53.7%
Angry 54.2%
Happy 45.1%
Confused 45.1%
Surprised 45.1%
Sad 45.1%
Disgusted 45.1%
Calm 45.2%

AWS Rekognition

Age 15-25
Gender Female, 55%
Calm 51.2%
Angry 45.3%
Sad 45.4%
Confused 45.3%
Surprised 45.1%
Happy 47.7%
Disgusted 45%

AWS Rekognition

Age 10-15
Gender Female, 54.3%
Calm 45.6%
Surprised 45.2%
Confused 45.5%
Sad 49%
Angry 48.9%
Disgusted 45.2%
Happy 45.6%

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 38
Gender Female

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 18
Gender Female

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Suit 90.3%

Categories

Imagga

people portraits 95.8%
events parties 4.2%

Text analysis

Amazon

class
before
high
The
school
The high school class of 1915 just before graduation.
1915
graduation.
just
of

Google

The high s chool class of 1915 just before graduation
The
high
s
chool
class
of
1915
just
before
graduation