Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: The Faculty
Date

c. 1900
People

Artist: Wolfson, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.165.1

Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: The Faculty

People

Artist: Wolfson, American

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.165.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.4
Person 99.4
Family 99.3
People 99.3
Person 99
Person 98.9
Person 98.8
Person 98.6
Person 98.4
Person 97.3
Person 96.8
Person 95.6
Person 94.2
Person 93.9
Person 93.5
Person 92.2
Poster 79.4
Advertisement 79.4
Person 76.9
Person 67.3
Person 62.5
Suit 57.2
Clothing 57.2
Apparel 57.2
Coat 57.2
Overcoat 57.2

Clarifai
created on 2019-06-05

people 99.8
group 99.6
many 98.5
child 97.2
group together 96.1
room 95.9
adult 95.6
woman 93.7
man 93.1
wear 91.6
education 90.9
school 88.7
administration 88
boy 85
musician 84.2
portrait 83.9
crowd 82.2
music 81.8
chair 81.6
family 79.9

Imagga
created on 2019-06-05

man 34.9
kin 34.9
person 33.1
male 30.7
people 30.7
adult 24.2
child 22.3
happy 21.9
family 19.6
businessman 19.4
room 19.4
teacher 18.6
business 17.6
home 17.5
couple 17.4
smiling 17.4
portrait 15.5
men 15.5
professional 15.4
senior 15
nurse 14.7
office 14.6
group 14.5
life 14.2
classroom 13.6
happiness 13.3
old 13.2
world 13.2
school 12.9
mother 12.7
team 12.5
student 12.4
boy 12.2
smile 12.1
father 12
education 11.3
women 11.1
kid 10.6
interior 10.6
together 10.5
blackboard 10.4
vintage 9.9
dad 9.7
success 9.7
looking 9.6
love 9.5
casual 9.3
face 9.2
holding 9.1
black 9
cheerful 8.9
patient 8.8
sitting 8.6
desk 8.5
two 8.5
daughter 8.3
aged 8.1
board 8.1
grandfather 8.1
lady 8.1
new 8.1
medical 7.9
work 7.8
standing 7.8
parent 7.8
class 7.7
attractive 7.7
elderly 7.7
meeting 7.5
human 7.5
retro 7.4
indoor 7.3
color 7.2
childhood 7.2
indoors 7

Google
created on 2019-06-05

Photograph 96.4
People 93.4
Snapshot 85.8
History 68.8
Room 65.7
Family 62.9
Vintage clothing 53.5

Microsoft
created on 2019-06-05

clothing 98.7
wall 95.6
man 92.1
person 87.1
posing 80.9
group 75.4
smile 69.1
old 60.3
people 57.2
footwear 53.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 19-36
Gender Male, 54.1%
Calm 53.1%
Confused 45.2%
Sad 46.3%
Surprised 45%
Happy 45.2%
Disgusted 45.1%
Angry 45.1%

AWS Rekognition

Age 26-43
Gender Female, 55%
Happy 54.9%
Disgusted 45%
Sad 45%
Surprised 45%
Confused 45%
Calm 45%
Angry 45%

AWS Rekognition

Age 26-43
Gender Female, 54.9%
Sad 50.1%
Calm 46.4%
Happy 46%
Surprised 45.5%
Angry 45.9%
Disgusted 45.4%
Confused 45.7%

AWS Rekognition

Age 20-38
Gender Male, 50.8%
Happy 52.5%
Sad 45.9%
Confused 45.1%
Calm 45.8%
Angry 45.2%
Disgusted 45.3%
Surprised 45.2%

AWS Rekognition

Age 35-52
Gender Male, 54.8%
Surprised 45.1%
Calm 51.8%
Happy 45.3%
Angry 45.4%
Sad 46.3%
Disgusted 45.2%
Confused 45.9%

AWS Rekognition

Age 16-27
Gender Female, 54.8%
Happy 45%
Angry 45.1%
Calm 45.1%
Confused 45%
Disgusted 45%
Surprised 45%
Sad 54.7%

AWS Rekognition

Age 29-45
Gender Male, 54.3%
Disgusted 47.9%
Confused 45.8%
Happy 45.7%
Sad 47.4%
Surprised 45.3%
Calm 47.1%
Angry 45.8%

AWS Rekognition

Age 38-59
Gender Male, 52%
Confused 45.2%
Angry 45.2%
Disgusted 45.1%
Calm 45.7%
Happy 50.1%
Surprised 45.1%
Sad 48.6%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Calm 46%
Angry 45.9%
Happy 45.4%
Sad 52%
Surprised 45.2%
Confused 45.3%
Disgusted 45.3%

AWS Rekognition

Age 26-43
Gender Male, 54.5%
Happy 45.1%
Sad 49.5%
Disgusted 45.1%
Angry 47.7%
Surprised 45.1%
Calm 46.8%
Confused 45.6%

AWS Rekognition

Age 35-52
Gender Male, 53.8%
Happy 45.2%
Sad 45.7%
Angry 45.4%
Surprised 45.2%
Calm 51.9%
Confused 45.7%
Disgusted 45.9%

AWS Rekognition

Age 26-43
Gender Male, 55%
Sad 45.4%
Angry 45.4%
Happy 45.2%
Surprised 45.1%
Confused 45.6%
Calm 53.2%
Disgusted 45%

AWS Rekognition

Age 35-53
Gender Male, 54.8%
Surprised 45.1%
Disgusted 45.2%
Sad 49.4%
Calm 48%
Confused 45.8%
Angry 45.4%
Happy 46.1%

AWS Rekognition

Age 35-52
Gender Male, 54.4%
Surprised 45.2%
Happy 45.1%
Confused 46.4%
Calm 48.4%
Disgusted 45.1%
Angry 45.7%
Sad 49.1%

AWS Rekognition

Age 20-38
Gender Female, 54.1%
Surprised 45.2%
Happy 46%
Calm 45.3%
Disgusted 45.2%
Confused 45.2%
Sad 52.7%
Angry 45.4%

AWS Rekognition

Age 26-43
Gender Male, 52.4%
Angry 45.3%
Sad 51.4%
Calm 46.1%
Surprised 45.2%
Confused 45.2%
Disgusted 45.3%
Happy 46.5%

AWS Rekognition

Age 23-38
Gender Female, 54.9%
Angry 45%
Calm 45.1%
Confused 45%
Happy 54.3%
Sad 45.2%
Disgusted 45.2%
Surprised 45.1%

AWS Rekognition

Age 29-45
Gender Male, 54.8%
Confused 45.2%
Surprised 45%
Angry 45.1%
Happy 45.1%
Sad 50%
Calm 49.5%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Female, 54.7%
Calm 45.1%
Angry 45.1%
Sad 45.2%
Confused 45%
Surprised 45.1%
Happy 54.4%
Disgusted 45.1%

AWS Rekognition

Age 26-44
Gender Male, 54.7%
Happy 47.1%
Surprised 45.2%
Confused 45.4%
Disgusted 45.3%
Calm 47.7%
Angry 45.3%
Sad 49%

AWS Rekognition

Age 26-43
Gender Male, 53.4%
Happy 45.2%
Sad 53.9%
Disgusted 45.1%
Calm 45.4%
Surprised 45%
Confused 45.1%
Angry 45.3%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Sad 46.1%
Calm 51.6%
Happy 45.7%
Surprised 45.3%
Angry 45.6%
Disgusted 45.2%
Confused 45.4%

AWS Rekognition

Age 26-43
Gender Male, 54.4%
Angry 45.4%
Disgusted 45.1%
Sad 48.8%
Surprised 45.2%
Happy 45.1%
Calm 50.1%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Male, 55%
Angry 46%
Happy 45.2%
Calm 51.6%
Confused 45.3%
Sad 46.6%
Disgusted 45%
Surprised 45.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Poster 79.4%
Suit 57.2%

Categories

Imagga

people portraits 56.9%
paintings art 19.2%
interior objects 18.8%
events parties 1.5%
pets animals 1.4%
text visuals 1.2%

Text analysis

Amazon

The
The Faculty
Faculty

Google

The Faculty
The
Faculty