Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Christodora House": Christodora House, New York City.: A Girls Club. German and Jewish.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3155.4

Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Christodora House": Christodora House, New York City.: A Girls Club. German and Jewish.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3155.4

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Person 99.6
Human 99.6
Person 99.5
Person 99.5
Person 99.4
Person 99.2
Person 99.1
Person 98.9
Person 96.7
Person 94.4
Person 87.9
Boy 83
Sailor Suit 80.3
Text 76.6
Person 76.5
Person 73.7
Person 72.6
People 68.3
Crowd 61.4
Person 60.3
Child 59.9
Kid 59.9

Clarifai
created on 2019-06-06

people 100
group 99.7
child 98.7
many 98.4
group together 96.9
portrait 96.9
adult 96.4
education 94.2
administration 93.2
music 92.9
school 92.4
wear 92.1
man 90.8
woman 90.6
leader 90.2
son 89.6
facial expression 89.3
retro 88
boy 87.6
several 87.4

Imagga
created on 2019-06-06

man 29.6
daily 25.7
old 24.4
people 24
male 22
person 21.9
business 18.8
newspaper 18.6
vintage 17.4
businessman 16.8
statue 16.3
team 16.1
kin 14.9
adult 14.7
portrait 14.2
ancient 13.8
aged 13.6
product 13.5
religion 13.4
men 12.9
happy 12.5
group 12.1
room 11.8
history 11.6
couple 11.3
antique 11.2
religious 11.2
classroom 11.1
creation 11
student 10.8
office 10.6
mature 10.2
catholic 10.1
world 10
sculpture 9.9
retro 9.8
black 9.6
education 9.5
happiness 9.4
teacher 9.3
monument 9.3
camera 9.2
nurse 8.9
family 8.9
school 8.8
smiling 8.7
art 8.7
close 8.6
businesspeople 8.5
stone 8.5
face 8.5
senior 8.4
church 8.3
20s 8.2
mother 8.2
indoor 8.2
businesswoman 8.2
cheerful 8.1
symbol 8.1
looking 8
women 7.9
day 7.8
child 7.8
professional 7.8
30s 7.7
two 7.6
sign 7.5
closeup 7.4
letter 7.3
worker 7.2
home 7.2
smile 7.1
love 7.1

Google
created on 2019-06-06

Photograph 96.7
People 96
Snapshot 86
Team 70.5
Family 64.5
History 62.6
Photography 62.4
Crew 61.7
Class 51.8

Microsoft
created on 2019-06-06

posing 98.6
clothing 97.8
handwriting 97.7
person 96.6
human face 95.7
smile 93.1
old 91.8
black 86.9
standing 75.6
player 68.3
man 68.1
group 65
child 59.5
photograph 52.8
team 40.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Female, 54.9%
Surprised 45.1%
Happy 46.9%
Confused 45.1%
Calm 45.2%
Disgusted 45.1%
Angry 45.1%
Sad 52.6%

AWS Rekognition

Age 14-23
Gender Female, 53.5%
Surprised 45.1%
Sad 51%
Disgusted 45.1%
Happy 45.8%
Confused 45.1%
Calm 47.5%
Angry 45.3%

AWS Rekognition

Age 15-25
Gender Male, 51.5%
Angry 48.9%
Disgusted 45%
Calm 45.2%
Surprised 45%
Happy 45%
Sad 50.6%
Confused 45.1%

AWS Rekognition

Age 11-18
Gender Female, 54.9%
Calm 45.1%
Confused 45%
Happy 45%
Surprised 45%
Angry 45.1%
Disgusted 45%
Sad 54.7%

AWS Rekognition

Age 23-38
Gender Female, 54.7%
Calm 45.4%
Disgusted 45%
Surprised 45.1%
Confused 45.2%
Angry 51.1%
Sad 48%
Happy 45.2%

AWS Rekognition

Age 15-25
Gender Male, 52.3%
Calm 48%
Surprised 45.1%
Happy 45.5%
Angry 45.5%
Confused 45.3%
Sad 49.9%
Disgusted 45.6%

AWS Rekognition

Age 14-25
Gender Female, 54.2%
Calm 45%
Angry 45.2%
Happy 45%
Sad 54.6%
Surprised 45%
Confused 45%
Disgusted 45.1%

AWS Rekognition

Age 35-52
Gender Female, 51.5%
Sad 51.1%
Disgusted 45.4%
Surprised 45.2%
Happy 45.1%
Confused 45.1%
Calm 47.8%
Angry 45.3%

AWS Rekognition

Age 10-15
Gender Female, 54.3%
Surprised 45%
Happy 45.1%
Sad 54.4%
Angry 45.3%
Disgusted 45%
Confused 45%
Calm 45.2%

AWS Rekognition

Age 35-52
Gender Female, 54.9%
Angry 45.4%
Confused 45.1%
Calm 46%
Surprised 45.1%
Sad 52.7%
Happy 45.5%
Disgusted 45.2%

AWS Rekognition

Age 16-27
Gender Female, 54.7%
Calm 45%
Sad 52.5%
Happy 45.3%
Confused 45.1%
Angry 46.8%
Surprised 45.1%
Disgusted 45.1%

AWS Rekognition

Age 20-38
Gender Female, 51.6%
Happy 45.1%
Sad 45.4%
Angry 45.1%
Surprised 45.1%
Calm 53.8%
Confused 45.1%
Disgusted 45.5%

AWS Rekognition

Age 15-25
Gender Female, 54.9%
Disgusted 45.3%
Happy 45.1%
Angry 52.9%
Surprised 45.1%
Sad 46.1%
Confused 45.2%
Calm 45.4%

AWS Rekognition

Age 35-52
Gender Female, 52.1%
Calm 45.6%
Happy 45.3%
Sad 53.3%
Angry 45.3%
Confused 45.1%
Disgusted 45.3%
Surprised 45.1%

AWS Rekognition

Age 16-27
Gender Female, 54.6%
Calm 46.8%
Angry 45.5%
Happy 45.7%
Sad 49.9%
Surprised 45.6%
Confused 46.1%
Disgusted 45.4%

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Categories

Imagga

people portraits 85.4%
paintings art 14.3%

Text analysis

Amazon

A
lewish.
Germor
Germor onod lewish.
A GiTIS C'lul.
C'lul.
onod
GiTIS
t6

Google

A GIrls G lub. Jewish. Germ on and
A
GIrls
G
lub.
Jewish.
Germ
on
and