Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Christodora House": Christodora House, New York City.: One of the Clubs
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3155.3

Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Christodora House": Christodora House, New York City.: One of the Clubs

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3155.3

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Person 98.1
Human 98.1
Person 98
Person 97.9
Person 97.3
Person 97
Tie 96.9
Accessories 96.9
Accessory 96.9
Person 95.3
Person 94.8
Tie 94.3
Person 93.6
Face 92
Person 90.6
Person 88.7
Person 87.8
Text 86.8
Crowd 83.1
Tie 82.2
Tie 80.5
Person 79.9
Tie 78.7
Suit 77
Apparel 77
Coat 77
Clothing 77
Overcoat 77
Suit 73.9
Tie 73.1
People 68.1
Tie 67.5
Head 64.2
Suit 64.2
Suit 63.6
Suit 60.9
Jury 59.4
Sailor Suit 58.7
Audience 58.4

Clarifai
created on 2019-06-06

people 99.9
group 99.9
many 99.3
leader 99.2
adult 98.6
portrait 98.3
group together 97.9
several 97
administration 96.4
retro 95.3
wear 93.2
man 92.8
five 92.2
facial expression 91.1
music 90.5
outfit 86.7
woman 86.2
musician 81.1
four 80.5
offense 80.4

Imagga
created on 2019-06-06

mug shot 100
photograph 100
representation 96.3
creation 65.6
business 23.7
man 23.5
money 20.4
currency 19.7
people 19.5
male 17.7
banking 16.5
cash 16.5
bill 16.2
dollar 15.8
person 15.6
happy 14.4
portrait 14.2
financial 13.4
old 13.2
vintage 13.2
senior 13.1
adult 13
success 12.9
face 12.8
smiling 12.3
finance 11.8
bank 11.8
wealth 11.7
couple 11.3
office 11.2
one 11.2
savings 11.2
paper 11
close 10.8
stamp 10.6
dollars 10.6
mail 10.5
exchange 10.5
investment 10.1
letter 10.1
smile 10
postmark 9.8
businessman 9.7
envelope 9.6
child 9.5
cartoon 8.9
group 8.9
hundred 8.7
us 8.7
work 8.6
design 8.4
economy 8.3
team 8.1
family 8
postage 7.9
black 7.8
men 7.7
card 7.6
wife 7.6
sign 7.5
symbol 7.4
art 7.4
retro 7.4
message 7.3
laptop 7.3
aged 7.2
home 7.2

Google
created on 2019-06-06

Photograph 95.3
People 93.1
Team 76.1
History 69.9
Family 60.9
Art 50.2

Microsoft
created on 2019-06-06

posing 99.8
wall 99.6
person 98.6
human face 98.3
group 96.9
text 96.5
clothing 95.3
man 94.2
newspaper 94
handwriting 93.7
smile 93.5
old 91.4
black 90.2
people 67.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 56.9%
Sad 9.5%
Angry 10.2%
Disgusted 9.3%
Surprised 6.3%
Happy 1.5%
Calm 60.2%
Confused 3%

AWS Rekognition

Age 14-25
Gender Male, 96.2%
Angry 0.1%
Happy 99.5%
Confused 0.1%
Surprised 0.1%
Sad 0.2%
Disgusted 0%
Calm 0%

AWS Rekognition

Age 20-38
Gender Female, 52.7%
Angry 45.2%
Calm 46.3%
Sad 49.4%
Surprised 45.1%
Disgusted 45.1%
Happy 48.9%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 99.4%
Calm 57.3%
Sad 12.6%
Happy 1%
Confused 2%
Angry 24.8%
Surprised 2%
Disgusted 0.5%

AWS Rekognition

Age 23-38
Gender Male, 86.7%
Angry 0.2%
Happy 12.5%
Disgusted 1.3%
Confused 0.4%
Calm 83.9%
Surprised 0.9%
Sad 0.8%

AWS Rekognition

Age 19-36
Gender Male, 86.7%
Calm 8.3%
Surprised 2.9%
Happy 8.7%
Angry 3.9%
Confused 2.8%
Sad 69.6%
Disgusted 3.8%

AWS Rekognition

Age 20-38
Gender Male, 54.3%
Confused 45.6%
Disgusted 45.1%
Calm 51.4%
Sad 47%
Angry 45.3%
Happy 45.3%
Surprised 45.3%

AWS Rekognition

Age 19-36
Gender Male, 54.6%
Calm 48.1%
Sad 50.6%
Surprised 45.1%
Angry 45.5%
Happy 45.1%
Confused 45.3%
Disgusted 45.3%

AWS Rekognition

Age 15-25
Gender Male, 54.4%
Calm 49.7%
Sad 46.4%
Confused 45.3%
Angry 45.7%
Disgusted 47.7%
Surprised 45.2%
Happy 45.1%

AWS Rekognition

Age 15-25
Gender Male, 54.1%
Calm 50.4%
Confused 45.6%
Happy 45.2%
Disgusted 45.1%
Sad 48.1%
Angry 45.3%
Surprised 45.4%

AWS Rekognition

Age 19-36
Gender Male, 54.8%
Angry 45.1%
Surprised 45.2%
Disgusted 45.1%
Calm 47.8%
Sad 47.3%
Happy 49.1%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Male, 92.4%
Calm 86.3%
Disgusted 1.7%
Surprised 0.9%
Confused 0.6%
Angry 4.2%
Sad 5.7%
Happy 0.6%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%
Tie 96.9%
Suit 77%

Categories

Imagga

people portraits 97.3%
paintings art 1.3%

Text analysis

Amazon

the
of
One of the C'luks
srr
One
C'luks

Google

One af he Clubs
One
af
he
Clubs