Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "The Lighthouse": The Lighthouse, Philadelphia, Pa.: Chess and Checkers Club.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3232.1

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "The Lighthouse": The Lighthouse, Philadelphia, Pa.: Chess and Checkers Club.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3232.1

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Person 98.2
Human 98.2
Person 98
Person 97.1
Person 97
Person 96.5
Person 96.4
Person 96
Person 95.5
Person 95
Person 94.8
Person 94.7
Apparel 94.5
Suit 94.5
Clothing 94.5
Coat 94.5
Overcoat 94.5
Suit 92.6
Person 91.6
Suit 87.8
People 79
Tie 76.3
Accessories 76.3
Accessory 76.3
Suit 74.1
Tie 68.2
Sitting 65.8
Military Uniform 60.9
Military 60.9
Jury 59.6
Crowd 57.9
Footwear 57.5
Shoe 57.5
Audience 56.7

Clarifai
created on 2019-06-07

people 99.9
group 99.7
many 99.6
leader 98.3
group together 97.6
adult 97.1
administration 96.7
portrait 95.6
woman 95.5
military 95
man 93.5
child 91.3
several 90.2
school 89.8
war 89.4
chair 89.3
wear 85.7
offense 84.9
education 83.9
music 82.3

Imagga
created on 2019-06-07

military uniform 34.8
uniform 33.3
man 30.9
people 30.1
kin 28.6
person 27.1
male 24.1
clothing 23.8
adult 21.7
group 19.3
business 18.2
room 17.1
happy 16.9
couple 15.7
portrait 15.5
men 14.6
brass 14.1
businessman 14.1
consumer goods 14.1
covering 13.6
family 13.3
happiness 13.3
classroom 13.3
student 11.8
team 11.6
smiling 11.6
love 11
wind instrument 11
old 10.4
women 10.3
black 10.2
youth 10.2
dress 9.9
professional 9.7
home 9.6
boy 9.5
indoor 9.1
fashion 9
cheerful 8.9
new 8.9
interior 8.8
together 8.7
lifestyle 8.7
bride 8.6
senior 8.4
attractive 8.4
musical instrument 8.3
camera 8.3
vintage 8.3
girls 8.2
businesswoman 8.2
child 8
indoors 7.9
standing 7.8
education 7.8
30s 7.7
four 7.7
meeting 7.5
human 7.5
fun 7.5
silhouette 7.4
wedding 7.3
school 7.3
success 7.2
office 7.2
life 7.2
looking 7.2
smile 7.1
mother 7.1

Google
created on 2019-06-07

Team 64.1
Family 56.6

Microsoft
created on 2019-06-07

person 99.4
posing 99.2
wall 99.1
clothing 98.9
smile 94.9
group 91.8
man 91.4
old 88.6
suit 67.3
human face 53.9
footwear 51.6
dressed 39.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 52.1%
Angry 45.8%
Calm 45.3%
Happy 45.1%
Sad 47.2%
Disgusted 51%
Surprised 45.1%
Confused 45.4%

AWS Rekognition

Age 45-65
Gender Male, 54.9%
Surprised 45.4%
Angry 45.2%
Calm 51.5%
Sad 45.4%
Confused 45.4%
Disgusted 45.1%
Happy 47%

AWS Rekognition

Age 35-52
Gender Male, 54%
Happy 46%
Sad 50%
Surprised 45.2%
Angry 45.6%
Calm 47%
Disgusted 45.8%
Confused 45.4%

AWS Rekognition

Age 48-68
Gender Male, 52.5%
Disgusted 45.1%
Surprised 45.3%
Sad 48.5%
Confused 45.2%
Calm 45.5%
Happy 50.1%
Angry 45.3%

AWS Rekognition

Age 35-52
Gender Male, 55%
Sad 47.4%
Surprised 45.3%
Calm 46.9%
Disgusted 47.3%
Confused 45.4%
Angry 45.8%
Happy 46.9%

AWS Rekognition

Age 35-52
Gender Male, 54.3%
Happy 45.8%
Angry 46%
Calm 49.7%
Surprised 45.4%
Disgusted 45.3%
Sad 47%
Confused 45.9%

AWS Rekognition

Age 38-59
Gender Male, 54.4%
Happy 45.5%
Surprised 45.2%
Sad 47.2%
Confused 45.2%
Disgusted 46.4%
Calm 48.1%
Angry 47.3%

AWS Rekognition

Age 29-45
Gender Male, 54.8%
Surprised 45%
Happy 45%
Calm 45.1%
Angry 45%
Disgusted 45%
Sad 54.8%
Confused 45%

AWS Rekognition

Age 57-77
Gender Male, 54.5%
Surprised 45.2%
Angry 52.1%
Sad 45.4%
Disgusted 45.7%
Happy 45.3%
Calm 46.1%
Confused 45.3%

AWS Rekognition

Age 35-52
Gender Male, 53.2%
Calm 48.8%
Surprised 46.4%
Confused 45.5%
Angry 45.9%
Sad 47%
Happy 45.6%
Disgusted 45.8%

AWS Rekognition

Age 38-57
Gender Male, 54.6%
Calm 46.2%
Sad 45.2%
Surprised 45.2%
Disgusted 45.2%
Angry 52.7%
Confused 45.1%
Happy 45.5%

AWS Rekognition

Age 38-59
Gender Male, 55%
Disgusted 45%
Angry 45.3%
Sad 48.8%
Happy 46.5%
Calm 49%
Surprised 45.1%
Confused 45.3%

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 55
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Suit 94.5%
Tie 76.3%
Shoe 57.5%

Categories

Text analysis

Amazon

ond
Checkers
Club.
Chsss ond Checkers Club.
Chsss

Google

Chess ond Checkers Club.
Chess
ond
Checkers
Club.