Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "The Lighthouse": The Lighthouse, Philadelphia, Pa.: Quoit Club.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3229.2

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "The Lighthouse": The Lighthouse, Philadelphia, Pa.: Quoit Club.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3229.2

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 99.4
Person 99.4
Person 99.4
Person 99.3
Person 98.1
Person 97.9
Person 97.5
Person 94.8
Person 93.1
Person 91.6
Person 91.2
Poster 87.1
Advertisement 87.1
Person 85.5
Indoors 85
Room 85
Person 80.1
People 78.3
Apparel 77.9
Clothing 77.9
Person 76.2
Leisure Activities 70.7
School 67.4
Classroom 67.4
Boy 64.8
Person 62.8
Person 61.7
Musical Instrument 55.1
Musician 55.1
Person 42.4

Clarifai
created on 2019-06-07

people 99.9
group 99.7
many 98.7
adult 97
woman 96.5
child 96.3
group together 96.2
education 94.3
music 94.1
man 94
wear 91
school 91
several 90.6
teacher 89.2
portrait 86.9
administration 86
musician 85.9
war 83.5
outfit 82.9
military 82.1

Imagga
created on 2019-06-07

person 28.4
people 24.5
man 23.6
male 21.3
black 21.1
happy 18.8
adult 18.3
dance 16.4
portrait 16.2
group 16.1
gymnasium 15.4
clothing 15.1
classroom 14.7
attractive 14.7
fun 13.5
boy 13
kin 12.9
child 12.9
active 12.7
love 12.6
athletic facility 12.4
sport 12
body 12
room 11.3
fashion 11.3
men 11.2
youth 11.1
model 10.9
fitness 10.8
silhouette 10.8
dancing 10.6
sexy 10.4
smile 10
human 9.7
facility 9.7
one 9.7
style 9.6
couple 9.6
women 9.5
friends 9.4
world 9.1
girls 9.1
lady 8.9
family 8.9
nightlife 8.8
nightclub 8.8
together 8.8
smiling 8.7
lifestyle 8.7
player 8.5
friendship 8.4
pretty 8.4
vintage 8.4
hand 8.3
dark 8.3
teenager 8.2
exercise 8.2
ball 8.1
art 8.1
dancer 8
cute 7.9
holiday 7.9
performer 7.8
face 7.8
party 7.7
two 7.6
action 7.4
teen 7.3
water 7.3
business 7.3
planner 7.2
color 7.2
looking 7.2
team 7.2
hair 7.1
posing 7.1
businessman 7.1

Google
created on 2019-06-07

Photograph 96.1
Snapshot 82.9
Team 74.5
Room 65.7
Art 65.5
Photography 62.4
History 60.4
Family 53.1

Microsoft
created on 2019-06-07

posing 99
wall 99
old 97.2
clothing 96.6
person 95.6
group 88.2
man 86.4
standing 80.3
black 67.6
people 64.4
smile 63.5
vintage 42.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 54.9%
Angry 45.6%
Confused 45.3%
Disgusted 45.2%
Surprised 45.2%
Calm 51.9%
Sad 45.2%
Happy 46.7%

AWS Rekognition

Age 38-59
Gender Male, 55%
Happy 45.6%
Calm 53.3%
Disgusted 45.2%
Angry 45.2%
Surprised 45.3%
Sad 45.1%
Confused 45.3%

AWS Rekognition

Age 45-66
Gender Male, 54.7%
Disgusted 45.6%
Confused 45.8%
Happy 46.3%
Calm 49.6%
Surprised 46.2%
Angry 46%
Sad 45.5%

AWS Rekognition

Age 45-63
Gender Male, 54.5%
Angry 45.2%
Calm 53.6%
Confused 45.2%
Happy 45.2%
Surprised 45.6%
Disgusted 45.1%
Sad 45.1%

AWS Rekognition

Age 35-55
Gender Male, 55%
Calm 48.9%
Sad 46%
Surprised 45.3%
Disgusted 45.3%
Angry 46.4%
Confused 46.1%
Happy 46.9%

AWS Rekognition

Age 38-57
Gender Male, 54.2%
Disgusted 45.6%
Happy 47%
Confused 45.9%
Sad 46.8%
Angry 45.8%
Surprised 45.6%
Calm 48.4%

AWS Rekognition

Age 16-27
Gender Female, 54.9%
Angry 45%
Surprised 45%
Confused 45%
Sad 54.9%
Disgusted 45%
Happy 45%
Calm 45%

AWS Rekognition

Age 38-57
Gender Male, 54.9%
Sad 45.2%
Confused 45.7%
Disgusted 45.2%
Calm 51.8%
Happy 45.6%
Angry 45.3%
Surprised 46.2%

AWS Rekognition

Age 35-52
Gender Male, 54.2%
Happy 45.5%
Angry 46.3%
Calm 49.4%
Surprised 45.9%
Disgusted 45.9%
Confused 45.7%
Sad 46.3%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Angry 45.5%
Happy 45.3%
Disgusted 45.1%
Sad 45.8%
Confused 45.4%
Surprised 45.1%
Calm 52.7%

AWS Rekognition

Age 48-68
Gender Male, 53.1%
Happy 45.2%
Sad 45.1%
Surprised 45.5%
Angry 45.2%
Calm 53.6%
Disgusted 45.2%
Confused 45.2%

AWS Rekognition

Age 48-68
Gender Male, 54.9%
Happy 45.2%
Angry 45.6%
Surprised 45.2%
Disgusted 45.3%
Confused 45.6%
Calm 48.5%
Sad 49.4%

AWS Rekognition

Age 35-52
Gender Male, 54.8%
Disgusted 45.3%
Surprised 47.3%
Angry 45.6%
Happy 45.5%
Sad 45.2%
Calm 50%
Confused 46.1%

AWS Rekognition

Age 38-59
Gender Male, 55%
Sad 54.8%
Angry 45.1%
Happy 45%
Disgusted 45%
Calm 45%
Surprised 45%
Confused 45.1%

AWS Rekognition

Age 38-59
Gender Male, 55%
Angry 46.5%
Calm 51.1%
Confused 45.7%
Happy 45.2%
Surprised 45.1%
Disgusted 45.9%
Sad 45.4%

AWS Rekognition

Age 26-43
Gender Male, 54.7%
Sad 45.3%
Confused 45.3%
Calm 49.7%
Angry 47.4%
Disgusted 45.4%
Happy 45.1%
Surprised 46.8%

AWS Rekognition

Age 60-90
Gender Male, 51.5%
Disgusted 45.1%
Surprised 45.1%
Sad 45%
Confused 45%
Calm 54.6%
Happy 45%
Angry 45%

AWS Rekognition

Age 45-65
Gender Male, 54.7%
Surprised 45.3%
Angry 45.4%
Confused 45.5%
Sad 45.1%
Calm 52.6%
Disgusted 45.4%
Happy 45.7%

AWS Rekognition

Age 26-43
Gender Male, 54%
Happy 45.1%
Surprised 45.2%
Sad 52.2%
Confused 45.4%
Disgusted 45.1%
Calm 46.4%
Angry 45.6%

AWS Rekognition

Age 35-55
Gender Male, 54.8%
Confused 47.3%
Sad 45.4%
Happy 46.6%
Disgusted 45.7%
Surprised 46.8%
Angry 46%
Calm 47.2%

AWS Rekognition

Age 23-38
Gender Female, 54.8%
Happy 45.9%
Sad 52.7%
Surprised 45.1%
Angry 45.3%
Calm 45.5%
Disgusted 45.1%
Confused 45.4%

AWS Rekognition

Age 35-55
Gender Male, 54.6%
Disgusted 45.2%
Angry 45.4%
Surprised 45.1%
Happy 45.2%
Sad 53.4%
Calm 45.3%
Confused 45.3%

Microsoft Cognitive Services

Age 59
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Poster 87.1%

Categories

Imagga

interior objects 98.9%

Text analysis

Amazon

Cluk.
Quoit Cluk.
Quoit

Google

Quoit Club.
Quoit
Club.