Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "The Lighthouse": The Lighthouse, Philadelphia, Pa.: Basketball team.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3233.2

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "The Lighthouse": The Lighthouse, Philadelphia, Pa.: Basketball team.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3233.2

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 99.3
Person 99.3
Person 99.1
Person 99.1
Person 98.6
Person 98.1
Person 97.2
Person 95.5
Person 90.4
Boy 87.3
People 84.8
Person 75.3
Kindergarten 59
Clothing 58
Apparel 58

Clarifai
created on 2019-06-07

people 99.9
group 99.5
child 99.5
portrait 98.7
woman 97.4
adult 96.8
education 95.8
son 94.6
school 92.5
family 92.2
facial expression 92.1
offspring 91.9
room 91.8
boy 91.6
five 91.2
furniture 91
man 90.6
many 90.4
four 90.2
several 90

Imagga
created on 2019-06-07

kin 100
family 40.9
happy 37
child 34.6
mother 30.6
people 29.6
happiness 28.2
father 24.7
portrait 24.6
children 23.7
love 23.7
man 23.5
smiling 23.2
male 23.1
kid 23
couple 22.7
smile 21.4
together 20.2
home 19.9
cheerful 19.5
boy 19.1
group 18.5
cute 17.9
daughter 17.7
attractive 17.5
person 17.2
childhood 17
parent 16.4
adult 16.2
holding 15.7
women 15
girls 14.6
lifestyle 14.5
two 14.4
fun 14.2
kids 14.1
friends 13.2
interior 12.4
gift 12
men 12
pretty 11.9
little 11.5
holiday 11.5
indoors 11.4
son 11.4
dad 11.4
friendship 11.2
looking 11.2
casual 11
face 10.7
brother 10.6
baby 10.3
relationship 10.3
youth 10.2
classroom 10.1
year 10
joy 10
dress 9.9
parents 9.8
new 9.7
boys 9.7
husband 9.5
sitting 9.4
togetherness 9.4
room 9.4
life 8.8
mom 8.7
brunette 8.7
couch 8.7
30s 8.7
diversity 8.6
four 8.6
color 8.3
school 8.2
black 8.1
success 8
celebration 8
teacher 7.9
old 7.7
sofa 7.7
ethnic 7.6
studio 7.6
wife 7.6
enjoying 7.6
domestic 7.6
house 7.5
traditional 7.5
adorable 7.4
lady 7.3
indoor 7.3
hat 7.3
team 7.2
romantic 7.1
clothing 7

Google
created on 2019-06-07

Microsoft
created on 2019-06-07

clothing 98.4
smile 98
human face 93.1
person 89.2
family 71.9
child 59.7
boy 52.9
posing 42.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Female, 54.1%
Surprised 2.3%
Disgusted 0.5%
Happy 0.6%
Sad 3.2%
Angry 2%
Calm 88.4%
Confused 3%

AWS Rekognition

Age 14-25
Gender Male, 82.4%
Surprised 2.8%
Disgusted 0.1%
Sad 5.5%
Angry 2.8%
Calm 85.1%
Happy 0.2%
Confused 3.6%

AWS Rekognition

Age 26-43
Gender Female, 50.7%
Calm 49.2%
Disgusted 45.4%
Angry 45.5%
Sad 46.2%
Surprised 46.9%
Confused 46.4%
Happy 45.3%

AWS Rekognition

Age 16-27
Gender Female, 52.8%
Angry 45.4%
Happy 45.1%
Confused 45.2%
Disgusted 45.1%
Sad 45.5%
Surprised 45.1%
Calm 53.7%

AWS Rekognition

Age 10-15
Gender Female, 62.6%
Calm 78.1%
Surprised 1.5%
Confused 4%
Angry 6.4%
Sad 2.8%
Happy 0.7%
Disgusted 6.6%

AWS Rekognition

Age 11-18
Gender Male, 54.6%
Calm 50.8%
Sad 46.7%
Surprised 45.3%
Disgusted 45.2%
Angry 45.8%
Confused 46.3%
Happy 45%

AWS Rekognition

Age 17-27
Gender Male, 78.2%
Sad 1.2%
Disgusted 0.5%
Confused 2.1%
Happy 0.2%
Angry 1.3%
Surprised 1.8%
Calm 92.9%

AWS Rekognition

Age 26-43
Gender Male, 93%
Surprised 13.8%
Angry 23.4%
Sad 13.4%
Disgusted 2.1%
Happy 1.1%
Calm 35.5%
Confused 10.7%

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 21
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 50
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Categories

Imagga

people portraits 99.6%

Text analysis

Amazon

L
Bos
team.
kef
07
Bo'sket Bos kef bal! team.
Bo'sket
bal!

Google

T Basket bal team.
Basket
team.
T
bal