Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "University House": University House, Philadelphia, Pa.: One of the Clubs

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3270.2

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "University House": University House, Philadelphia, Pa.: One of the Clubs

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-07-02

Person 99.6
Human 99.6
Person 99.5
Person 98.7
Person 98
Person 97.7
Room 96.2
Indoors 96.2
Person 95
Person 94.7
Person 93.5
People 91.9
Person 89.7
Person 86.6
Painting 86.6
Art 86.6
Person 76.8
Person 76.1
Person 69.6
Person 68.2
Person 51.6

Imagga
created on 2022-07-02

kin 66.7
man 31.6
people 28.4
couple 27
male 22.1
person 21.4
love 16.6
happy 16.3
classroom 16.1
adult 16.1
room 15.5
portrait 15.5
old 15.3
groom 15.3
two 14.4
child 14.3
smiling 13.7
bride 13.4
family 13.3
happiness 13.3
group 12.9
men 12.9
businessman 12.4
together 12.3
women 11.9
student 11.8
husband 11.6
home 11.2
camera 11.1
wedding 11
education 10.4
world 10.3
business 10.3
20s 10.1
cheerful 9.7
outdoors 9.7
mother 9.6
married 9.6
standing 9.6
wife 9.5
senior 9.4
youth 9.4
school 9.3
park 9.1
dress 9
boy 8.7
lifestyle 8.7
ancient 8.6
holiday 8.6
marriage 8.5
friends 8.4
vintage 8.3
retro 8.2
aged 8.1
new 8.1
religion 8.1
romance 8
romantic 8
day 7.8
teacher 7.8
tree 7.7
hand 7.6
religious 7.5
future 7.4
success 7.2
team 7.2
indoors 7

Google
created on 2022-07-02

Microsoft
created on 2022-07-02

clothing 98.6
old 97.8
text 97.3
person 97.1
posing 87.5
group 85.4
human face 78.6
child 78.6
woman 76.8
smile 68.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Female, 99.5%
Calm 97%
Surprised 6.5%
Fear 6%
Sad 2.4%
Angry 0.6%
Confused 0.4%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 11-19
Gender Female, 100%
Calm 98.8%
Surprised 6.4%
Fear 6%
Sad 2.3%
Happy 0.1%
Disgusted 0.1%
Angry 0%
Confused 0%

AWS Rekognition

Age 37-45
Gender Female, 100%
Calm 99.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Angry 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 18-24
Gender Male, 100%
Calm 99.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.2%
Confused 0.1%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 22-30
Gender Female, 99.6%
Calm 96.4%
Surprised 6.7%
Fear 6%
Sad 2.4%
Happy 0.7%
Angry 0.6%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 24-34
Gender Female, 100%
Calm 94.9%
Surprised 6.4%
Fear 5.9%
Sad 2.4%
Angry 1.8%
Disgusted 1.1%
Confused 0.8%
Happy 0.1%

AWS Rekognition

Age 28-38
Gender Female, 100%
Fear 91.9%
Surprised 23.6%
Sad 2.3%
Calm 1.6%
Disgusted 1.1%
Confused 0.6%
Happy 0.5%
Angry 0.5%

AWS Rekognition

Age 26-36
Gender Female, 99.7%
Calm 99.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.3%
Happy 0.1%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 23-33
Gender Female, 100%
Happy 79.4%
Confused 12.9%
Surprised 7.4%
Fear 6.2%
Sad 2.4%
Angry 2.1%
Calm 1.3%
Disgusted 0.6%

AWS Rekognition

Age 24-34
Gender Male, 76.9%
Calm 99.2%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.2%
Angry 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 19-27
Gender Female, 97.5%
Calm 98.7%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Angry 0.3%
Confused 0.2%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 18-26
Gender Female, 88.7%
Calm 74.5%
Fear 9.9%
Surprised 7.7%
Happy 4.7%
Sad 3.2%
Angry 2.4%
Disgusted 2.3%
Confused 2.3%

AWS Rekognition

Age 4-12
Gender Male, 61.2%
Calm 74.4%
Angry 8.1%
Surprised 7%
Sad 6.6%
Fear 6.2%
Confused 5.2%
Happy 1.2%
Disgusted 0.7%

AWS Rekognition

Age 14-22
Gender Female, 100%
Calm 99.5%
Surprised 6.3%
Fear 6%
Sad 2.2%
Angry 0.1%
Confused 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 6-14
Gender Female, 100%
Happy 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0%
Confused 0%
Calm 0%
Disgusted 0%

AWS Rekognition

Age 18-24
Gender Female, 99.6%
Calm 53.7%
Confused 32.4%
Fear 10.6%
Surprised 7.7%
Sad 2.4%
Disgusted 0.3%
Angry 0.3%
Happy 0.2%

AWS Rekognition

Age 6-12
Gender Female, 100%
Angry 44.7%
Calm 33%
Sad 13.7%
Fear 7.9%
Surprised 7.6%
Confused 0.6%
Happy 0.4%
Disgusted 0.3%

AWS Rekognition

Age 6-14
Gender Male, 94.7%
Calm 82.4%
Sad 11.3%
Surprised 7.1%
Fear 6%
Angry 2%
Happy 0.6%
Disgusted 0.4%
Confused 0.4%

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 15
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 61
Gender Male

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 24
Gender Male

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 14
Gender Female

Microsoft Cognitive Services

Age 48
Gender Female

Microsoft Cognitive Services

Age 8
Gender Female

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 37
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Painting 86.6%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 93.5%
a vintage photo of a group of people posing for a picture 93.4%
a group of people posing for a photo 93.3%

Text analysis

Amazon

SRR

Google

SRR
SRR match
match