Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Pittsburgh. "Kingsley House": Kingsley House, Pittsburg, Pa.: Younger members of boys' clubs.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3277.2

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Pittsburgh. "Kingsley House": Kingsley House, Pittsburg, Pa.: Younger members of boys' clubs.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3277.2

Machine Generated Data

Tags

Amazon
created on 2022-07-02

School 99.7
Room 99.6
Classroom 99.6
Indoors 99.6
Person 99.4
Human 99.4
Person 99.3
Person 99.2
Person 99
Person 98.6
Person 98.3
Person 97.9
Person 97.4
Person 97.4
Person 94
Person 81.9
Person 78.2
Person 77.7
Person 73.1
Person 71.7
Person 67
Person 65.4
Person 64.3
Person 63.7
Person 62.8
Kindergarten 59.1
People 56.2
Person 53.4

Imagga
created on 2022-07-02

statue 31.6
sculpture 30.1
stone 28.4
old 27.2
architecture 24.2
ancient 22.5
history 20.6
cemetery 19.3
religion 18.8
travel 18.3
monument 17.7
art 16.4
antique 15.7
culture 15.4
historical 15
historic 14.7
building 14.6
tourism 14
landmark 13.5
city 12.5
memorial 12.3
temple 11.9
traditional 11.6
heritage 11.6
structure 11.3
famous 11.2
religious 10.3
people 9.5
plaything 9.3
place 9.3
decoration 9.2
detail 8.8
fountain 8.8
palace 8.7
style 8.2
grave 8
wall 8
marble 7.9
brick 7.8
chime 7.7
world 7.5
outdoors 7.5
vintage 7.4
textured 7

Google
created on 2022-07-02

Photograph 94.2
Headgear 83.3
Monochrome 76.6
Team 76
Vintage clothing 75.2
Crew 75.2
Event 73.1
Child 70.6
Building 68.2
History 66.8
Crowd 66.5
Stock photography 65
Room 63.1
Monochrome photography 62.4
Class 62
City 58.6
Window 58.2
Uniform 57.9
Suit 53.8
Photography 51.6

Microsoft
created on 2022-07-02

clothing 98.5
person 93.8
old 86
group 85
posing 74.6
child 69.3
text 68.4
man 59.1
photograph 57.5
crowd 4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 13-21
Gender Male, 100%
Calm 57.9%
Sad 24.7%
Surprised 13%
Fear 6.5%
Angry 6%
Happy 3.1%
Confused 2.5%
Disgusted 0.5%

AWS Rekognition

Age 14-22
Gender Male, 92.7%
Confused 59.9%
Sad 40.7%
Surprised 7%
Calm 6.8%
Fear 6.2%
Angry 5.7%
Disgusted 0.8%
Happy 0.4%

AWS Rekognition

Age 16-22
Gender Male, 95.2%
Calm 99.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.1%
Confused 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 20-28
Gender Female, 100%
Calm 99.1%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.2%
Angry 0.2%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 9-17
Gender Male, 97.8%
Calm 78.8%
Surprised 6.9%
Angry 6.7%
Fear 6.3%
Happy 4.3%
Confused 3.7%
Sad 3.1%
Disgusted 1.6%

AWS Rekognition

Age 7-17
Gender Female, 59.4%
Sad 93.3%
Calm 17.5%
Angry 15.5%
Fear 9.9%
Surprised 8.9%
Confused 5.7%
Happy 1.7%
Disgusted 1.6%

AWS Rekognition

Age 22-30
Gender Male, 99.1%
Angry 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Calm 0.1%
Confused 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 19-27
Gender Male, 99.7%
Calm 94%
Surprised 6.4%
Fear 5.9%
Angry 3.5%
Sad 2.2%
Confused 0.9%
Happy 0.8%
Disgusted 0.1%

AWS Rekognition

Age 18-24
Gender Male, 100%
Calm 91.8%
Surprised 6.8%
Fear 5.9%
Confused 3.8%
Sad 2.3%
Happy 1.4%
Angry 1.4%
Disgusted 0.1%

AWS Rekognition

Age 29-39
Gender Male, 92.1%
Calm 49.4%
Angry 41%
Surprised 7.1%
Fear 6.2%
Confused 2.8%
Sad 2.6%
Happy 1.6%
Disgusted 1.4%

AWS Rekognition

Age 19-27
Gender Male, 99.6%
Sad 90.9%
Calm 27%
Angry 24.4%
Surprised 6.7%
Fear 6.7%
Happy 1.7%
Confused 1%
Disgusted 0.3%

AWS Rekognition

Age 10-18
Gender Female, 60.1%
Calm 93.4%
Surprised 6.5%
Fear 6%
Sad 3.5%
Happy 1.1%
Confused 0.6%
Angry 0.6%
Disgusted 0.1%

AWS Rekognition

Age 2-8
Gender Female, 68%
Calm 80.3%
Surprised 8.8%
Fear 6.8%
Confused 4.8%
Sad 3.2%
Happy 2.5%
Angry 2%
Disgusted 0.9%

AWS Rekognition

Age 6-12
Gender Male, 99%
Calm 76.9%
Confused 9%
Sad 8.3%
Surprised 6.6%
Fear 6%
Angry 1.9%
Disgusted 0.7%
Happy 0.5%

AWS Rekognition

Age 16-22
Gender Male, 82.4%
Calm 62.5%
Sad 30.6%
Confused 9.5%
Surprised 6.8%
Fear 6.4%
Angry 1.9%
Disgusted 1.7%
Happy 0.9%

AWS Rekognition

Age 25-35
Gender Male, 100%
Sad 91.1%
Confused 32.5%
Calm 20.6%
Surprised 6.5%
Fear 6.1%
Angry 1.7%
Happy 0.7%
Disgusted 0.4%

AWS Rekognition

Age 10-18
Gender Male, 99.9%
Sad 98.5%
Calm 35%
Surprised 7.4%
Fear 6.2%
Confused 4.6%
Angry 1%
Happy 0.5%
Disgusted 0.2%

AWS Rekognition

Age 16-24
Gender Female, 74.3%
Calm 92.5%
Surprised 6.8%
Fear 6%
Angry 2.8%
Sad 2.6%
Confused 1.2%
Happy 0.5%
Disgusted 0.3%

AWS Rekognition

Age 11-19
Gender Male, 83.3%
Calm 75.9%
Angry 7.8%
Surprised 7.2%
Fear 6.2%
Confused 5%
Sad 4.6%
Happy 2.4%
Disgusted 0.8%

AWS Rekognition

Age 16-22
Gender Male, 98.7%
Sad 73.2%
Calm 54.3%
Surprised 6.7%
Fear 6.3%
Confused 5.4%
Angry 2.2%
Happy 1.7%
Disgusted 0.7%

AWS Rekognition

Age 2-8
Gender Male, 99.5%
Angry 67.4%
Confused 12.1%
Calm 11.9%
Surprised 7.2%
Fear 6%
Sad 4.4%
Happy 0.7%
Disgusted 0.5%

AWS Rekognition

Age 2-8
Gender Female, 98%
Calm 81.7%
Angry 15.5%
Surprised 6.5%
Fear 6%
Sad 2.6%
Confused 0.2%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 29-39
Gender Male, 99.7%
Calm 67.8%
Confused 9.2%
Surprised 8.4%
Angry 8.2%
Fear 6.6%
Sad 4.6%
Disgusted 2.2%
Happy 1.5%

AWS Rekognition

Age 22-30
Gender Female, 76.5%
Calm 45.5%
Confused 18.9%
Surprised 9.2%
Happy 8.4%
Angry 7.3%
Fear 6.7%
Sad 6.5%
Disgusted 4.9%

AWS Rekognition

Age 23-33
Gender Female, 100%
Angry 45.9%
Calm 39.3%
Surprised 7.9%
Fear 6.2%
Disgusted 4.3%
Sad 4.3%
Confused 1.3%
Happy 0.4%

AWS Rekognition

Age 19-27
Gender Male, 99.9%
Angry 97.1%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Calm 1.6%
Happy 0.5%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 23-33
Gender Female, 78.7%
Calm 88.3%
Surprised 6.9%
Fear 6.1%
Angry 3.1%
Sad 2.9%
Disgusted 2.7%
Confused 1.3%
Happy 0.5%

AWS Rekognition

Age 27-37
Gender Male, 95.9%
Angry 43.8%
Calm 38.2%
Sad 10.5%
Surprised 7%
Fear 6.2%
Confused 2.5%
Happy 1.5%
Disgusted 0.3%

AWS Rekognition

Age 22-30
Gender Male, 100%
Sad 100%
Calm 9%
Surprised 6.4%
Fear 6%
Angry 0.7%
Confused 0.3%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 13-21
Gender Female, 92.8%
Calm 50.1%
Angry 15.6%
Surprised 12.2%
Confused 10.6%
Fear 6.6%
Sad 5.7%
Happy 3.6%
Disgusted 2.5%

AWS Rekognition

Age 14-22
Gender Male, 99.9%
Angry 39.7%
Sad 30.8%
Calm 25.4%
Surprised 9.4%
Fear 6.5%
Confused 3.6%
Happy 2.8%
Disgusted 0.7%

AWS Rekognition

Age 13-21
Gender Male, 99.7%
Calm 93.5%
Surprised 6.8%
Fear 6%
Sad 2.6%
Confused 1.6%
Happy 1.4%
Angry 0.6%
Disgusted 0.2%

AWS Rekognition

Age 9-17
Gender Male, 99.4%
Calm 47.4%
Surprised 26.5%
Sad 10.4%
Angry 8%
Fear 7.5%
Confused 5.3%
Disgusted 2.2%
Happy 2.1%

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 86.9%
Angry 7.4%
Surprised 6.9%
Fear 6.1%
Sad 3.1%
Confused 0.9%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 10-18
Gender Female, 96.1%
Calm 43.5%
Angry 20.6%
Confused 20.1%
Sad 7.8%
Surprised 7.4%
Fear 6.5%
Happy 2%
Disgusted 0.5%

AWS Rekognition

Age 31-41
Gender Female, 96.6%
Sad 100%
Surprised 6.3%
Calm 6.1%
Fear 6.1%
Angry 0.7%
Confused 0.3%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 26-36
Gender Male, 94.2%
Calm 76.6%
Surprised 11.8%
Fear 6.2%
Confused 5%
Angry 3.8%
Sad 3.7%
Happy 0.9%
Disgusted 0.8%

AWS Rekognition

Age 18-26
Gender Female, 54.3%
Sad 68.5%
Calm 46.1%
Fear 17.5%
Surprised 6.4%
Happy 1.2%
Angry 0.9%
Disgusted 0.6%
Confused 0.5%

AWS Rekognition

Age 23-33
Gender Male, 98.6%
Calm 58.4%
Surprised 12.6%
Confused 12.1%
Sad 8.9%
Fear 6.4%
Angry 4.1%
Happy 3.9%
Disgusted 0.7%

AWS Rekognition

Age 19-27
Gender Female, 59.7%
Calm 85.9%
Angry 7.1%
Surprised 6.5%
Fear 6%
Happy 2.9%
Sad 2.7%
Confused 1.3%
Disgusted 0.4%

AWS Rekognition

Age 23-33
Gender Female, 73.9%
Calm 76.1%
Angry 15.3%
Surprised 7.2%
Fear 6.2%
Sad 3.4%
Confused 1.6%
Happy 0.6%
Disgusted 0.6%

AWS Rekognition

Age 22-30
Gender Female, 100%
Angry 59.1%
Calm 25.2%
Surprised 8%
Fear 7.8%
Sad 3.1%
Confused 2.1%
Disgusted 1.9%
Happy 1.2%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 82.9%
Confused 14.4%
Surprised 6.5%
Fear 6%
Sad 2.4%
Angry 0.7%
Happy 0.4%
Disgusted 0.1%

AWS Rekognition

Age 10-18
Gender Female, 70.7%
Calm 50.1%
Surprised 10.6%
Angry 9.9%
Sad 9.6%
Fear 8.1%
Confused 7.8%
Happy 5%
Disgusted 4.4%

AWS Rekognition

Age 16-24
Gender Male, 100%
Calm 43.9%
Happy 36.1%
Sad 10.6%
Surprised 7.2%
Fear 6%
Angry 4.9%
Confused 0.7%
Disgusted 0.4%

AWS Rekognition

Age 12-20
Gender Male, 99.6%
Sad 57.2%
Calm 35.9%
Confused 26.4%
Surprised 6.7%
Fear 6.5%
Angry 4%
Happy 1.4%
Disgusted 1%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Sad 98.4%
Angry 15.6%
Surprised 12.2%
Calm 7.7%
Fear 7.4%
Happy 4.4%
Confused 3.5%
Disgusted 1.3%

AWS Rekognition

Age 19-27
Gender Male, 99.7%
Calm 60.5%
Happy 13.2%
Sad 9.6%
Surprised 8%
Fear 6.8%
Confused 5.2%
Angry 2.7%
Disgusted 2.1%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Sad 100%
Surprised 6.3%
Fear 6.3%
Angry 2.4%
Calm 0.2%
Confused 0.1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 25-35
Gender Female, 78.4%
Calm 32.4%
Sad 29.8%
Fear 12.7%
Surprised 11.6%
Happy 9.4%
Angry 9.3%
Confused 4.5%
Disgusted 3.2%

AWS Rekognition

Age 6-12
Gender Male, 69.1%
Confused 39.5%
Calm 24.9%
Angry 16.8%
Surprised 7.5%
Fear 6.8%
Sad 5%
Happy 4.8%
Disgusted 3.3%

Microsoft Cognitive Services

Age 3
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 20
Gender Male

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 15
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 19
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 18
Gender Male

Microsoft Cognitive Services

Age 1
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Categories

Imagga

paintings art 51.8%
interior objects 18.6%
streetview architecture 18.1%
people portraits 9.5%

Text analysis

Amazon

SKI4

Google

SEH