Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Pittsburgh. "Kingsley House": Kingsley House, Pittsburg, Pa.: In the Gymnasium.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3276.1

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Pittsburgh. "Kingsley House": Kingsley House, Pittsburg, Pa.: In the Gymnasium.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3276.1

Machine Generated Data

Tags

Amazon
created on 2022-07-02

Person 99.3
Human 99.3
Person 99.2
Person 98.8
Person 98.6
Person 98.4
Person 98.4
Person 97.2
Person 97
Person 95.7
Room 95.6
Indoors 95.6
Person 91.3
Person 88.4
Court 83.6
Painting 83.4
Art 83.4
Person 78.2
Person 76.1
Crowd 75.2
Jury 74.4
Person 73.9
People 71
Workshop 59
Interior Design 55.7
Person 50.1

Imagga
created on 2022-07-02

architecture 19.5
travel 18.3
pedestrian 18
people 17.3
stone 16.6
cemetery 16.3
building 15.9
structure 14.3
tourism 14
old 13.9
hall 13.9
memorial 13.5
flowers 13
holiday 12.2
tourist 12
groom 11.5
monument 11.2
world 11.1
historic 11
city 10.8
religion 10.7
fence 10.3
summer 10.3
tradition 10.2
column 10.1
park 9.9
history 9.8
landscape 9.7
sky 9.6
house 9.5
picket fence 9.4
gravestone 9.3
garden 9.2
street 9.2
landmark 9
black 9
military 8.7
scene 8.6
men 8.6
famous 8.4
palace 8.3
uniform 8
natural 8
celebration 8
metropolitan 7.9
love 7.9
color 7.8
ancient 7.8
war 7.7
culture 7.7
bride 7.7
life 7.6
person 7.5
field 7.5
church 7.4
gold 7.4
art 7.4
new 7.3
national 7.2
flower 7.2
women 7.1
to 7.1
spring 7.1
cathedral 7

Google
created on 2022-07-02

Microsoft
created on 2022-07-02

person 98.5
clothing 98.4
group 91.1
text 89.9
old 83.9
black 79.8
people 78.6
standing 77
man 63.7
white 62.6
woman 56.3
posing 54
vintage 34.3
crowd 0.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 16-24
Gender Female, 87.9%
Calm 63.2%
Angry 11.5%
Sad 9.4%
Surprised 6.9%
Fear 6.8%
Confused 6.1%
Disgusted 3.9%
Happy 1%

AWS Rekognition

Age 18-26
Gender Female, 51.5%
Calm 98.6%
Surprised 6.4%
Fear 6%
Sad 2.2%
Angry 0.2%
Disgusted 0.2%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 23-33
Gender Female, 55%
Calm 76.7%
Sad 7.7%
Surprised 6.9%
Fear 6.6%
Confused 5.2%
Angry 3.2%
Disgusted 2%
Happy 0.6%

AWS Rekognition

Age 24-34
Gender Female, 84.4%
Sad 100%
Surprised 6.4%
Fear 6%
Calm 4.7%
Confused 1.6%
Disgusted 0.5%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 21-29
Gender Male, 88.3%
Sad 100%
Surprised 6.4%
Fear 6%
Calm 3.7%
Angry 1%
Confused 0.4%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 23-31
Gender Female, 99.6%
Angry 72.7%
Sad 14.3%
Surprised 7.6%
Fear 6.8%
Calm 4.6%
Confused 2.1%
Disgusted 1.2%
Happy 0.3%

AWS Rekognition

Age 20-28
Gender Female, 87.8%
Calm 98.3%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 6-14
Gender Female, 97.5%
Calm 28%
Sad 22.3%
Happy 16.2%
Surprised 14.9%
Fear 10.3%
Angry 9.9%
Disgusted 5.5%
Confused 2.1%

AWS Rekognition

Age 13-21
Gender Female, 99.1%
Calm 73.5%
Sad 14.8%
Surprised 7%
Fear 6.8%
Confused 4.4%
Happy 2.2%
Disgusted 1%
Angry 0.7%

AWS Rekognition

Age 12-20
Gender Male, 58.2%
Sad 98.9%
Calm 21.7%
Angry 12.6%
Surprised 6.6%
Fear 6.1%
Confused 4.1%
Disgusted 1.3%
Happy 0.4%

AWS Rekognition

Age 18-24
Gender Female, 73.9%
Calm 63.1%
Sad 40%
Surprised 7.2%
Fear 7.2%
Angry 4.9%
Disgusted 1.4%
Confused 1%
Happy 0.7%

AWS Rekognition

Age 28-38
Gender Male, 90.3%
Calm 73.5%
Sad 10%
Surprised 8.3%
Fear 6.2%
Angry 3.5%
Happy 2.6%
Confused 2.5%
Disgusted 2.2%

AWS Rekognition

Age 31-41
Gender Male, 96.9%
Calm 84.2%
Surprised 6.9%
Fear 6.3%
Sad 3.9%
Disgusted 3.6%
Confused 2.4%
Happy 2%
Angry 1.1%

AWS Rekognition

Age 12-20
Gender Female, 89.1%
Sad 99.9%
Angry 12%
Calm 9%
Surprised 6.6%
Fear 6.2%
Confused 1.9%
Disgusted 1.6%
Happy 0.2%

AWS Rekognition

Age 20-28
Gender Female, 70.3%
Sad 75.3%
Calm 29.3%
Fear 17.9%
Surprised 8.7%
Angry 8.4%
Happy 1.9%
Disgusted 1.6%
Confused 1.5%

AWS Rekognition

Age 18-26
Gender Female, 93.4%
Angry 51.4%
Confused 22.2%
Disgusted 8.8%
Sad 7.8%
Surprised 7.1%
Fear 6.4%
Calm 4.3%
Happy 1.1%

AWS Rekognition

Age 14-22
Gender Female, 61.7%
Calm 87.5%
Sad 6.5%
Fear 6.4%
Surprised 6.4%
Angry 1.1%
Disgusted 0.7%
Confused 0.4%
Happy 0.3%

AWS Rekognition

Age 22-30
Gender Female, 89.9%
Calm 97.1%
Surprised 6.4%
Fear 6.1%
Sad 2.5%
Confused 0.3%
Happy 0.3%
Angry 0.2%
Disgusted 0.2%

AWS Rekognition

Age 20-28
Gender Female, 91.2%
Calm 91.1%
Surprised 6.5%
Fear 6%
Sad 4.5%
Happy 1.4%
Confused 0.7%
Disgusted 0.5%
Angry 0.3%

AWS Rekognition

Age 20-28
Gender Female, 90.4%
Calm 74.8%
Sad 40.2%
Surprised 6.3%
Fear 5.9%
Angry 0.7%
Disgusted 0.2%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 16-22
Gender Female, 93.4%
Sad 97.9%
Fear 27.2%
Surprised 7.7%
Calm 5.7%
Angry 5.5%
Disgusted 3%
Confused 1.8%
Happy 1.2%

AWS Rekognition

Age 20-28
Gender Female, 86.1%
Sad 80.2%
Calm 43%
Surprised 7.4%
Fear 6.9%
Confused 6.4%
Angry 5.2%
Happy 2.3%
Disgusted 1.9%

AWS Rekognition

Age 18-24
Gender Male, 67%
Calm 97.5%
Surprised 6.3%
Fear 5.9%
Sad 2.8%
Angry 0.2%
Confused 0.2%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 23-33
Gender Male, 98%
Calm 99.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0%
Angry 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 13-21
Gender Female, 84%
Sad 100%
Surprised 6.5%
Fear 6.2%
Calm 5.9%
Disgusted 1%
Confused 0.6%
Angry 0.5%
Happy 0.1%

AWS Rekognition

Age 21-29
Gender Female, 75.1%
Fear 96%
Surprised 6.6%
Sad 4.9%
Calm 2.7%
Happy 0.7%
Angry 0.5%
Disgusted 0.4%
Confused 0.4%

AWS Rekognition

Age 13-21
Gender Female, 69.1%
Calm 92.2%
Surprised 6.6%
Fear 6.3%
Sad 2.9%
Happy 1.3%
Disgusted 1%
Confused 0.7%
Angry 0.7%

AWS Rekognition

Age 12-20
Gender Female, 72.1%
Calm 81.1%
Surprised 7.2%
Fear 6.4%
Disgusted 5.3%
Angry 4%
Sad 3.4%
Happy 2.5%
Confused 0.7%

AWS Rekognition

Age 7-17
Gender Female, 76.6%
Sad 78.8%
Calm 49.9%
Angry 9.4%
Surprised 6.7%
Fear 6%
Disgusted 1.9%
Confused 0.8%
Happy 0.6%

AWS Rekognition

Age 16-24
Gender Male, 70.8%
Calm 86.2%
Sad 9.5%
Surprised 6.5%
Fear 6.1%
Confused 0.7%
Angry 0.5%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 19-27
Gender Male, 61%
Calm 68.2%
Fear 9.4%
Sad 8.7%
Surprised 7.7%
Disgusted 5.7%
Angry 4.2%
Happy 0.9%
Confused 0.6%

AWS Rekognition

Age 19-27
Gender Female, 58.5%
Calm 54.8%
Angry 25.6%
Surprised 8.4%
Fear 6.4%
Disgusted 5.8%
Sad 4.3%
Happy 2.7%
Confused 1.1%

AWS Rekognition

Age 21-29
Gender Female, 78.4%
Sad 91.4%
Calm 29.6%
Angry 21.5%
Surprised 6.6%
Fear 6.6%
Disgusted 2.3%
Confused 0.5%
Happy 0.4%

AWS Rekognition

Age 16-24
Gender Male, 77.3%
Calm 72.5%
Sad 9.7%
Surprised 7.5%
Angry 7.1%
Fear 6.7%
Disgusted 2.8%
Happy 1%
Confused 1%

AWS Rekognition

Age 29-39
Gender Female, 54.9%
Sad 97.1%
Angry 45.9%
Surprised 6.4%
Fear 5.9%
Confused 1.2%
Calm 0.8%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 16-22
Gender Male, 96.1%
Calm 97.3%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Happy 1.2%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 14-22
Gender Female, 98.3%
Angry 50.6%
Calm 47.1%
Surprised 6.5%
Fear 5.9%
Sad 2.4%
Disgusted 0.6%
Happy 0.3%
Confused 0.1%

AWS Rekognition

Age 21-29
Gender Female, 85.8%
Sad 99.9%
Calm 9.4%
Surprised 7.2%
Angry 6.8%
Fear 6.5%
Disgusted 3.9%
Confused 1.8%
Happy 0.5%

AWS Rekognition

Age 18-26
Gender Male, 84.3%
Calm 91.8%
Surprised 6.8%
Fear 6.3%
Angry 2.9%
Sad 2.8%
Happy 0.6%
Disgusted 0.5%
Confused 0.4%

AWS Rekognition

Age 10-18
Gender Male, 99.2%
Calm 84.8%
Angry 8.3%
Surprised 7.1%
Fear 6%
Sad 3.1%
Happy 1.2%
Confused 0.9%
Disgusted 0.5%

AWS Rekognition

Age 16-24
Gender Female, 86.4%
Calm 80.7%
Fear 7%
Surprised 6.9%
Sad 4.8%
Angry 4.3%
Disgusted 2%
Confused 1.8%
Happy 1.3%

AWS Rekognition

Age 7-17
Gender Male, 94.9%
Calm 54.3%
Fear 13.5%
Angry 9.9%
Sad 8.1%
Surprised 7.3%
Disgusted 6%
Happy 2.4%
Confused 2.2%

AWS Rekognition

Age 16-24
Gender Male, 81.2%
Sad 94.2%
Calm 32.4%
Surprised 11.5%
Confused 6.4%
Fear 6.2%
Angry 4%
Disgusted 1.7%
Happy 0.6%

AWS Rekognition

Age 11-19
Gender Female, 64.9%
Calm 97.8%
Surprised 6.4%
Fear 5.9%
Sad 2.4%
Angry 0.5%
Disgusted 0.3%
Happy 0.1%
Confused 0.1%

AWS Rekognition

Age 24-34
Gender Female, 91%
Calm 95.9%
Surprised 6.4%
Fear 6%
Sad 2.4%
Happy 0.9%
Angry 0.9%
Disgusted 0.6%
Confused 0.2%

AWS Rekognition

Age 10-18
Gender Female, 77.1%
Calm 44.1%
Sad 19.2%
Fear 18.3%
Angry 14.8%
Surprised 6.8%
Disgusted 1.8%
Happy 1.3%
Confused 1.2%

AWS Rekognition

Age 18-24
Gender Male, 79.1%
Sad 94.2%
Calm 37.8%
Surprised 7%
Fear 6.4%
Disgusted 5.1%
Confused 4.1%
Angry 2.7%
Happy 1.2%

AWS Rekognition

Age 6-16
Gender Female, 83.9%
Calm 69.2%
Sad 10.1%
Angry 8.9%
Surprised 8.2%
Fear 6.4%
Disgusted 3%
Happy 1.6%
Confused 1%

AWS Rekognition

Age 13-21
Gender Male, 73.8%
Calm 59.2%
Happy 28.7%
Surprised 6.8%
Fear 6.2%
Sad 3.4%
Disgusted 3.2%
Angry 2.7%
Confused 1%

AWS Rekognition

Age 14-22
Gender Female, 64%
Calm 86.4%
Fear 8.2%
Surprised 6.9%
Sad 2.9%
Disgusted 1.5%
Angry 1.4%
Confused 1%
Happy 0.8%

AWS Rekognition

Age 14-22
Gender Male, 85.5%
Calm 97.8%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Angry 0.5%
Confused 0.5%
Disgusted 0.2%
Happy 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Painting 83.4%

Categories

Text analysis

Amazon

SE4

Google

SE4