Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. Roxbury Neighborhood House: The Roxbury Neighborhood House, Boston, Mass. The Playground.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.265

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. Roxbury Neighborhood House: The Roxbury Neighborhood House, Boston, Mass. The Playground.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.265

Machine Generated Data

Tags

Amazon
created on 2022-06-04

Person 99.8
Human 99.8
Person 99.2
Person 98.3
Person 97.8
Person 97.7
Person 97.5
Person 97.1
Person 96.5
Person 96
Person 93.3
Person 92.6
People 88.8
Person 88.6
Military 87.6
Fireman 86.6
Military Uniform 84
Crowd 83.3
Person 77.1
Person 76.6
Painting 75.2
Art 75.2
Person 72.2
Army 71.7
Armored 71.7
Person 71.7
Person 70.1
Horse 69.1
Animal 69.1
Mammal 69.1
Troop 58.8
Police 58.1
Officer 57.1
Person 56.4
Soldier 56.2
Person 43

Imagga
created on 2022-06-04

snow 100
weather 83.3
winter 43.4
landscape 30.5
cold 29.3
tree 26.2
forest 21.8
frost 20.2
outdoors 19.4
trees 18.7
sky 17.9
season 17.9
ice 17.7
park 17.3
snowy 16.5
frozen 16.2
rural 15.9
scenery 14.4
old 13.2
outdoor 13
scene 13
travel 12.7
field 12.6
wood 12.5
country 12.3
city 11.6
woods 11.5
town 11.1
snowing 10.8
holiday 10.8
peaceful 10.1
light 10
water 10
horse 9.8
freeze 9.7
people 9.5
architecture 9.4
branch 9.1
morning 9
frosty 8.8
scenics 8.6
pen 8.1
recreation 8.1
mountain 8
sand 8
resort 7.9
building 7.9
seasonal 7.9
snowfall 7.9
bench 7.9
day 7.8
horses 7.8
cattle 7.4
animal 7.4
tourist 7.3
sun 7.2
fall 7.2
transportation 7.2
beach 7.1
farm 7.1
plow 7.1
sea 7
scenic 7

Google
created on 2022-06-04

Tree 86
Adaptation 79.2
Vintage clothing 74.4
Event 74
Pole 71.9
Monochrome 71.7
Motor vehicle 71.6
Crowd 70.8
Military organization 70.7
History 68.6
Crew 64.6
Stock photography 62.7
Public event 59.3
Infantry 58.8
Monochrome photography 56.1
Rebellion 54.8
Team 54.6
Winter 54.3
Troop 54.2
Paper product 53.1

Microsoft
created on 2022-06-04

outdoor 99.4
person 96.3
clothing 92.5
old 90.9
group 89.4
snow 89
text 87
man 84
tree 82.7
people 60.5
crowd 0.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Female, 99.9%
Calm 73.9%
Disgusted 17.3%
Surprised 6.5%
Fear 6%
Sad 3.9%
Happy 2.4%
Angry 0.9%
Confused 0.4%

AWS Rekognition

Age 23-31
Gender Female, 96.7%
Angry 91.5%
Surprised 6.3%
Fear 6.1%
Sad 4.4%
Calm 1.1%
Confused 0.7%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 23-33
Gender Male, 98.8%
Sad 99.5%
Confused 14.2%
Calm 12.8%
Surprised 8.1%
Fear 6.3%
Angry 1.9%
Disgusted 1.4%
Happy 1.1%

AWS Rekognition

Age 4-12
Gender Female, 100%
Calm 81.5%
Happy 12.3%
Surprised 6.6%
Fear 6%
Sad 2.6%
Confused 2%
Angry 1%
Disgusted 0.9%

AWS Rekognition

Age 21-29
Gender Male, 96.6%
Calm 39.9%
Happy 25%
Confused 20%
Surprised 10.8%
Fear 6.2%
Sad 3%
Disgusted 2.6%
Angry 2.5%

AWS Rekognition

Age 1-7
Gender Female, 99.6%
Calm 82.6%
Surprised 7%
Fear 6.2%
Sad 4.1%
Confused 3.9%
Angry 3.7%
Happy 2%
Disgusted 0.9%

AWS Rekognition

Age 2-8
Gender Female, 99.9%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 4.5%
Angry 0.5%
Confused 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 2-10
Gender Female, 84.4%
Calm 47.1%
Happy 34.3%
Sad 8.8%
Surprised 6.8%
Fear 6%
Angry 3.4%
Disgusted 2.2%
Confused 1.4%

AWS Rekognition

Age 1-7
Gender Female, 99.9%
Sad 100%
Disgusted 9.3%
Surprised 6.3%
Fear 6%
Angry 3.6%
Calm 1.2%
Confused 0.2%
Happy 0.1%

AWS Rekognition

Age 9-17
Gender Female, 90.3%
Sad 98.6%
Calm 30.2%
Surprised 7.6%
Fear 6.2%
Confused 5.8%
Angry 2.5%
Disgusted 1.3%
Happy 0.6%

AWS Rekognition

Age 18-24
Gender Female, 93.9%
Calm 62.7%
Sad 42.9%
Angry 7%
Surprised 6.9%
Fear 6%
Confused 3%
Disgusted 0.6%
Happy 0.4%

AWS Rekognition

Age 4-10
Gender Female, 98.2%
Angry 98.3%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Calm 0.8%
Confused 0.3%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 11-19
Gender Female, 100%
Calm 83.6%
Happy 7.2%
Surprised 6.6%
Fear 6%
Angry 5.3%
Sad 2.5%
Confused 1%
Disgusted 0.8%

AWS Rekognition

Age 23-33
Gender Female, 97.7%
Sad 99.8%
Calm 10.6%
Fear 7.7%
Surprised 6.9%
Happy 6.1%
Angry 3.8%
Confused 1.9%
Disgusted 1.1%

AWS Rekognition

Age 7-17
Gender Female, 94.6%
Sad 100%
Surprised 6.4%
Fear 6%
Calm 1.4%
Disgusted 1%
Confused 1%
Angry 0.7%
Happy 0.4%

AWS Rekognition

Age 2-8
Gender Female, 100%
Sad 100%
Surprised 6.4%
Fear 6%
Angry 1.5%
Happy 0.9%
Disgusted 0.8%
Confused 0.6%
Calm 0.4%

AWS Rekognition

Age 25-35
Gender Female, 66.3%
Sad 72.9%
Calm 29.4%
Happy 13.1%
Surprised 8%
Confused 7.1%
Fear 6.9%
Disgusted 6%
Angry 5.2%

AWS Rekognition

Age 28-38
Gender Male, 99.5%
Sad 99.9%
Angry 11.4%
Fear 6.9%
Surprised 6.8%
Calm 5.3%
Confused 2.8%
Disgusted 1.4%
Happy 0.2%

AWS Rekognition

Age 31-41
Gender Female, 99.9%
Happy 92.4%
Surprised 7%
Fear 6.1%
Sad 3.1%
Calm 1.2%
Disgusted 0.9%
Angry 0.5%
Confused 0.4%

AWS Rekognition

Age 2-8
Gender Male, 99.4%
Sad 95.3%
Calm 32.1%
Angry 8.6%
Surprised 7.2%
Fear 6.2%
Confused 5.3%
Happy 2.1%
Disgusted 1.4%

AWS Rekognition

Age 21-29
Gender Female, 90.5%
Angry 62.3%
Calm 24%
Surprised 6.9%
Fear 6.3%
Sad 4.2%
Happy 3.3%
Confused 1.9%
Disgusted 1.2%

AWS Rekognition

Age 31-41
Gender Female, 88%
Happy 43.7%
Calm 31.5%
Surprised 10.3%
Fear 6.5%
Angry 4.6%
Sad 4.1%
Confused 3.9%
Disgusted 3.8%

AWS Rekognition

Age 19-27
Gender Male, 56.3%
Happy 97.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Calm 1.5%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 24-34
Gender Female, 96.3%
Confused 69.5%
Sad 39.5%
Surprised 6.4%
Fear 6.2%
Calm 5%
Disgusted 0.2%
Angry 0.2%
Happy 0.2%

AWS Rekognition

Age 35-43
Gender Male, 96%
Sad 55.9%
Calm 43.5%
Disgusted 15.3%
Surprised 7.3%
Fear 6.3%
Confused 5.4%
Angry 3.2%
Happy 1.2%

AWS Rekognition

Age 4-10
Gender Female, 91.2%
Calm 98.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.8%
Angry 0.2%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 41-49
Gender Male, 99.2%
Happy 49.8%
Confused 21.1%
Surprised 10.2%
Sad 7.7%
Angry 7.1%
Fear 6.6%
Disgusted 3%
Calm 1.8%

AWS Rekognition

Age 18-24
Gender Male, 56.2%
Sad 64.9%
Calm 31.5%
Happy 28%
Surprised 7.4%
Fear 6.9%
Confused 2.1%
Angry 2%
Disgusted 0.7%

AWS Rekognition

Age 19-27
Gender Female, 80.8%
Happy 28.8%
Calm 27.9%
Angry 13.5%
Sad 10.2%
Surprised 9.3%
Fear 7.3%
Confused 7.1%
Disgusted 2.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.8%
Painting 75.2%
Horse 69.1%

Text analysis

Amazon

SJJ7

Google

SJJ 1
SJJ
1