Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Christodora House": Christodora House, New York City.: City Playground In front of the settlement.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.259.5

Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Christodora House": Christodora House, New York City.: City Playground In front of the settlement.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Human 99.7
Person 99.7
Person 99.7
Person 99.7
Person 99.5
Person 99.2
Person 99.1
Person 98.8
Person 98.8
Person 98.7
Person 98.6
Person 95.5
Person 93.1
Toy 92.9
Swing 92.9
Person 87.6
Person 87.3
Person 86.5
Person 83.8
Person 79.1
Person 62
Play Area 56.2
Playground 56.2

Imagga
created on 2022-06-25

swing 92.9
mechanical device 72.8
plaything 71.1
mechanism 55.2
sky 24.2
crane 22
pole 19.5
man 18.8
industrial 17.2
silhouette 16.6
rod 16.4
industry 16.2
danger 15.5
device 14.3
city 14.1
sunset 13.5
person 13
construction 12.8
male 12.8
destruction 12.7
sport 12.3
architecture 11.7
lifting device 11.5
bridge 11.1
outdoor 10.7
water 10.7
people 10.6
metal 10.5
landscape 10.4
equipment 10.2
beach 10.1
protection 10
park 10
dirty 9.9
environment 9.9
travel 9.9
radioactive 9.8
radiation 9.8
accident 9.8
adult 9.7
nuclear 9.7
sun 9.7
gas 9.6
structure 9.6
urban 9.6
building 9.6
power 9.2
cable 9
outdoors 9
world 8.9
stalker 8.9
river 8.9
toxic 8.8
protective 8.8
chemical 8.7
high 8.7
mask 8.6
cloud 8.6
monument 8.4
weapon 8.4
smoke 8.4
old 8.4
machine 8.3
tourism 8.2
landmark 8.1
recreation 8.1
tower 8.1
steel 8
disaster 7.8
military 7.7
summer 7.7
fun 7.5
leisure 7.5
chemical weapon 7.4
activity 7.2
light 7

Google
created on 2022-06-25

Sky 90.3
Standing 86.4
Maypole 85.6
Gesture 85.3
Tree 84.8
Style 84
Vintage clothing 75.8
Pole 75.1
Event 72.7
Crowd 72.2
Fun 71.9
Monochrome photography 71.7
Flag 71.2
Monochrome 71
History 64.3
Child 64
Stock photography 63.4
Crew 63.1
Leisure 59.3
Playground 58.4

Microsoft
created on 2022-06-25

outdoor 100
tree 99.9
playground 96.6
old 94.6
person 88.7
clothing 81.7
child 77.9
group 72.2
man 60.4
team 36.8
posing 36.4
several 10

Face analysis

Amazon

Google

AWS Rekognition

Age 20-28
Gender Female, 99.7%
Happy 86.3%
Calm 9.2%
Surprised 6.6%
Fear 6.1%
Sad 2.4%
Disgusted 1.6%
Angry 0.6%
Confused 0.2%

AWS Rekognition

Age 10-18
Gender Female, 100%
Calm 56.9%
Happy 15.4%
Sad 12.7%
Surprised 7.2%
Fear 6.4%
Confused 5.7%
Angry 2.9%
Disgusted 2.7%

AWS Rekognition

Age 26-36
Gender Male, 99.2%
Happy 36.8%
Sad 34.6%
Fear 24.1%
Calm 7.8%
Surprised 6.6%
Angry 4.8%
Disgusted 2.5%
Confused 0.9%

AWS Rekognition

Age 4-10
Gender Male, 86.9%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 1.8%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%
Confused 0%

AWS Rekognition

Age 1-7
Gender Female, 97.7%
Sad 99.4%
Angry 33.6%
Surprised 6.3%
Fear 6.3%
Calm 1.2%
Disgusted 0.7%
Confused 0.7%
Happy 0.2%

AWS Rekognition

Age 6-12
Gender Female, 99%
Happy 99.1%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.2%
Disgusted 0.2%
Angry 0.1%
Calm 0.1%

AWS Rekognition

Age 27-37
Gender Female, 94.1%
Sad 97.4%
Surprised 68.5%
Fear 6%
Happy 2.1%
Calm 1.9%
Disgusted 1.5%
Confused 1.1%
Angry 0.3%

AWS Rekognition

Age 16-24
Gender Female, 84.1%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Disgusted 0%
Happy 0%
Angry 0%

AWS Rekognition

Age 9-17
Gender Male, 92.7%
Calm 85.5%
Fear 8.3%
Surprised 6.7%
Sad 3.8%
Disgusted 1.2%
Happy 1.2%
Angry 0.8%
Confused 0.7%

AWS Rekognition

Age 14-22
Gender Male, 98.6%
Calm 79.8%
Fear 8.8%
Surprised 7.3%
Sad 4.9%
Angry 3.1%
Disgusted 1.1%
Confused 1%
Happy 0.6%

AWS Rekognition

Age 16-24
Gender Male, 61.2%
Calm 95.8%
Surprised 6.4%
Fear 5.9%
Sad 2.5%
Happy 1%
Confused 0.9%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 6-16
Gender Female, 71.7%
Calm 59.7%
Sad 29.2%
Angry 7.6%
Surprised 7.3%
Fear 6.4%
Disgusted 5.8%
Happy 2%
Confused 1.1%

AWS Rekognition

Age 16-22
Gender Female, 62.2%
Calm 79.5%
Surprised 10.1%
Fear 6.2%
Disgusted 5.3%
Happy 3.8%
Sad 3%
Angry 1.1%
Confused 1%

AWS Rekognition

Age 21-29
Gender Female, 94.3%
Calm 96.9%
Surprised 6.3%
Fear 5.9%
Sad 2.6%
Happy 0.8%
Angry 0.4%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 6-14
Gender Male, 90.7%
Calm 59%
Sad 19%
Fear 8.1%
Happy 7.2%
Surprised 7.2%
Confused 5.2%
Angry 3%
Disgusted 2.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 92.9%
a group of people posing for a photo 92.8%
a vintage photo of a group of people posing for a picture 92.7%

Text analysis

Google

| 4
|
4