Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Pittsburgh. Kingsley House: Kingsley House, Pittsburgh, Pa.: In the Country.: Tug of war.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.284.2

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Pittsburgh. Kingsley House: Kingsley House, Pittsburgh, Pa.: In the Country.: Tug of war.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-07-02

Human 98.3
Person 98.2
Chair 97.9
Furniture 97.9
Person 96.7
Person 95.8
Person 95.7
Person 94.6
People 94.4
Person 93.7
Person 90.3
Person 88.2
Person 87.3
Person 86.3
Crowd 86.3
Person 84.1
Person 78.9
Person 78.5
Military Uniform 74.4
Military 74.4
Person 70.3
Person 67.5
Team 63.3
Person 61.9
Person 59.7
Team Sport 59
Sport 59
Sports 59
Person 58.3
Troop 56.2
Armored 56.2
Army 56.2
Person 45.9

Imagga
created on 2022-07-02

sand 46.2
beach 42.4
sea 32
ocean 28.2
water 24
vacation 23.7
afghan hound 22.7
coast 22.4
shore 21.4
landscape 20.1
sky 19.8
travel 19.7
summer 19.3
hound 18.5
rock 16.5
dog 15.9
holiday 15.8
hunting dog 15.1
tourism 14.8
outdoor 14.5
island 13.7
outdoors 13
sun 12.9
coastline 12.2
relax 11.8
people 11.7
mountain 11.6
man 11.4
walking 11.4
bay 11.3
wave 11.2
waves 11.1
tropical 11.1
scenery 10.8
horizon 10.8
rocks 10.4
resort 10.3
tree 10
desert 9.4
scenic 8.8
sport 8.7
wheeled vehicle 8.7
walk 8.6
unicycle 8.5
stone 8.5
male 8.5
paradise 8.5
clouds 8.4
vehicle 8.4
leisure 8.3
lake 8.2
recreation 8.1
day 7.8
canine 7.8
coastal 7.8
sunny 7.7
death 7.7
run 7.7
seascape 7.6
snow 7.5
park 7.4
tourist 7.3
dune 7.1
sunlight 7.1
seaside 7.1

Google
created on 2022-07-02

Font 81.1
Tints and shades 76.9
Rectangle 74.8
Art 72.2
Team sport 71
Event 69.3
Crew 68.7
Vintage clothing 67.6
Monochrome photography 64
Visual arts 62.1
History 61.9
Uniform 61.9
Stock photography 61.8
Monochrome 57.9
Suit 54
Team 53
Paper product 52.9
Photo caption 50.2

Microsoft
created on 2022-07-02

outdoor 96.9
old 96.8
text 94.8
baseball 93.5
person 92.5
group 84.6
clothing 78.3
man 76
posing 74.8
team 70.7
player 69.5
black 68.5

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Female, 54.7%
Calm 97.7%
Surprised 6.3%
Fear 5.9%
Sad 2.6%
Happy 0.3%
Angry 0.3%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 4-12
Gender Male, 69.3%
Calm 98.4%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Happy 0.5%
Confused 0.2%
Disgusted 0.1%
Angry 0%

AWS Rekognition

Age 20-28
Gender Male, 83.4%
Calm 95.3%
Surprised 6.4%
Fear 6%
Sad 3%
Angry 1%
Disgusted 0.4%
Happy 0.2%
Confused 0.1%

AWS Rekognition

Age 23-33
Gender Male, 82.6%
Calm 75.4%
Angry 14.3%
Surprised 6.4%
Fear 6%
Sad 5.7%
Disgusted 1.8%
Confused 0.6%
Happy 0.3%

AWS Rekognition

Age 6-12
Gender Male, 90.4%
Calm 84.8%
Sad 12.3%
Surprised 6.4%
Fear 6.1%
Angry 0.7%
Confused 0.4%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 22-30
Gender Male, 92.7%
Happy 83.5%
Calm 7.9%
Surprised 7.4%
Fear 6%
Disgusted 3.3%
Sad 2.3%
Angry 1.6%
Confused 0.7%

AWS Rekognition

Age 23-31
Gender Male, 98.4%
Happy 98.5%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Calm 0.3%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 18-26
Gender Female, 97.5%
Happy 39.8%
Calm 29.8%
Sad 27.9%
Fear 8.2%
Surprised 6.5%
Angry 3%
Disgusted 0.8%
Confused 0.6%

AWS Rekognition

Age 10-18
Gender Male, 99.4%
Calm 46.1%
Fear 14.5%
Happy 14.3%
Sad 9.8%
Surprised 7.3%
Confused 4.3%
Angry 4.2%
Disgusted 3.2%

AWS Rekognition

Age 19-27
Gender Male, 74.2%
Calm 63%
Sad 18.8%
Angry 14.8%
Surprised 6.9%
Fear 6.1%
Confused 2.2%
Happy 1%
Disgusted 0.8%

AWS Rekognition

Age 21-29
Gender Male, 99.1%
Calm 72.6%
Sad 7.2%
Surprised 7.1%
Happy 6.9%
Fear 6.4%
Angry 3.8%
Confused 3.6%
Disgusted 1.3%

AWS Rekognition

Age 16-24
Gender Male, 94%
Calm 90.9%
Surprised 6.6%
Fear 6.3%
Sad 3.3%
Angry 1.9%
Disgusted 1%
Confused 0.9%
Happy 0.3%

AWS Rekognition

Age 23-31
Gender Male, 99.8%
Calm 47.6%
Happy 19.1%
Angry 15.9%
Fear 9.2%
Surprised 7.5%
Sad 3.7%
Disgusted 2%
Confused 1.8%

AWS Rekognition

Age 27-37
Gender Male, 98.6%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Happy 0%

AWS Rekognition

Age 18-24
Gender Male, 97.7%
Calm 56.4%
Sad 39.6%
Surprised 7.5%
Fear 7.2%
Angry 5.6%
Disgusted 4.4%
Happy 3.3%
Confused 0.8%

AWS Rekognition

Age 18-26
Gender Female, 67.4%
Calm 78.4%
Happy 12.2%
Surprised 6.8%
Fear 6.3%
Sad 4.1%
Disgusted 1%
Angry 1%
Confused 0.4%

AWS Rekognition

Age 9-17
Gender Female, 75.7%
Sad 100%
Fear 6.9%
Surprised 6.6%
Disgusted 4.9%
Angry 2.8%
Calm 2.2%
Confused 1.5%
Happy 1%

AWS Rekognition

Age 7-17
Gender Female, 77.7%
Angry 41.7%
Calm 19.1%
Happy 14.6%
Sad 9.2%
Surprised 8.2%
Fear 8.1%
Disgusted 3.8%
Confused 1.7%

AWS Rekognition

Age 14-22
Gender Male, 99.3%
Disgusted 61.6%
Calm 28.2%
Surprised 6.7%
Fear 6.3%
Sad 3.5%
Angry 3.1%
Happy 1.1%
Confused 0.6%

AWS Rekognition

Age 6-16
Gender Female, 59.1%
Calm 97.3%
Surprised 7.1%
Fear 6%
Sad 2.2%
Disgusted 0.5%
Happy 0.1%
Confused 0.1%
Angry 0%

AWS Rekognition

Age 37-45
Gender Male, 98.9%
Sad 99.9%
Calm 11.7%
Fear 6.8%
Surprised 6.8%
Confused 2%
Disgusted 1.5%
Happy 1.2%
Angry 0.6%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Sad 78.7%
Calm 39.6%
Angry 15.2%
Surprised 6.5%
Fear 6%
Happy 4.8%
Confused 2%
Disgusted 1.6%

AWS Rekognition

Age 18-26
Gender Female, 99.5%
Calm 89.7%
Surprised 6.9%
Fear 6%
Sad 4%
Disgusted 1.2%
Angry 1.1%
Confused 1%
Happy 0.9%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Sad 82.3%
Calm 58.1%
Surprised 6.4%
Fear 6.3%
Happy 1.2%
Angry 0.9%
Confused 0.6%
Disgusted 0.4%

AWS Rekognition

Age 18-26
Gender Male, 96.7%
Calm 94.2%
Fear 6.6%
Surprised 6.6%
Sad 2.7%
Angry 0.7%
Confused 0.4%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 20-28
Gender Male, 98.3%
Calm 51.1%
Fear 39.5%
Surprised 6.5%
Sad 6%
Happy 2.7%
Angry 2.6%
Disgusted 0.5%
Confused 0.3%

AWS Rekognition

Age 16-22
Gender Male, 60.9%
Calm 82.2%
Surprised 7.3%
Fear 6.5%
Angry 4.8%
Sad 3.8%
Confused 2.3%
Disgusted 2.1%
Happy 1%

AWS Rekognition

Age 21-29
Gender Male, 99.2%
Calm 85.1%
Surprised 6.6%
Fear 6.4%
Angry 5.7%
Sad 3.6%
Confused 1.3%
Happy 1.1%
Disgusted 0.9%

AWS Rekognition

Age 19-27
Gender Male, 96.8%
Calm 65.4%
Happy 12%
Angry 10.8%
Surprised 7.7%
Fear 6.4%
Sad 3.9%
Confused 2%
Disgusted 1.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 90.9%
a vintage photo of a group of people posing for a picture 90.8%
an old photo of a group of people posing for the camera 90.7%

Text analysis

Amazon

34
SE4

Google

SE4 34
SE4
34