Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Association of Neighborhood Workers": Arts and Festival Committee: Association of Neighborhood Workers of New York. Arts and Festivals Committee

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3139.3

Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Association of Neighborhood Workers": Arts and Festival Committee: Association of Neighborhood Workers of New York. Arts and Festivals Committee

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 98.7
Person 98.6
Person 93.6
Crowd 92.7
Person 91.5
Person 90.7
Military 89.4
Person 86.6
Military Uniform 86.4
Person 85.7
Person 84.9
Person 80.6
Clothing 79.9
Apparel 79.9
Person 75.9
Person 72.7
People 70.1
Person 69.9
Person 63.5
Audience 62.2
Person 61.4
Person 61.2
Person 60.6
Marching 58.6
Armored 58
Army 58
Officer 57.2
Person 50
Person 48.3

Clarifai
created on 2019-06-06

people 100
many 99.8
group 99.7
adult 98.7
group together 97.2
man 95.7
military 95
child 93.3
crowd 93.2
leader 92.5
wear 92.2
cavalry 92.1
outfit 92
administration 91.4
home 91.4
vehicle 88.7
war 86.4
uniform 85.4
woman 85.2
veil 82.3

Imagga
created on 2019-06-06

snow 55.9
thatch 32.5
landscape 32
weather 27.6
roof 26.6
tree 23.2
protective covering 20.6
sky 18.8
winter 16.2
covering 15
rural 15
travel 14.8
trees 14.2
field 14.2
stone 13.3
old 13.2
sand 12.5
scenic 12.3
rock 12.2
scenery 11.7
water 11.3
cold 11.2
shore 11.1
clouds 11
countryside 11
structure 10.8
mountain 10.8
farm 10.7
outdoors 10.7
cemetery 10.5
sea 10.2
horizon 9.9
agriculture 9.6
mountains 9.3
fence 9.1
summer 9
coast 9
sun 8.8
country 8.8
park bench 8.5
beach 8.4
wood 8.3
tourism 8.2
park 8.2
road 8.1
textured 7.9
forest 7.8
architecture 7.8
season 7.8
building 7.7
house 7.5
south 7.5
ocean 7.5
environment 7.4
natural 7.4
peaceful 7.3
penguin 7.2
spring 7.1

Google
created on 2019-06-06

Microsoft
created on 2019-06-06

tree 100
outdoor 99.9
horse 92.6
white 92.3
old 83.8
people 83.3
black 72.8
group 68.1
person 63.6
crowd 28.7
team 25

Face analysis

Amazon

AWS Rekognition

Age 10-15
Gender Female, 50.5%
Angry 49.5%
Calm 49.6%
Confused 49.5%
Happy 49.7%
Sad 50.1%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 45-63
Gender Female, 50.4%
Calm 49.5%
Happy 50.2%
Sad 49.7%
Angry 49.5%
Disgusted 49.5%
Confused 49.5%
Surprised 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Angry 49.6%
Happy 49.5%
Calm 49.6%
Confused 49.5%
Sad 49.6%
Disgusted 50.2%
Surprised 49.5%

AWS Rekognition

Age 16-27
Gender Female, 50.4%
Surprised 49.5%
Angry 50%
Sad 49.8%
Happy 49.6%
Disgusted 49.6%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 35-52
Gender Male, 50.2%
Calm 49.6%
Sad 50%
Confused 49.5%
Angry 49.7%
Disgusted 49.5%
Surprised 49.5%
Happy 49.6%

AWS Rekognition

Age 14-23
Gender Female, 50.4%
Angry 49.5%
Confused 49.5%
Calm 49.5%
Disgusted 49.5%
Happy 49.5%
Surprised 49.5%
Sad 50.5%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Sad 50.4%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Confused 49.5%
Calm 49.5%
Angry 49.5%

AWS Rekognition

Age 14-23
Gender Male, 50.1%
Calm 49.7%
Angry 49.7%
Happy 49.5%
Sad 49.8%
Surprised 49.5%
Confused 49.7%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Calm 49.5%
Sad 50.5%
Angry 49.5%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%
Happy 49.5%

AWS Rekognition

Age 20-38
Gender Male, 50.4%
Happy 49.6%
Disgusted 49.6%
Surprised 49.6%
Sad 49.8%
Confused 49.6%
Angry 49.7%
Calm 49.8%

AWS Rekognition

Age 26-43
Gender Male, 50.3%
Disgusted 49.8%
Confused 49.6%
Surprised 49.6%
Calm 49.8%
Happy 49.5%
Angry 49.7%
Sad 49.6%

AWS Rekognition

Age 20-38
Gender Male, 50.4%
Surprised 49.5%
Happy 49.5%
Sad 49.8%
Angry 49.6%
Disgusted 49.6%
Confused 49.7%
Calm 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Sad 49.6%
Angry 49.5%
Confused 49.7%
Happy 49.5%
Disgusted 49.5%
Surprised 49.6%
Calm 50%

AWS Rekognition

Age 15-25
Gender Female, 50.3%
Happy 49.6%
Sad 49.6%
Confused 49.5%
Calm 49.5%
Angry 49.6%
Disgusted 50.1%
Surprised 49.5%

AWS Rekognition

Age 9-14
Gender Female, 50.1%
Sad 49.7%
Angry 49.6%
Calm 50%
Confused 49.6%
Happy 49.6%
Disgusted 49.5%
Surprised 49.6%

AWS Rekognition

Age 27-44
Gender Male, 50.5%
Disgusted 49.5%
Surprised 49.6%
Sad 49.8%
Angry 49.6%
Happy 49.5%
Confused 49.8%
Calm 49.8%

AWS Rekognition

Age 23-38
Gender Male, 50.5%
Angry 49.6%
Surprised 49.5%
Sad 50.3%
Confused 49.5%
Calm 49.5%
Disgusted 49.5%
Happy 49.5%

AWS Rekognition

Age 16-27
Gender Female, 50.4%
Calm 49.6%
Disgusted 49.6%
Surprised 49.5%
Confused 49.5%
Angry 49.6%
Sad 50%
Happy 49.7%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Confused 49.6%
Sad 49.9%
Disgusted 49.6%
Angry 49.6%
Happy 49.5%
Calm 49.8%
Surprised 49.5%

AWS Rekognition

Age 10-15
Gender Female, 50.4%
Surprised 49.6%
Happy 49.8%
Confused 49.5%
Calm 49.6%
Disgusted 49.9%
Sad 49.6%
Angry 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50%
Happy 49.5%
Sad 49.5%
Disgusted 49.5%
Calm 50.4%
Surprised 49.5%
Confused 49.5%
Angry 49.5%

AWS Rekognition

Age 19-36
Gender Female, 50%
Sad 50%
Angry 49.8%
Happy 49.6%
Disgusted 49.5%
Calm 49.5%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Angry 49.8%
Happy 49.6%
Confused 49.6%
Surprised 49.6%
Sad 49.7%
Disgusted 49.7%
Calm 49.6%

AWS Rekognition

Age 38-59
Gender Female, 50.1%
Happy 49.5%
Angry 49.6%
Calm 49.9%
Sad 49.9%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%

Feature analysis

Amazon

Person 98.6%

Captions

Microsoft

a group of people standing in front of a white horse 96.4%
a group of people riding on the back of a horse 94.6%
a group of people in front of a white horse 94.5%