Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Hudson Guild": The Hudson Guild, New York City.: Summer Outings.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3182.4

Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Hudson Guild": The Hudson Guild, New York City.: Summer Outings.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 97.7
Person 97.7
Person 93.9
Person 93.5
Outdoors 92.6
Person 91.6
Person 88
Nature 86.9
Transportation 81.8
Person 81
Snow 81
Vehicle 80.6
Person 79.4
Painting 76.3
Art 76.3
Ice 74.5
Person 70.5
Boat 70
Person 69.2
Person 65.4
Rowboat 64.4
Person 64.4
Winter 56.7
Person 52.5

Clarifai
created on 2019-06-06

people 100
group 99.6
adult 99
print 98.8
many 98.2
group together 98.1
vehicle 97.6
man 97.5
watercraft 97
illustration 93.2
military 92.3
several 91.5
interaction 91.2
art 91.2
cavalry 90.9
skirmish 90.5
wear 90.3
engraving 89.9
war 88
weapon 87.6

Imagga
created on 2019-06-06

snow 66.1
weather 37.5
landscape 29
forest 28.2
tree 26.5
winter 25.5
lake 22.1
water 22
ice 22
cold 21.5
ocean 20.8
river 19.7
sky 19.7
grunge 19.6
texture 19.5
season 18.7
trees 17.8
park 17.3
basin 15.6
mountain 15.2
body of water 15.1
frozen 14.3
natural 14.1
pattern 13.7
outdoors 13.7
frost 13.4
wallpaper 13
outdoor 13
natural depression 12.8
snowy 12.6
reflection 12.6
scenery 12.6
old 12.6
cool 12.4
structure 12.4
scene 12.1
geological formation 11.4
travel 11.3
design 11.3
fountain 11.3
goose 11.1
sea 11
wood 10.8
art 10.7
graphic 10.2
mountains 10.2
aged 10
decoration 9.9
backdrop 9.9
splash 9.9
textured 9.6
beach 9.6
drawing 9.5
wave 9.5
path 9.5
vintage 9.1
paint 9.1
tranquil 9.1
environment 9.1
summer 9
material 8.9
color 8.9
white 8.8
rural 8.8
scenic 8.8
sand 8.8
grass 8.7
artistic 8.7
grungy 8.5
clouds 8.5
stream 8.2
branch 8.2
coast 8.1
rock 7.8
antique 7.8
wilderness 7.8
nobody 7.8
scenics 7.7
weathered 7.6
hill 7.5
silhouette 7.5
waves 7.4
calm 7.3
backgrounds 7.3
black 7.2
wet 7.2
waterfowl 7.1
day 7.1
surface 7.1

Google
created on 2019-06-06

Photograph 95.4
Tree 74.7
Art 73.1
Room 65.7
Painting 63.8
Photography 62.4
Bank 56.5
Bayou 56.5
Picture frame 55.8
Visual arts 55
Illustration 50.4

Microsoft
created on 2019-06-06

outdoor 99.8
tree 98.7
water 94.6
person 91.2
lake 85.9
mammal 51.3
old 45.5

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Confused 49.5%
Calm 49.5%
Disgusted 49.6%
Sad 49.9%
Happy 49.6%
Angry 49.8%
Surprised 49.5%

AWS Rekognition

Age 15-25
Gender Female, 50.1%
Surprised 49.6%
Disgusted 49.6%
Sad 49.7%
Calm 49.7%
Confused 49.6%
Angry 49.6%
Happy 49.7%

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Confused 49.5%
Sad 49.6%
Disgusted 50.1%
Angry 49.6%
Happy 49.5%
Calm 49.5%
Surprised 49.5%

AWS Rekognition

Age 15-25
Gender Female, 50.4%
Calm 49.5%
Happy 49.6%
Confused 49.5%
Sad 49.9%
Angry 49.6%
Surprised 49.5%
Disgusted 49.8%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Surprised 49.6%
Disgusted 49.7%
Angry 49.6%
Sad 49.8%
Happy 49.6%
Confused 49.6%
Calm 49.7%

AWS Rekognition

Age 26-43
Gender Male, 50.3%
Angry 49.6%
Surprised 49.7%
Disgusted 49.5%
Calm 49.8%
Sad 49.6%
Happy 49.5%
Confused 49.8%

AWS Rekognition

Age 14-25
Gender Female, 50.4%
Angry 49.8%
Disgusted 49.5%
Calm 49.8%
Surprised 49.5%
Happy 49.5%
Sad 49.7%
Confused 49.6%

Feature analysis

Amazon

Person 97.7%
Painting 76.3%

Captions

Microsoft

a group of people in the water 74.1%
a black and white photo of a person 74%
a group of people riding on the back of a horse 59.4%

Text analysis

Amazon

2