Human Generated Data

Title

Social Settlements: United States. New York. Brooklyn. "Greenpoint Settlement": Greenpoint Settlement, Brooklyn, N.Y.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3132

Human Generated Data

Title

Social Settlements: United States. New York. Brooklyn. "Greenpoint Settlement": Greenpoint Settlement, Brooklyn, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 95.8
Person 95.8
Person 92.6
Person 88.4
Person 88.3
Person 86.6
Person 84.7
Amusement Park 83.4
Carousel 83
Person 77.6
Person 77.2
Text 75.7
Person 75
Theme Park 74.5
Person 73
Person 69
Person 60.2
Person 58.7
Person 50.8
Person 42.8

Clarifai
created on 2019-06-06

desktop 94.1
paper 93.6
retro 91.4
illustration 90.8
vintage 90.5
old 90.4
art 90.1
picture frame 89.2
design 86.3
no person 85.4
image 84.4
blank 83.9
antique 83.8
texture 83.3
document 82.5
decoration 82.3
note 79.9
wall 79.8
card 78.5
ancient 78

Imagga
created on 2019-06-06

comb 51.7
tool 48.4
grunge 32.3
snow 26.9
texture 26.4
paper 26
old 24.4
vintage 24
frame 22.5
brush 21.7
envelope 21
antique 19.9
landscape 18.6
dirty 18.1
blank 18
winter 17.9
space 17.8
shredder 17.7
page 16.7
ancient 16.4
pattern 16.4
empty 16.3
design 16.3
device 16
retro 15.6
rough 15.5
aged 15.4
container 15.2
black 15
text 14.8
tree 14.6
textured 14
cardboard 13.4
drawing 13.4
damaged 13.4
grungy 13.3
cold 12.9
art 12.9
border 12.7
sky 12.1
document 12.1
decoration 11.8
season 11.7
wood 11.7
snowy 11.7
messy 11.6
frost 11.5
copy 11.5
wallpaper 11.5
dirt 11.5
structure 11
close 10.8
outdoor 10.7
torn 10.6
obsolete 10.5
frozen 10.5
seasonal 10.5
old fashioned 10.5
scene 10.4
wall 10.4
sheet 10.3
graphic 10.2
card 10.2
paint 10
scenery 9.9
material 9.8
trees 9.8
surface 9.7
rural 9.7
stain 9.6
forest 9.6
artistic 9.6
book 9.3
grain 9.2
note 9.2
natural 8.7
edge 8.7
bristle brush 8.6
parchment 8.6
architecture 8.6
weathered 8.5
canvas 8.5
ice 8.4
fence 8.4
dark 8.3
stationery 8.2
backgrounds 8.1
web site 7.9
distressed 7.9
scratch 7.8
crumpled 7.8
plow 7.8
decay 7.7
ink 7.7
worn 7.6
field 7.5
cover 7.4
brown 7.4
light 7.4
water 7.3
letter 7.3
school 7.2
holiday 7.2
history 7.2
country 7

Google
created on 2019-06-06

Photograph 95.3
Text 91.6
Paper 75.3
Room 71.4
Photographic paper 70.5
Collection 70.4
Photography 67.8
Art 67.7
Illustration 66.9
Paper product 66
History 64.5
Stock photography 59.4
Visual arts 55

Microsoft
created on 2019-06-06

gallery 74.6
room 54

Face analysis

Amazon

AWS Rekognition

Age 14-25
Gender Female, 50.3%
Surprised 49.5%
Sad 50.2%
Disgusted 49.5%
Calm 49.5%
Happy 49.6%
Angry 49.6%
Confused 49.5%

AWS Rekognition

Age 15-25
Gender Female, 50.4%
Angry 49.6%
Confused 49.5%
Calm 49.5%
Disgusted 49.5%
Happy 49.5%
Surprised 49.5%
Sad 50.3%

AWS Rekognition

Age 14-25
Gender Female, 50.4%
Surprised 49.5%
Sad 50.3%
Disgusted 49.5%
Happy 49.6%
Confused 49.5%
Calm 49.5%
Angry 49.5%

AWS Rekognition

Age 12-22
Gender Female, 50.3%
Angry 49.6%
Happy 49.6%
Disgusted 49.5%
Confused 49.5%
Calm 49.5%
Surprised 49.5%
Sad 50.2%

AWS Rekognition

Age 4-9
Gender Female, 50.2%
Surprised 49.5%
Angry 49.9%
Sad 49.8%
Happy 49.5%
Disgusted 49.6%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Calm 49.6%
Disgusted 49.6%
Surprised 49.6%
Confused 49.5%
Angry 49.6%
Sad 50%
Happy 49.6%

AWS Rekognition

Age 11-18
Gender Female, 50.5%
Calm 49.5%
Surprised 49.5%
Happy 49.5%
Angry 49.5%
Confused 49.5%
Sad 50.4%
Disgusted 49.5%

AWS Rekognition

Age 4-9
Gender Female, 50.1%
Calm 49.6%
Happy 49.6%
Confused 49.6%
Sad 50%
Angry 49.6%
Surprised 49.5%
Disgusted 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Angry 49.5%
Happy 49.6%
Calm 50.1%
Confused 49.6%
Sad 49.6%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 14-23
Gender Female, 50.2%
Sad 49.8%
Calm 49.8%
Surprised 49.6%
Confused 49.6%
Disgusted 49.5%
Happy 49.7%
Angry 49.6%

AWS Rekognition

Age 14-25
Gender Male, 50.1%
Calm 49.5%
Confused 49.5%
Happy 49.5%
Disgusted 49.5%
Angry 49.5%
Surprised 49.5%
Sad 50.4%

AWS Rekognition

Age 10-15
Gender Female, 50.2%
Confused 49.5%
Sad 50%
Disgusted 49.5%
Angry 49.7%
Happy 49.7%
Calm 49.5%
Surprised 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Confused 49.6%
Disgusted 49.7%
Sad 49.6%
Angry 49.6%
Surprised 49.6%
Happy 49.8%
Calm 49.7%

AWS Rekognition

Age 15-25
Gender Female, 50.4%
Angry 49.5%
Confused 49.5%
Calm 49.5%
Surprised 49.5%
Sad 50.4%
Happy 49.5%
Disgusted 49.5%

AWS Rekognition

Age 4-7
Gender Female, 50.3%
Disgusted 49.5%
Confused 49.5%
Happy 49.6%
Sad 49.8%
Surprised 49.5%
Calm 49.6%
Angry 50%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Sad 50.4%
Angry 49.5%
Confused 49.5%
Happy 49.5%
Disgusted 49.5%
Surprised 49.5%
Calm 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Confused 49.5%
Disgusted 49.5%
Sad 50.2%
Angry 49.6%
Surprised 49.5%
Happy 49.5%
Calm 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Happy 50.1%
Disgusted 49.5%
Angry 49.5%
Confused 49.5%
Calm 49.5%
Surprised 49.5%
Sad 49.8%

AWS Rekognition

Age 26-44
Gender Female, 50.5%
Happy 49.5%
Disgusted 49.5%
Surprised 49.5%
Sad 49.8%
Confused 49.6%
Angry 49.6%
Calm 49.9%

AWS Rekognition

Age 15-25
Gender Female, 50.4%
Sad 50.4%
Angry 49.6%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 16-27
Gender Female, 50.4%
Confused 49.6%
Surprised 49.5%
Angry 49.6%
Happy 49.6%
Sad 49.8%
Calm 49.8%
Disgusted 49.6%

AWS Rekognition

Age 15-25
Gender Female, 50.2%
Surprised 49.5%
Happy 49.5%
Confused 49.5%
Calm 49.5%
Disgusted 49.5%
Angry 49.5%
Sad 50.5%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Sad 49.6%
Calm 49.8%
Happy 49.6%
Surprised 49.6%
Angry 49.6%
Disgusted 49.7%
Confused 49.6%

AWS Rekognition

Age 4-9
Gender Male, 50.2%
Confused 49.6%
Disgusted 49.6%
Calm 49.8%
Sad 49.8%
Angry 49.7%
Happy 49.5%
Surprised 49.5%

AWS Rekognition

Age 6-13
Gender Female, 50.4%
Calm 49.7%
Surprised 49.5%
Happy 49.6%
Disgusted 49.6%
Angry 49.6%
Sad 50%
Confused 49.6%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Disgusted 49.5%
Happy 49.5%
Angry 49.6%
Surprised 49.5%
Sad 50.2%
Confused 49.5%
Calm 49.5%

AWS Rekognition

Age 15-25
Gender Female, 50.3%
Calm 49.7%
Happy 49.7%
Sad 49.9%
Angry 49.6%
Confused 49.6%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 14-25
Gender Female, 50.5%
Calm 49.7%
Disgusted 49.6%
Angry 49.6%
Happy 49.6%
Sad 49.8%
Surprised 49.6%
Confused 49.6%

AWS Rekognition

Age 16-27
Gender Female, 50.3%
Happy 49.6%
Angry 49.6%
Calm 49.6%
Sad 50.2%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.4%
Angry 49.6%
Calm 49.6%
Sad 49.9%
Surprised 49.5%
Disgusted 49.8%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 17-27
Gender Female, 50.2%
Confused 49.5%
Surprised 49.5%
Angry 49.6%
Happy 49.5%
Sad 50.2%
Calm 49.5%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Angry 49.6%
Happy 49.6%
Calm 49.8%
Confused 49.5%
Sad 49.9%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Disgusted 49.5%
Calm 49.7%
Confused 49.5%
Happy 49.6%
Surprised 49.5%
Angry 49.6%
Sad 50.1%

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Sad 50.3%
Angry 49.6%
Confused 49.5%
Happy 49.5%
Disgusted 49.6%
Surprised 49.5%
Calm 49.5%

AWS Rekognition

Age 15-25
Gender Female, 50.4%
Sad 50.2%
Calm 49.6%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%
Happy 49.6%
Angry 49.5%

Feature analysis

Amazon

Person 95.8%

Captions

Microsoft

a display in a room 60.1%
a display case in a room 37.6%
a display case 27.6%

Text analysis

Amazon

Greenpoint
Settlement,
Brooklyn,
Greenpoint Settlement, Brooklyn, N.Y.
N.Y.
uring
eey
Where eey
Where
thomsoies
Roof
thomsoies uring A
Roof Gorderr
G Se 27- 724/0
Gorderr
A

Google

sumer
Garden
Greenpoint
N.Y.
the
y
Roof
GSe
76ro
Brooklyn,
Where
themaelves
aonths
children
enjo
uing
GSe 2-7 76ro Greenpoint Settlement, Brooklyn, N.Y. Where the children enjo y themaelves uing the sumer aonths Roof Garden
2-7
Settlement,