Human Generated Data

Title

Social Settlements: United States. New York. New York City. University Settlement: University Settlement, New York City: A corner of the porch.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.142.2

Human Generated Data

Title

Social Settlements: United States. New York. New York City. University Settlement: University Settlement, New York City: A corner of the porch.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.2
Person 99.2
Person 97.5
Apparel 94.4
Clothing 94.4
Person 92.9
Poster 88.6
Advertisement 88.6
Paper 85.7
Text 80.8
Flyer 73.2
Brochure 73.2
Fashion 68.3
Gown 68.3
Robe 59.4
Evening Dress 55.5
Collage 55.4
Wedding 55.4

Clarifai
created on 2019-06-05

painting 97.7
people 96.7
empty 95.6
no person 95
indoors 93.4
paper 92.7
adult 91.8
man 91.4
wear 91.2
wall 91.2
one 90.9
art 89.9
blank 89.7
retro 89
picture frame 89
museum 88.2
room 87.1
window 86.2
woman 85.9
furniture 84.6

Imagga
created on 2019-06-05

envelope 100
container 56
notebook 30.6
paper 29.9
card 25.7
frame 21.7
old 20.2
blank 19.7
book 16.8
note 16.6
design 16.5
retro 15.6
business 15.2
board 15
binding 14.7
message 14.6
office 13.7
binder 13.5
man 13.5
vintage 13.2
holding 13.2
page 13
greeting 13
empty 12.9
home 12.8
grunge 11.9
person 11.8
adult 11.7
bill 11.4
male 11.4
happy 11.3
money 11.1
border 10.9
cardboard 10.6
protective covering 10.1
aged 10
copy 9.7
decoration 9.6
ancient 9.5
people 9.5
covering 9.4
floral 9.4
space 9.3
brown 8.8
album 8.8
scrapbook 8.7
antique 8.7
advertising 8.6
worn 8.6
professional 8.4
modern 8.4
communication 8.4
decorative 8.4
birthday 8.3
symbol 8.1
product 8.1
smile 7.8
art 7.8
leaf 7.8
flower 7.7
texture 7.6
sign 7.5
technology 7.4
box 7.4
present 7.3
valentine 7.3
drawing 7.2
computer 7.2
dirty 7.2
currency 7.2
holiday 7.2

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

person 90.1
clothing 88.5
scene 81.3
woman 78.7
picture frame 77.8
room 70.7
gallery 70.6

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Confused 49.5%
Calm 49.5%
Angry 49.5%
Surprised 49.5%
Sad 49.6%
Happy 50.4%
Disgusted 49.5%

AWS Rekognition

Age 38-59
Gender Female, 50.4%
Confused 49.5%
Angry 49.7%
Disgusted 49.5%
Surprised 49.5%
Sad 50.2%
Calm 49.5%
Happy 49.5%

AWS Rekognition

Age 15-25
Gender Female, 50.2%
Disgusted 49.5%
Sad 49.7%
Calm 49.5%
Surprised 49.5%
Angry 50.1%
Happy 49.6%
Confused 49.5%

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a room with art on the wall 59.2%
a close up of a white wall 46.9%

Text analysis

Amazon

York
New
City.
York City. New nt,
Acorner
of
A Acorner of the porch.
A
the
porch.
nt,
uanversity
Setnent
G Se- 2973.19-13

Google

29.73-29-13
UrAuces
ity
Setnen
corner
G
S
nt,
City.
corner of the porch G S 29.73-29-13 UrAuces ity Setnen nt, New York City.
the
New
York
of
porch