Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. The College Settlement: Environment After Immigration. Perpetuation of European Standards in America. The College Settlement, Philadelphia, Pa.: Polish Family. (This family, which includes, beside the woman and children shown, two men, lives in the single small room.)
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.191.2

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. The College Settlement: Environment After Immigration. Perpetuation of European Standards in America. The College Settlement, Philadelphia, Pa.: Polish Family. (This family, which includes, beside the woman and children shown, two men, lives in the single small room.)

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.191.2

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 98.8
Person 98.8
Person 97.8
Person 97.3
Person 93.8
Person 92.3
Person 91.6
Indoors 88.4
Room 88.4
Person 82.8
Person 74
Painting 71.6
Art 71.6
Text 71.2
Person 70
Interior Design 64.6
People 64.5
Porch 59.2
Clinic 57

Clarifai
created on 2019-06-05

people 100
group 99.3
adult 98.3
room 98.1
child 97
man 96.8
woman 95.3
many 94.4
group together 92.8
furniture 92.2
sit 92.2
leader 91.4
indoors 91
print 90.3
boy 90.3
several 90.1
chair 88.8
military 88.5
family 88.2
administration 85.7

Imagga
created on 2019-06-05

paper 28.5
money 24.7
old 24.4
currency 24.2
vintage 22.3
cash 21
business 20.6
bill 20
finance 18.6
dollar 18.6
retro 18
bank 17.1
grunge 16.2
barbershop 16
room 15.8
ancient 15.6
aged 15.4
mail 15.3
shop 14.6
financial 14.2
note 13.8
letter 13.7
blank 13.7
stamp 13.7
card 13.2
banking 12.9
postmark 12.8
postage 12.8
newspaper 12.6
hundred 12.6
antique 12.5
exchange 12.4
envelope 12.2
sign 12
office 11.5
symbol 11.4
man 11.4
texture 11.1
blackboard 11
message 11
decoration 10.9
circa 10.8
postal 10.8
wealth 10.8
dollars 10.6
people 10.6
design 10.1
mercantile establishment 10.1
dirty 9.9
philately 9.9
table 9.8
bills 9.7
banknote 9.7
pay 9.6
pattern 9.6
classroom 9.6
post 9.5
furniture 9.4
savings 9.3
space 9.3
investment 9.2
frame 9.2
close 9.1
history 8.9
wall 8.7
art 8.6
desk 8.6
empty 8.6
product 8.5
stock 8.4
house 8.4
one 8.2
global 8.2
creation 8.1
travel 7.7
states 7.7
us 7.7
payment 7.7
notes 7.7
united 7.6
grungy 7.6
drawing 7.3
paint 7.2
black 7.2
home 7.2

Google
created on 2019-06-05

Photograph 96.6
People 93.9
Snapshot 87.1
Text 86.9
Room 81.5
History 68.8
Family 67.3
Adaptation 67
Vintage clothing 64
Photography 62.4
Art 58.1
House 53.7
Illustration 50.4

Microsoft
created on 2019-06-05

clothing 95
person 94.5
furniture 72
picture frame 62.8
table 54

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Female, 53.3%
Calm 46%
Disgusted 46.4%
Happy 45.4%
Surprised 45.5%
Sad 50.3%
Angry 46.1%
Confused 45.3%

AWS Rekognition

Age 4-9
Gender Female, 53.2%
Sad 51.1%
Calm 45.4%
Happy 46%
Surprised 45.3%
Angry 45.6%
Disgusted 46.4%
Confused 45.3%

AWS Rekognition

Age 4-9
Gender Female, 53.4%
Happy 45.7%
Angry 45.1%
Calm 45.3%
Confused 45.1%
Disgusted 45.1%
Surprised 45.1%
Sad 53.4%

AWS Rekognition

Age 11-18
Gender Male, 50%
Calm 46.3%
Disgusted 45.3%
Sad 52.2%
Happy 45.1%
Confused 45.4%
Surprised 45.3%
Angry 45.5%

AWS Rekognition

Age 4-9
Gender Female, 54.6%
Surprised 45.2%
Calm 50.4%
Happy 46%
Angry 45.2%
Sad 47.9%
Disgusted 45.1%
Confused 45.2%

AWS Rekognition

Age 4-9
Gender Female, 52.7%
Surprised 51.1%
Disgusted 45.2%
Sad 46.4%
Calm 45.8%
Confused 45.7%
Angry 45.4%
Happy 45.4%

AWS Rekognition

Age 35-52
Gender Female, 50.1%
Disgusted 45.4%
Confused 45.3%
Surprised 45.2%
Calm 51.1%
Happy 45.5%
Angry 46.6%
Sad 45.9%

AWS Rekognition

Age 19-36
Gender Female, 50.5%
Disgusted 49.6%
Confused 49.6%
Surprised 49.5%
Calm 49.6%
Happy 49.6%
Angry 49.5%
Sad 50%

Microsoft Cognitive Services

Age 24
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Painting 71.6%

Categories

Imagga

interior objects 68.5%
paintings art 28.4%
streetview architecture 2%

Captions

Text analysis

Amazon

Family
Polish Family
Polish
which
shown,
smoll
the
wo
womon
(This fomily, which inchdes, beside the womon and children
and
shown, wo mem, ives in the single smoll room.
single
fomily,
children
(This
room.
beside
ives
inchdes,
in
mem,

Google

Eriancady Palish Family (This tamily, which includes, beside the woman and children shown, two men, lves in the single small room.
Eriancady
Palish
Family
(This
tamily,
which
includes,
beside
the
woman
and
children
shown,
two
men,
lves
in
single
small
room.