Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "South End Industrial School": South End Industrial School, Roxbury, Mass.: Little Dressmakers. Many of the girls are wearing dresses they made in class.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.456.1

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "South End Industrial School": South End Industrial School, Roxbury, Mass.: Little Dressmakers. Many of the girls are wearing dresses they made in class.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.456.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Poster 99.8
Advertisement 99.8
Person 98.7
Human 98.7
Person 98.1
Person 96.6
Person 94.8
Person 91.9
Person 90.3
Text 85.8
Person 84.7
People 84.3
Person 80.2
Face 76.8
Person 75.3
Person 64.2
Bed 55.1
Furniture 55.1
Person 43.7
Person 43.5

Clarifai
created on 2019-06-05

people 100
group 99.5
child 98.4
adult 97.2
print 96.2
several 94
man 93.2
sit 92.8
portrait 92.8
woman 92.2
many 92.1
two 88.5
wear 88.3
engraving 88
one 87.7
administration 87.7
art 86.9
leader 86.7
music 86.3
furniture 85.8

Imagga
created on 2019-06-05

book jacket 73.9
newspaper 58.7
jacket 57.5
product 46.9
wrapping 43.7
creation 38.2
vintage 37.2
stamp 33.9
mail 33.5
postmark 31.5
covering 29.4
letter 29.4
envelope 28.9
postage 28.5
money 27.2
currency 26.9
printed 26.6
postal 26.5
old 25.8
retro 25.4
paper 24.3
circa 22.7
philately 21.7
shows 21.7
ancient 21.6
cash 20.1
banking 18.4
business 18.2
aged 18.1
bank 17.9
dollar 17.6
bill 17.1
art 16.4
global 16.4
post 16.2
antique 14.9
dollars 14.5
card 14.5
wealth 14.4
finance 14.4
close 14.3
message 13.7
daily 13.6
cutting 13.5
symbol 13.5
communications 13.4
exchange 13.4
financial 13.4
unique 13.3
savings 13.1
stamps 12.8
culture 12.8
one 11.9
masterpiece 11.9
bills 11.7
fine 11.4
man 11.4
post mail 10.9
painter 10.9
zigzag 10.9
known 10.9
address 10.8
closeup 10.8
paintings 10.8
delivery 10.7
banknote 10.7
museum 10.7
office 10.4
economy 10.2
investment 10.1
fame 9.9
renaissance 9.8
hundred 9.7
black 9.6
painted 9.5
icon 9.5
note 9.2
portrait 9.1
paint 9.1
sign 9
history 8.9
post office 8.9
market 8.9
banknotes 8.8
states 8.7
face 8.5
grunge 8.5
comic book 8.2
person 8
pounds 7.9
people 7.8
male 7.8
letters 7.7
pound 7.7
us 7.7
notes 7.7
texture 7.6
united 7.6
hobby 7.6
rich 7.4
church 7.4
collection 7.2

Google
created on 2019-06-05

Photograph 96.9
People 93.4
Snapshot 87.6
Text 85.2
Stock photography 70.4
Photography 67.8
Room 65.7
Paper product 59.4
Vintage clothing 55.9
Family 51.8
Art 50.2

Microsoft
created on 2019-06-05

clothing 97.6
person 97.1
text 94.5
human face 90.6
woman 79.5
child 79.5
photograph 61.3
smile 52.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 11-18
Gender Female, 55%
Calm 45%
Surprised 45%
Happy 55%
Disgusted 45%
Angry 45%
Sad 45%
Confused 45%

AWS Rekognition

Age 27-44
Gender Female, 95.5%
Disgusted 2.9%
Happy 45.8%
Angry 2.5%
Calm 34.1%
Surprised 1.8%
Confused 3.4%
Sad 9.5%

AWS Rekognition

Age 35-52
Gender Female, 54.6%
Disgusted 45.1%
Calm 45.2%
Confused 45.2%
Happy 54%
Surprised 45.2%
Angry 45.1%
Sad 45.2%

AWS Rekognition

Age 9-14
Gender Female, 54.4%
Surprised 45.3%
Calm 50.3%
Happy 46.2%
Angry 45.9%
Sad 46.7%
Disgusted 45.3%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Female, 54.5%
Disgusted 45.4%
Surprised 45.3%
Sad 46.2%
Angry 45.2%
Happy 47.3%
Confused 45.4%
Calm 50.2%

AWS Rekognition

Age 10-15
Gender Female, 54.9%
Happy 54.5%
Disgusted 45.1%
Sad 45.2%
Surprised 45.1%
Confused 45%
Calm 45.1%
Angry 45%

AWS Rekognition

Age 35-52
Gender Female, 54.8%
Happy 47.4%
Calm 45.1%
Sad 51.4%
Surprised 45.2%
Angry 45.3%
Confused 45.2%
Disgusted 45.4%

AWS Rekognition

Age 16-27
Gender Female, 54.4%
Angry 45%
Calm 45.1%
Disgusted 45%
Happy 54.7%
Surprised 45%
Sad 45.1%
Confused 45%

AWS Rekognition

Age 35-52
Gender Female, 54.6%
Confused 45.1%
Surprised 45.1%
Angry 45.1%
Happy 54%
Sad 45.3%
Calm 45.2%
Disgusted 45.2%

AWS Rekognition

Age 11-18
Gender Female, 54.5%
Angry 45%
Disgusted 45%
Confused 45%
Calm 45%
Happy 54.9%
Surprised 45%
Sad 45%

AWS Rekognition

Age 35-52
Gender Female, 53%
Disgusted 45.4%
Happy 46%
Angry 45.1%
Calm 45.1%
Surprised 45.1%
Confused 45.1%
Sad 53.3%

AWS Rekognition

Age 4-9
Gender Female, 51.8%
Angry 45%
Confused 45%
Calm 45.1%
Surprised 45%
Sad 45%
Happy 54.8%
Disgusted 45%

AWS Rekognition

Age 10-15
Gender Female, 53.6%
Surprised 45.1%
Sad 45.2%
Disgusted 45.1%
Happy 52.7%
Confused 45.4%
Calm 46.2%
Angry 45.3%

AWS Rekognition

Age 15-25
Gender Female, 54.6%
Surprised 45.1%
Happy 45.5%
Confused 45.1%
Calm 45.6%
Disgusted 45.2%
Sad 52.7%
Angry 45.8%

AWS Rekognition

Age 14-25
Gender Female, 54.5%
Disgusted 45.1%
Confused 45.1%
Surprised 45.1%
Calm 45.2%
Happy 50.2%
Angry 45.1%
Sad 49.4%

AWS Rekognition

Age 27-44
Gender Male, 51.2%
Happy 45.2%
Angry 46%
Calm 49.1%
Sad 48.7%
Surprised 45.1%
Confused 45.3%
Disgusted 45.5%

AWS Rekognition

Age 35-52
Gender Female, 54.5%
Happy 53.1%
Sad 46.1%
Disgusted 45.1%
Calm 45.2%
Surprised 45.1%
Confused 45.2%
Angry 45.1%

AWS Rekognition

Age 26-43
Gender Female, 50.9%
Sad 48.5%
Happy 45.2%
Surprised 45.1%
Disgusted 45.2%
Confused 45.2%
Calm 50.2%
Angry 45.7%

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 41
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 38
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 44
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Poster 99.8%
Person 98.7%

Categories

Imagga

paintings art 93.8%
pets animals 5.8%

Captions

Microsoft
created on 2019-06-05

a group of people around each other 38.7%
a group of people in a room 38.6%
an old photo of a person 38.5%

Text analysis

Amazon

wearing
resses
ore
Little
Little Dressmakers.
the
Dressmakers.
girls
they
nade
in
they nade class.
Many of the girls ore in wearing resses
class.
Many
of

Google

Little Dressmakers. Mony of the girls are wearing dresses they made in closs.
Little
Dressmakers.
Mony
of
the
girls
are
wearing
dresses
they
made
in
closs.