Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "North Bennet Street Industrial School": North Bennet St. Industrial School, Boston, Mass.: Modeled from life by an Italian Girl fourteen years old. Evening class in advanced modeling.
Date

c. 1903
People

Artist: Nathaniel L. Stebbins, American active late 19th and early 20th centuries
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3048

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "North Bennet Street Industrial School": North Bennet St. Industrial School, Boston, Mass.: Modeled from life by an Italian Girl fourteen years old. Evening class in advanced modeling.

People

Artist: Nathaniel L. Stebbins, American active late 19th and early 20th centuries

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3048

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 99.4
Person 99.4
Head 96.9
Person 96.6
Clothing 93.6
Apparel 93.6
Text 90.8
Face 89.3
Poster 85
Advertisement 85
Paper 72.2
Art 65.6
Hat 64.3
Portrait 61.7
Photography 61.7
Photo 61.7
Brochure 61.3
Flyer 61.3
Label 58.8
Bonnet 56.1
Word 55.3
Collage 55

Clarifai
created on 2019-06-06

people 99.1
exhibition 98.8
portrait 97.9
adult 97.5
retro 96.8
empty 96.2
no person 95.7
wear 95.6
museum 95.3
woman 94.7
one 94.7
indoors 94.1
blank 93.6
two 92.6
man 92.3
furniture 92.2
room 91.2
group 89.9
picture frame 89.3
painting 89

Imagga
created on 2019-06-06

envelope 44.5
billboard 35.9
money 25.5
signboard 25.1
business 24.3
cash 22.9
currency 22.4
bill 20.9
container 20.8
structure 20.7
finance 19.4
web site 19.2
one 18.7
dollar 18.6
banking 18.4
book 17.3
product 17.1
wealth 17.1
bank 17
financial 16.9
creation 16.8
paper 16.5
vintage 15.7
board 14.5
exchange 14.3
blackboard 14.2
savings 14
old 13.9
office 13.7
dollars 13.5
man 13.4
mail 13.4
letter 12.8
person 12.7
stamp 12.6
close 12.6
portrait 12.3
people 12.3
education 12.1
postmark 11.8
chalkboard 11.8
investment 11
black 10.8
postage 10.8
holding 10.7
banknote 10.7
sign 10.5
success 10.5
blank 10.3
culture 10.3
rich 10.2
symbol 10.1
happy 10
global 10
art 10
male 9.9
circa 9.9
shows 9.8
printed 9.8
postal 9.8
hundred 9.7
pay 9.6
communications 9.6
message 9.1
museum 9
retro 9
masterpiece 8.9
businessman 8.8
bills 8.7
us 8.7
post 8.6
smile 8.5
unique 8.5
television 8.5
note 8.3
paint 8.1
school 8.1
market 8
known 7.9
design 7.9
funds 7.8
banknotes 7.8
boy 7.8
paintings 7.8
chalk 7.8
states 7.7
cutting 7.7
class 7.7
card 7.6
fine 7.6
hand 7.6
computer 7.5
pattern 7.5
stock 7.5
economy 7.4
light 7.3
brass 7.3
smiling 7.2
looking 7.2
child 7.2
face 7.1
laptop 7

Google
created on 2019-06-06

Photograph 95.5
Picture frame 76.1
Art 70.9
Room 65.7
Photography 62.4
Stock photography 62.1
Square 51.2
Rectangle 50.5

Microsoft
created on 2019-06-06

human face 99.3
person 95.8
man 84.4
clothing 67.2
smile 60.8
envelope 29

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 51.4%
Calm 48.7%
Sad 49.1%
Angry 45.6%
Surprised 45.3%
Disgusted 45.8%
Confused 45.2%
Happy 45.4%

AWS Rekognition

Age 35-52
Gender Female, 53.6%
Calm 52.3%
Disgusted 45.2%
Surprised 45.2%
Confused 45.1%
Angry 45.2%
Sad 46.9%
Happy 45.1%

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 19
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Categories

Imagga

text visuals 79%
paintings art 16.9%
events parties 1.9%
people portraits 1.2%

Captions

Microsoft
created on 2019-06-06

a screen shot of a computer 56.5%
a close up of a screen 56.4%
a screen shot of a social media post 56.3%

Text analysis

Amazon

Industrial
North
Bennet
North Bennet St. Industrial School, Boston.Ms
School,
St.
Boston.Ms
Gry
Modeled Gry ald
Modeled
ald
G Se 27. 57-17. 4

Google

GSe 29.7-37.3 North Bennet St. Industrial School, Boston, Mass. Modeled from le by on tolion G Erenng fourteen yaars old oovanced mooeng
GSe
29.7-37.3
North
Bennet
St.
Industrial
School,
Boston,
Mass.
Modeled
from
le
by
on
tolion
G
Erenng
fourteen
yaars
old
oovanced
mooeng