Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. Hale House: Hale House, Boston, Mass.: In the Country.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.413.3

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. Hale House: Hale House, Boston, Mass.: In the Country.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.413.3

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 99.7
Human 99.7
Person 99.6
Person 99
Person 97.2
Person 88.7
Art 75.3
Leisure Activities 62.2
Duel 59.8
Advertisement 58.2
Poster 58.2
Painting 58
Musical Instrument 55
Banjo 55

Clarifai
created on 2019-06-05

people 99.9
art 99.2
group 98.1
portrait 98
painting 98
nostalgia 97.6
adult 97.3
man 97.2
woman 97.1
illustration 97.1
child 96.3
print 95.2
album 95
vintage 94.8
retro 94.5
picture frame 94.5
wear 93.8
antique 93.8
old 93.5
snapshot 93

Imagga
created on 2019-06-05

book jacket 49.6
envelope 39
jacket 38.6
vintage 29.8
wrapping 29.3
old 25.8
stamp 22.3
mail 22
covering 21.1
postmark 19.7
retro 19.7
letter 19.3
paper 18.8
container 18.6
printed 17.7
postage 17.7
currency 17.1
grunge 17
money 17
circa 16.8
billboard 16.5
product 16.3
art 15.9
business 15.8
newspaper 15.4
aged 15.4
black 15
shows 14.8
creation 14.8
postal 14.7
cash 13.7
global 13.7
signboard 13.5
symbol 13.5
ancient 13
frame 12.9
message 12.8
card 12.8
painted 12.4
post 12.4
bill 12.4
banking 12
close 11.4
office 11.2
one 11.2
savings 11.2
culture 11.1
finance 11
philately 10.9
bank 10.8
financial 10.7
antique 10.4
photograph 10.3
note 10.1
man 10.1
structure 9.9
paintings 9.8
cutting 9.7
communications 9.6
unique 9.5
people 9.5
dollar 9.3
portrait 9.1
paint 9.1
child 9
painter 8.9
post mail 8.9
zigzag 8.9
masterpiece 8.9
fame 8.9
known 8.9
stamps 8.9
renaissance 8.8
delivery 8.7
museum 8.7
icon 8.7
dollars 8.7
fine 8.6
blank 8.6
wall 8.6
texture 8.3
wealth 8.1
design 7.9
book 7.9
face 7.8
banknote 7.8
letters 7.7
film 7.5
world 7.5
investment 7.3
success 7.2
person 7.1
drawing 7.1

Google
created on 2019-06-05

Photograph 95.9
Snapshot 82
Art 65.5
Picture frame 60.3
Stock photography 59.4
History 57.6
Illustration 54.5
Family 54.3

Microsoft
created on 2019-06-05

gallery 98.7
clothing 98
person 97.9
text 96.1
room 96
man 91.1
photograph 84.5
scene 78.7
picture frame 69.8
tree 60.4
smile 53.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 11-18
Gender Female, 53.9%
Happy 54.4%
Surprised 45%
Confused 45%
Disgusted 45.1%
Calm 45.1%
Angry 45%
Sad 45.3%

AWS Rekognition

Age 10-15
Gender Female, 54.9%
Calm 45.5%
Disgusted 45.1%
Surprised 45.2%
Confused 45.1%
Angry 45.2%
Sad 53.7%
Happy 45.2%

AWS Rekognition

Age 20-38
Gender Female, 53.9%
Disgusted 45%
Confused 45.1%
Happy 46.4%
Sad 53.3%
Surprised 45.1%
Calm 45%
Angry 45%

AWS Rekognition

Age 20-38
Gender Female, 52%
Sad 47.2%
Happy 45.5%
Surprised 45.5%
Disgusted 45.8%
Confused 45.5%
Calm 47.7%
Angry 47.8%

Microsoft Cognitive Services

Age 52
Gender Male

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 25
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Poster 58.2%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2019-06-05

a vintage photo of a boy 38.3%
a vintage photo of some text 38.2%
a vintage photo of a person 38.1%