Human Generated Data

Title

Untitled (girl and boy, seated, three-quarter length, front view)
Date

1840s-1850s
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.54.7

Human Generated Data

Title

Untitled (girl and boy, seated, three-quarter length, front view)

People

Artist: Unidentified Artist,

Date

1840s-1850s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.54.7

Machine Generated Data

Tags

Amazon
created on 2019-11-05

Clothing 99.7
Apparel 99.7
Person 99.4
Human 99.4
Person 99.3
Art 94.8
Painting 94.8
People 69.4
Overcoat 67.1
Suit 67.1
Coat 67.1
Photography 60.2
Photo 60.2
Face 60.2
Portrait 60.2

Clarifai
created on 2019-11-05

people 100
man 98.2
adult 97.5
group 97.5
two 97.2
print 97.2
illustration 97.1
portrait 96.1
woman 94.2
art 92.7
vintage 92.1
retro 90.8
lithograph 89.8
leader 89.4
three 89.1
antique 87.7
music 86.4
monarch 84.7
engraving 84.1
wear 81.3

Imagga
created on 2019-11-05

currency 34.1
money 32.3
cash 29.3
brass 28.1
dollar 26.9
finance 25.3
memorial 23.3
one 23.1
bill 22.8
bank 21.5
financial 21.4
paper 21.2
wealth 20.6
banking 19.3
business 18.8
religion 18.8
culture 18.8
art 18.6
dollars 17.4
structure 17.1
close 16.5
vintage 16.5
savings 15.8
banknote 15.5
us 15.4
sculpture 14.7
investment 14.7
hundred 14.5
exchange 14.3
symbol 14.1
television 13.9
ancient 13.8
kin 13.5
military uniform 13.5
old 13.2
rich 13
economy 13
church 12.9
banknotes 12.7
history 12.5
profit 12.4
portrait 12.3
man 12.1
letter 11.9
icon 11.9
masterpiece 11.9
museum 11.8
postmark 11.8
envelope 11.8
postage 11.8
postal 11.8
antique 11.7
stamp 11.6
statue 11.6
loan 11.5
mail 11.5
closeup 11.4
uniform 11.3
telecommunication system 11.3
success 11.3
painter 10.9
shows 10.8
printed 10.8
gold 10.7
pay 10.5
fine 10.5
historical 10.3
religious 10.3
historic 10.1
face 9.9
known 9.9
paintings 9.8
office 9.6
finances 9.6
painted 9.5
post 9.5
unique 9.5
note 9.2
global 9.1
clothing 9
black 9
people 8.9
post mail 8.9
zigzag 8.9
fame 8.9
franklin 8.8
renaissance 8.8
funds 8.8
bookend 8.8
delivery 8.7
value 8.7
carving 8.7
cutting 8.7
artist 8.7
holy 8.7
communications 8.6
god 8.6
golden 8.6
person 8.5
device 8.2
concepts 8
circa 7.9
covering 7.9
male 7.8
bills 7.8
travel 7.7
states 7.7
saint 7.7
notes 7.7
united 7.6
temple 7.6
support 7.2
market 7.1
chest 7.1
conceptual 7
architecture 7

Google
created on 2019-11-05

Picture frame 96.4
Painting 83.7
Antique 69.8
Art 69.5
Vintage clothing 62.5
Visual arts 62.5
Gentleman 61.7
Collection 59.7
Portrait 51.6
Family 51

Microsoft
created on 2019-11-05

clothing 98.8
person 98.7
human face 95.1
text 94
old 88.1
picture frame 72.6
victorian 71.5
vintage clothing 53.7
photograph 51.5
retro style 50.9
painting 32.8
plaque 17.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-35
Gender Female, 94.2%
Calm 94.9%
Surprised 0.2%
Confused 1.1%
Sad 2.2%
Disgusted 0.1%
Angry 1.3%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 29-45
Gender Male, 97.1%
Happy 0%
Sad 3.3%
Confused 0.9%
Angry 9.1%
Surprised 0.1%
Fear 0.1%
Calm 86.3%
Disgusted 0.1%

Microsoft Cognitive Services

Age 35
Gender Female

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 94.8%

Categories

Imagga

people portraits 54.8%
paintings art 42.1%
food drinks 2.1%