Human Generated Data

Title

James Mongin Smith and Nurse
Date

19th century
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2020.53

Human Generated Data

Title

James Mongin Smith and Nurse

People

Artist: Unidentified Artist,

Date

19th century

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-05-03

Furniture 99.9
Painting 99.7
Art 99.7
Person 96.6
Human 96.6
Apparel 96.2
Clothing 96.2
Person 95.8
Bonnet 81.3
Hat 81.3
Cradle 76.7
Portrait 63.8
Photography 63.8
Face 63.8
Photo 63.8
Bed 55.3
Newborn 55.1
Baby 55.1

Imagga
created on 2022-05-03

frame 58.4
old 44.6
vintage 40.5
antique 40.5
retro 36.8
art 36.1
gold 32.9
tray 32.4
blank 28.7
design 28.7
ancient 28.5
empty 28.3
decoration 27.5
receptacle 26.2
furniture 25.3
decorative 24.2
border 23.5
golden 23.2
ornate 22.9
baby bed 22.6
container 20.8
aged 20.8
museum 20.5
grunge 20.4
ornament 19.8
wood 19.2
carved 17.6
wooden 17.6
stamp 17.4
texture 17.4
painting 17.2
furnishing 17.1
wall 16.6
framework 16.3
style 15.6
object 15.4
mail 15.3
pattern 15
interior 15
postage 14.7
deco 14.7
letter 14.7
paintings 14.7
culture 14.5
rustic 14.4
photograph 14
bassinet 13.9
postmark 13.8
baroque 13.7
cradle 13.5
post 13.3
hole 13.3
ornamental 13.3
gallery 12.8
postal 12.7
square 12.7
decor 12.4
sculpture 12.1
decorate 11.4
paper 11
space 10.9
exhibition 10.8
religion 10.7
envelope 10.7
detail 10.4
home 10.4
luxury 10.3
architecture 10.1
gilded 9.9
rectangle 9.7
portrait 9.7
carving 9.7
decorated 9.6
classical 9.6
classic 9.3
wallpaper 9.2
one 9
backgrounds 8.9
framing 8.9
shows 8.9
printed 8.8
brown 8.8
framed 8.8
frames 8.8
textured 8.8
icon 8.7
old fashioned 8.6
unique 8.5
elegance 8.4
historic 8.2
stone 8.1
symbol 8.1
history 8
metal 8
mosaic 7.9
masterpiece 7.9
philately 7.9
painter 7.8
artistic 7.8
delivery 7.8
cutting 7.7
floral 7.6
card 7.6
painted 7.6
fine 7.6
rusty 7.6
religious 7.5
display 7.4
panel 7.4
global 7.3
black 7.2
collection 7.2

Google
created on 2022-05-03

Brown 98
Picture frame 96.8
Product 90.7
Rectangle 88
Art 81.8
Painting 79.4
Baby 75.3
Toddler 73.6
Illustration 68.7
Visual arts 68.6
Vintage clothing 67.7
Antique 66.4
Interior design 65.7
Stock photography 63.1
Room 53.9
Child 53.3
Wood 51.9
History 51.4

Microsoft
created on 2022-05-03

baby 98.3
human face 96.1
text 94
person 93.8
toddler 92.6
clothing 77.6
old 68.9
picture frame 22.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-3
Gender Female, 100%
Calm 84.6%
Sad 14.9%
Surprised 6.3%
Fear 5.9%
Confused 0.2%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 2
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.7%
Person 96.6%

Captions

Microsoft

an old photo of a box 58.8%
an old photo of a person 56.4%

Text analysis

Google

ン
ン