Human Generated Data

Title

James Mongin Smith and Nurse
Date

19th century
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2020.53

Human Generated Data

Title

James Mongin Smith and Nurse

People

Artist: Unidentified Artist,

Date

19th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2020.53

Machine Generated Data

Tags

Amazon
created on 2023-07-18

Clothing 100
Hat 100
Face 99.7
Photography 99.7
Portrait 99.7
Head 99.7
Adult 97.8
Male 97.8
Person 97.8
Man 97.8
Bonnet 79.8
Art 79.4
Painting 79.4
Furniture 57.9
Accessories 57.3
Jewelry 57.3
Earring 57.3

Clarifai
created on 2023-10-13

painting 99.4
art 99.3
picture frame 98.3
people 97.4
illustration 95.8
wear 94.7
retro 94.2
baby 94
old 92.6
margin 91.7
veil 91.4
decoration 91.2
son 90.4
museum 89.8
ornate 89.4
two 89.2
woman 88.4
portrait 87.1
one 86.6
religion 85.8

Imagga
created on 2023-07-18

tray 100
receptacle 100
container 75.1
vintage 52.1
frame 49.6
old 49.5
retro 42.6
antique 33.7
art 31
ancient 27.7
gold 26.3
stamp 26.1
blank 25.7
grunge 24.7
border 23.5
empty 23.2
decoration 23.2
mail 23
aged 22.6
design 22
postmark 21.7
postage 21.6
ornate 21.1
wall 19.8
golden 19.8
postal 19.6
letter 19.3
decorative 19.2
post 19.1
texture 18.8
museum 17.7
painting 16.3
wood 15.9
ornament 15.5
paintings 14.7
object 14.7
icon 14.3
ornamental 14.2
paper 14.1
style 14.1
wooden 14.1
shows 13.8
printed 13.8
envelope 13.6
rustic 13.4
interior 13.3
framework 13
chalkboard 12.7
deco 12.7
carved 12.7
symbol 12.1
black 12
culture 12
philately 11.9
baroque 11.7
brown 11
portrait 11
collection 10.8
gallery 10.8
frames 10.8
delivery 10.7
decorate 10.5
board 10.4
pattern 10.3
floral 10.2
card 10.2
elegance 10.1
gilded 9.9
stamps 9.9
history 9.8
one 9.7
decorated 9.6
painted 9.5
fine 9.5
unique 9.5
global 9.1
square 9.1
post mail 8.9
masterpiece 8.9
zigzag 8.9
circa 8.9
known 8.9
metal 8.9
office 8.8
exhibition 8.8
painter 8.8
rectangle 8.8
textured 8.8
cutting 8.7
photograph 8.7
communications 8.6
rusty 8.6
old fashioned 8.6
finance 8.5
classic 8.4
message 8.2
religion 8.1
home 8
philatelic 7.9
fame 7.9
renaissance 7.9
space 7.8
letters 7.7
obsolete 7.7
concrete 7.7
classical 7.6
page 7.4
business 7.3
dirty 7.2
carving 7.1
decor 7.1
prayer rug 7

Google
created on 2023-07-18

Picture frame 93.8
Rectangle 86.6
Baby 81.4
Art 79.9
Toddler 72.6
Vintage clothing 67.2
Painting 64.7
Stock photography 62.3
Visual arts 60.7
Interior design 60.6
Child 57.9
Antique 55.2
Circle 51.3
Collectable 50.2
Illustration 50.1

Microsoft
created on 2023-07-18

human face 98.4
baby 96.5
person 94.6
indoor 93.6
picture frame 93.2
toddler 83.1
clothing 77.5
drawing 60.8
gallery 52.2
old 47.9
painting 16

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-37
Gender Female, 54.6%
Calm 98.9%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Angry 0.1%
Happy 0.1%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 0-3
Gender Female, 100%
Sad 100%
Calm 15.9%
Surprised 6.3%
Fear 5.9%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 3
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 97.8%
Male 97.8%
Person 97.8%
Man 97.8%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2023-07-18

an old photo of a boy 33.7%
an old photo of a person 33.6%
an old photo of a person 33.5%

Text analysis

Google

COUNCEUNGHYNGEMAGUKAGUMINGOUSTOU
akkan kak takuta COUNCEUNGHYNGEMAGUKAGUMINGOUSTOU
akkan
kak
takuta