Human Generated Data

Title

Untitled (Julius Goldman as a boy)
Date

1860s
People

Artist: Jones & Bro., American active 1860s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2691

Human Generated Data

Title

Untitled (Julius Goldman as a boy)

People

Artist: Jones & Bro., American active 1860s

Date

1860s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Furniture 99.8
Person 97.1
Human 97.1
Stick 79.3
Cane 70.8
Throne 65.5
Clothing 60.8
Overcoat 60.8
Apparel 60.8
Suit 60.8
Coat 60.8
Chair 56

Imagga
created on 2021-12-14

crutch 52.3
staff 38.9
stick 32.2
person 31.9
fashion 27.9
portrait 23.3
people 22.3
attractive 19.6
black 19.5
adult 18.8
man 18.8
sexy 18.5
hair 18.2
pretty 18.2
one 17.9
clothes 17.8
model 17.1
style 16.3
happy 16.3
male 16.1
smile 15.7
cleaner 15.4
posing 15.1
standing 13.9
urban 13.1
cute 12.9
dress 12.6
lady 12.2
dark 11.7
make 10.9
smiling 10.9
lifestyle 10.8
city 10.8
face 10.7
child 10.6
human 10.5
body 10.4
happiness 10.2
stylish 9.9
outdoor 9.9
cheerful 9.8
cleaning implement 9.5
walking 9.5
clothing 9.5
wall 9.4
swab 9.4
blond 9.2
studio 9.1
pose 9.1
old 9.1
building 9
interior 8.8
looking 8.8
brunette 8.7
elegant 8.6
expression 8.5
fashionable 8.5
vintage 8.3
holding 8.3
single 8.2
sensual 8.2
hairstyle 7.6
skin 7.6
street 7.4
alone 7.3
women 7.1
work 7.1
indoors 7
suit 7

Google
created on 2021-12-14

Chair 88.1
Art 86.2
Sleeve 79.4
Tints and shades 76.3
Picture frame 74.4
Vintage clothing 74
Formal wear 69.2
Room 68.5
Visual arts 68.4
Curtain 65.9
Military person 64.6
Stock photography 63.7
Uniform 62.5
Classic 62.1
History 59.1
Painting 58.8
Non-commissioned officer 58.4
Portrait 55
Illustration 53.9
Retro style 53.7

Microsoft
created on 2021-12-14

text 98.9
clothing 97.6
wall 95.5
person 94.1
standing 85.5
man 79
posing 66.3
black 65.9
old 64.9
suit 59.4
boy 58.2
photograph 54.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 17-29
Gender Male, 52.2%
Sad 48.8%
Calm 39.5%
Confused 6.3%
Angry 2.1%
Fear 1.4%
Surprised 1.1%
Happy 0.5%
Disgusted 0.3%

Microsoft Cognitive Services

Age 14
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.1%
Suit 60.8%

Captions

Microsoft

a vintage photo of a person 91.8%
a vintage photo of a person in a suit and tie 91.7%
a vintage photo of a person wearing a suit and tie 91.6%