Human Generated Data

Title

Untitled (Julius Goldman as a boy)

Date

1860s

People

Artist: Jones & Bro., American active 1860s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2691

Human Generated Data

Title

Untitled (Julius Goldman as a boy)

People

Artist: Jones & Bro., American active 1860s

Date

1860s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Furniture 99.8
Person 97.1
Human 97.1
Stick 79.3
Cane 70.8
Throne 65.5
Clothing 60.8
Overcoat 60.8
Apparel 60.8
Suit 60.8
Coat 60.8
Chair 56

Imagga
created on 2021-12-14

crutch 52.3
staff 38.9
stick 32.2
person 31.9
fashion 27.9
portrait 23.3
people 22.3
attractive 19.6
black 19.5
adult 18.8
man 18.8
sexy 18.5
hair 18.2
pretty 18.2
one 17.9
clothes 17.8
model 17.1
style 16.3
happy 16.3
male 16.1
smile 15.7
cleaner 15.4
posing 15.1
standing 13.9
urban 13.1
cute 12.9
dress 12.6
lady 12.2
dark 11.7
make 10.9
smiling 10.9
lifestyle 10.8
city 10.8
face 10.7
child 10.6
human 10.5
body 10.4
happiness 10.2
stylish 9.9
outdoor 9.9
cheerful 9.8
cleaning implement 9.5
walking 9.5
clothing 9.5
wall 9.4
swab 9.4
blond 9.2
studio 9.1
pose 9.1
old 9.1
building 9
interior 8.8
looking 8.8
brunette 8.7
elegant 8.6
expression 8.5
fashionable 8.5
vintage 8.3
holding 8.3
single 8.2
sensual 8.2
hairstyle 7.6
skin 7.6
street 7.4
alone 7.3
women 7.1
work 7.1
indoors 7
suit 7

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

text 98.9
clothing 97.6
wall 95.5
person 94.1
standing 85.5
man 79
posing 66.3
black 65.9
old 64.9
suit 59.4
boy 58.2
photograph 54.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 17-29
Gender Male, 52.2%
Sad 48.8%
Calm 39.5%
Confused 6.3%
Angry 2.1%
Fear 1.4%
Surprised 1.1%
Happy 0.5%
Disgusted 0.3%

Microsoft Cognitive Services

Age 14
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.1%
Suit 60.8%

Captions

Microsoft

a vintage photo of a person 91.8%
a vintage photo of a person in a suit and tie 91.7%
a vintage photo of a person wearing a suit and tie 91.6%