Human Generated Data

Title

James Jackson [first physician to Massachusetts General Hospital, 1777-1867]
Date

c. 1850-1855
People

Artist: Southworth & Hawes, American active 1843-1863
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Loan from the Massachusetts General Hospital Archives and Special Collections, 6.1979

Human Generated Data

Title

James Jackson [first physician to Massachusetts General Hospital, 1777-1867]

People

Artist: Southworth & Hawes, American active 1843-1863

Date

c. 1850-1855

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Loan from the Massachusetts General Hospital Archives and Special Collections, 6.1979

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Face 99.1
Human 99.1
Person 95.2
Art 77.3
Man 75.1
Portrait 71.3
Photography 71.3
Photo 71.3
Jacket 58.6
Clothing 58.6
Coat 58.6
Apparel 58.6

Clarifai
created on 2023-10-30

portrait 100
people 99.7
one 99.1
art 98.2
man 96.9
adult 96.7
old 95.2
elderly 94.7
wear 92.1
leader 90.6
vintage 89.5
painting 86.5
lid 83.6
music 83.1
sepia 82.6
outerwear 80.8
facial hair 80.4
writer 79.9
veil 78.6
pensive 77.8

Imagga
created on 2022-05-28

man 42.5
portrait 39.5
person 39.4
male 36.9
senior 32.8
old 32.1
face 29.9
adult 29.1
people 25.7
mature 25.1
looking 22.4
one 21.7
statue 20.3
elderly 20.1
black 19.4
serious 19.1
human 18
expression 17.9
head 16.8
older 16.5
grandfather 16.4
hair 15.9
glasses 15.8
handsome 15.2
businessman 15
close 14.9
retired 14.6
sculpture 13.4
age 13.4
executive 13
men 12.9
depression 12.7
performer 12.5
retirement 12.5
aged 11.8
comedian 11.7
eye 11.6
aging 11.5
closeup 11.5
eyes 11.2
happy 10.7
look 10.5
business 10.3
casual 10.2
beard 10.1
suit 10
studio 9.9
sad 9.7
professional 9.4
entertainer 9.3
hand 9.2
crazy 9.2
gray 9
wrinkle 8.9
worried 8.8
lifestyle 8.7
work 8.6
smile 8.6
bust 8.5
manager 8.4
currency 8.1
success 8.1
grandmother 7.8
art 7.8
sadness 7.8
ancient 7.8
money 7.7
boss 7.7
stone 7.6
mustache 7.6
dark 7.5
emotion 7.4
cash 7.3
alone 7.3
confident 7.3
pensioner 7.2
smiling 7.2
life 7.2
bow tie 7.2
world 7
model 7

Google
created on 2022-05-28

Sleeve 87.2
Collar 83.3
Rectangle 79.4
Wrinkle 74.3
Vintage clothing 69.2
Stock photography 65.4
History 63.9
Art 63.6
Self-portrait 58.4
Portrait 58.1
Facial hair 55.7
Picture frame 54.5
Moustache 54.1
Portrait photography 53.5
Sitting 53.4
Visual arts 50.1

Microsoft
created on 2022-05-28

person 99.6
human face 98.8
text 98.6
man 97.7
wall 96.8
portrait 91.4
clothing 88.6
indoor 85.9
old 48.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 64-74
Gender Male, 100%
Calm 76%
Sad 29.7%
Surprised 6.6%
Fear 6.1%
Confused 1.1%
Angry 0.6%
Happy 0.2%
Disgusted 0.2%

Microsoft Cognitive Services

Age 63
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.2%
Jacket 58.6%

Categories

Imagga

pets animals 90.8%
paintings art 5.7%
people portraits 2%