Human Generated Data

Title

John Collins Warren (1778-1856)

Date

c. 1850-1856

People

Artist: Southworth & Hawes, American active 1843-1863

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Loan from the Massachusetts General Hospital Archives and Special Collections, 9.1979

Human Generated Data

Title

John Collins Warren (1778-1856)

People

Artist: Southworth & Hawes, American active 1843-1863

Date

c. 1850-1856

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Painting 99
Art 99
Human 98.3
Person 98.3
Apparel 96.8
Clothing 96.8
Coat 78.6
Overcoat 78.6
Face 74.6
Portrait 71.8
Photography 71.8
Photo 71.8
Suit 64.7

Imagga
created on 2022-05-28

man 31.6
black 31.2
male 30.7
portrait 27.2
person 25.7
face 24.9
people 24.5
adult 23.9
punching bag 23.5
dark 20.9
call 20.7
expression 17.1
human 15.7
attractive 15.4
suit 15
one 14.9
model 14.8
eyes 14.6
game equipment 14.2
guy 13.4
fashion 12.8
hair 12.7
serious 12.4
look 12.3
sexy 12
equipment 12
looking 12
body 12
makeup 11.2
business 10.9
lifestyle 10.8
men 10.3
casual 10.2
studio 9.9
art 9.8
handsome 9.8
posing 9.8
device 9.8
bow tie 9.1
pretty 9.1
office 9.1
style 8.9
cool 8.9
evil 8.8
love 8.7
room 8.6
elegant 8.6
hand 8.4
alone 8.2
sensuality 8.2
fitness 8.1
lady 8.1
light 8
women 7.9
couple 7.8
wall 7.7
mystery 7.7
old 7.7
professional 7.6
head 7.6
leisure 7.5
glasses 7.4
necktie 7.4
clothing 7.3
night 7.1
jacket 7
covering 7

Google
created on 2022-05-28

Microsoft
created on 2022-05-28

text 97.9
human face 97.8
person 96.2
man 90.5
clothing 90.4
old 89
painting 84.2
drawing 82.1
black 80.3
portrait 73.3
smile 66.5
sketch 57.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 72-82
Gender Male, 99.1%
Sad 91%
Calm 54.4%
Surprised 6.3%
Fear 6%
Confused 1.9%
Happy 0.2%
Disgusted 0.2%
Angry 0.1%

Microsoft Cognitive Services

Age 60
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99%
Person 98.3%

Captions

Microsoft

a vintage photo of John Collins Warren 90.7%
a vintage photo of John Collins Warren in a suit and tie 90.6%
a vintage photo of John Collins Warren wearing a suit and tie 90.5%

Text analysis

Google

MATA