Human Generated Data

Title

John Collins Warren (1778-1856)
Date

c. 1855
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Loan from the Massachusetts General Hospital Archives and Special Collections, 125.1979

Human Generated Data

Title

John Collins Warren (1778-1856)

People

Artist: Unidentified Artist,

Date

c. 1855

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-01

Art 96.3
Painting 96.3
Human 95
Person 95
Clothing 76.3
Apparel 76.3
Face 69.7
Photo 69.3
Portrait 69.3
Photography 69.3
Mirror 60
Overcoat 58.3
Coat 58.3
Suit 58.3
Window 58.1
Text 55.6

Clarifai
created on 2018-04-18

people 99.9
one 99.8
portrait 98.8
adult 98.8
art 96.7
painting 96.4
wear 95.7
side view 94.4
indoors 94.1
man 94.1
oval 89.3
porthole 87.4
veil 86.9
no person 86.2
two 86
music 85.8
ellipse 84.9
museum 84.8
furniture 84.3
container 84.2

Imagga
created on 2018-04-18

toilet seat 65.9
seat 53.1
furniture 39
furnishing 26.3
speaker 17.3
music 17.1
sound 16.8
black 16.8
man 16.8
shield 16.3
male 15.6
bass 14.2
equipment 14.1
adult 13.6
audio 13.4
armor 13.2
neck brace 13.1
stereo 12.9
face 12.8
person 12
loud 11.7
portrait 11.6
modern 11.2
attractive 11.2
entertainment 11
close 10.8
people 10.6
brace 10.5
system 10.5
one 10.4
protective covering 10.2
power 10.1
fitness 9.9
volume 9.7
electronics 9.5
men 9.4
closeup 9.4
circle 9.4
dollar 9.3
handsome 8.9
woofer 8.9
treble 8.9
look 8.7
support 8.6
guy 8.4
hand 8.3
car 8.3
loudspeaker 8.2
technology 8.2
looking 8
strengthener 7.9
model 7.8
paper 7.6
astronaut 7.6
finance 7.6
sport 7.5
dark 7.5
covering 7.5
cash 7.3
digital 7.3
business 7.3
exercise 7.3
metal 7.2
device 7.2
currency 7.2
home 7.2

Google
created on 2018-04-18

photograph 95.7
portrait 92.9
gentleman 78.2
painting 72.9
picture frame 65.2
vintage clothing 61.1
history 55.1

Microsoft
created on 2018-04-18

old 73.4
black 72.1
round 35.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Male, 96.3%
Sad 1.5%
Surprised 1.7%
Angry 2.2%
Calm 89%
Happy 2%
Disgusted 2.6%
Confused 1.1%

Microsoft Cognitive Services

Age 66
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 96.3%
Person 95%

Captions

Microsoft

a close up of a man making a face for the camera 78.4%
a close up of the face of a man 78.3%
a close up of a man 78.2%