Human Generated Data

Title

Colonel Elmer Ephraim Ellsworth (1837-1861)
Date

1861
People

Artist: Mathew B. Brady & Studio, American active 1844 - 1895
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Special Collections, Fine Arts Library, Harvard College Library, Bequest of Evert Jansen Wendell, 2010.47

Human Generated Data

Title

Colonel Elmer Ephraim Ellsworth (1837-1861)

People

Artist: Mathew B. Brady & Studio, American active 1844 - 1895

Date

1861

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Person 98
Human 98
Military Uniform 96.9
Military 96.9
Officer 95.3
Soldier 55.4

Clarifai
created on 2018-04-19

people 99.9
one 99.4
portrait 99.1
adult 99.1
wear 99.1
outfit 96
military 94.6
military uniform 94.1
administration 93.7
uniform 92.7
woman 91.5
music 90.2
leader 88.8
lid 85.6
man 84.3
retro 80.6
actor 80.2
soldier 77.8
child 71.2
art 70.4

Imagga
created on 2018-04-19

man 25.5
person 21.6
people 19.5
black 18.4
guitar 17.3
male 17.1
musical instrument 16.7
adult 16.2
wind instrument 16.2
singer 16
musician 14.6
portrait 14.2
sport 14.1
music 13.6
microphone 13.5
dark 13.4
silhouette 13.2
one 12.7
attractive 12.6
device 12.2
performer 11.7
model 11.7
posing 11.5
brass 11.4
studio 11.4
fashion 11.3
rock 11.3
sexy 11.2
body 11.2
style 10.4
sunset 9.9
weapon 9.6
crutch 9.3
oboe 9.2
instrument 9.1
protection 9.1
stick 9.1
pose 9.1
human 9
looking 8.8
boy 8.7
player 8.7
world 8.6
musical 8.6
performance 8.6
walking 8.5
holding 8.3
danger 8.2
lady 8.1
hair 7.9
concert 7.8
pretty 7.7
guy 7.7
helmet 7.6
hand 7.6
sword 7.6
pleasure 7.5
mask 7.5
happy 7.5
equipment 7.5
outdoors 7.5
alone 7.3
industrial 7.3
child 7.2
building 7.1
clothing 7.1

Google
created on 2018-04-19

photograph 95
standing 93.2
vintage clothing 76.6
military officer 67.1
military person 62.2
soldier 61.9
gentleman 59.4
human behavior 50.9

Microsoft
created on 2018-04-19

standing 91.3
outdoor 89.9
person 86.3
black 83.3
old 56.9
posing 46.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Male, 94.9%
Angry 9%
Happy 2.4%
Surprised 3.6%
Sad 5.6%
Disgusted 2.6%
Confused 5.6%
Calm 71.1%

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98%

Captions

Microsoft

a black and white photo of a person 83.3%
a person standing posing for the camera 83.2%
an old black and white photo of a person 80.3%