Human Generated Data

Title

General William Tecumseh Sherman (1820-1891) and six of his seven generals (Oliver Otis Howard, John A. Logan, William B. Hazen, Jefferson C. Davis, Henry Warner Slocum, and Joseph A. Mower)
Date

1865
People

Artist: Mathew B. Brady & Studio, American active 1844 - 1895
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Special Collections, Fine Arts Library, Harvard College Library, Bequest of Evert Jansen Wendell, 2010.50

Human Generated Data

Title

General William Tecumseh Sherman (1820-1891) and six of his seven generals (Oliver Otis Howard, John A. Logan, William B. Hazen, Jefferson C. Davis, Henry Warner Slocum, and Joseph A. Mower)

People

Artist: Mathew B. Brady & Studio, American active 1844 - 1895

Date

1865

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.7
Human 99.7
Person 99.7
Person 99.6
Person 99.5
Person 99.2
Officer 98.8
Military Uniform 98.8
Military 98.8
Person 96.3
Person 94.1
Chair 93.8
Furniture 93.8
Shoe 90.2
Footwear 90.2
Clothing 90.2
Apparel 90.2
Soldier 83.2
Army 76.8
Armored 76.8
Captain 72.9
Shoe 68.2
Person 58.9
Coat 58.1
Shoe 57.8

Imagga
created on 2022-01-09

brass 77
wind instrument 61.3
musical instrument 42.5
cornet 40.9
silhouette 25.6
man 24.8
male 24.8
people 22.8
person 22.4
adult 18.5
player 17.1
sunset 17
athlete 17
ballplayer 16
kin 15.6
men 15.4
group 15.3
black 15.1
trombone 14.5
helmet 13.3
world 12.7
sport 11.5
women 11.1
contestant 10.7
businessman 10.6
boy 10.4
clothing 10.4
business 10.3
dark 10
fashion 9.8
human 9.7
sexy 9.6
couple 9.6
sky 9.6
girls 9.1
portrait 9
dress 9
style 8.9
love 8.7
party 8.6
summer 8.3
pose 8.1
team 8.1
model 7.8
attractive 7.7
outdoor 7.6
studio 7.6
beach 7.6
professional 7.6
power 7.5
guy 7.5
friendship 7.5
evening 7.5
back 7.3
freedom 7.3
success 7.2
family 7.1
to 7.1
happiness 7
travel 7

Google
created on 2022-01-09

Trousers 96.1
Photograph 94.1
Peaked cap 94
Furniture 93.8
Military uniform 91.4
Military person 90.1
Non-commissioned officer 84.3
Military officer 81.4
Hat 81.1
Soldier 75.7
Vintage clothing 74.4
Snapshot 74.3
Chair 74.2
Official 74.1
Event 72.4
Crew 72.4
Military organization 70.7
Military rank 69.3
Uniform 69.1
Classic 68

Microsoft
created on 2022-01-09

wall 99.1
musical instrument 98.6
person 94.4
concert 91.6
standing 91.6
text 91.3
posing 88.2
clothing 87.2
man 81.6
music 80.2
group 79.8
saxophone 76.6
people 67.9
accordion 65.6
guitar 54.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 97.4%
Sad 1.6%
Confused 0.5%
Angry 0.2%
Happy 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 41-49
Gender Male, 99.9%
Confused 41.7%
Calm 29.5%
Angry 21.8%
Sad 5.1%
Disgusted 0.6%
Fear 0.6%
Surprised 0.4%
Happy 0.2%

AWS Rekognition

Age 29-39
Gender Male, 99.8%
Calm 99.4%
Confused 0.3%
Fear 0.1%
Sad 0.1%
Disgusted 0%
Happy 0%
Surprised 0%
Angry 0%

AWS Rekognition

Age 39-47
Gender Male, 97.9%
Calm 92.9%
Confused 2.9%
Happy 1.6%
Sad 0.8%
Angry 0.7%
Surprised 0.5%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 37-45
Gender Male, 100%
Calm 86%
Confused 11%
Disgusted 1.6%
Angry 0.5%
Sad 0.4%
Fear 0.3%
Surprised 0.1%
Happy 0.1%

AWS Rekognition

Age 45-51
Gender Male, 99.7%
Calm 94.4%
Sad 4%
Confused 0.5%
Disgusted 0.4%
Angry 0.3%
Fear 0.2%
Happy 0.1%
Surprised 0.1%

AWS Rekognition

Age 39-47
Gender Male, 100%
Angry 87.4%
Confused 7.9%
Calm 1.7%
Sad 1.3%
Disgusted 0.9%
Fear 0.4%
Surprised 0.3%
Happy 0.1%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Chair 93.8%
Shoe 90.2%

Captions

Microsoft

Oliver O. Howard, Henry Slocum, Joseph A. Mower posing for a photo 97.6%
Oliver O. Howard, Henry Slocum, Joseph A. Mower posing for the camera 97.5%
Oliver O. Howard, Henry Slocum, Joseph A. Mower posing for a picture 97.4%