Human Generated Data

Title

Untitled (President William Howard Taft, Louisiana Purchase Exposition, St. Louis?)

Date

c. 1904

People

Artist: Jessie Tarbox Beals, American 1870 - 1942

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3159

Human Generated Data

Title

Untitled (President William Howard Taft, Louisiana Purchase Exposition, St. Louis?)

People

Artist: Jessie Tarbox Beals, American 1870 - 1942

Date

c. 1904

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3159

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.6
Human 99.6
Military Uniform 99.5
Military 99.5
Person 98.3
Person 97.9
Officer 97.4
Person 95.4
Person 95
Person 92.9
People 88.2
Person 84.8
Person 79.6
Army 71.4
Armored 71.4
Person 70.4
Troop 68.9
Funeral 68.6
Soldier 68.4
Captain 65.7
Guard 57.1
Person 49.8

Clarifai
created on 2023-10-27

people 99.9
many 98.1
group 97.9
leader 97.3
group together 97.3
street 96.2
man 96
wedding 93.9
adult 92.2
military 91.6
military uniform 90.9
administration 90.2
wear 90.1
woman 88.8
monochrome 88.5
several 87.2
war 86.6
soldier 86.2
chair 85.2
outfit 83.9

Imagga
created on 2022-01-23

brass 91.9
wind instrument 72.2
trombone 54.4
musical instrument 51
religion 21.5
architecture 18.7
church 17.6
statue 17.3
man 16.8
old 16.7
people 16.2
cathedral 15.3
adult 13
building 12.9
sculpture 12.4
column 12.4
monument 12.1
culture 12
dress 11.7
art 11.7
outfit 11.6
holy 11.5
tourism 11.5
gold 11.5
faith 11.5
religious 11.2
ancient 11.2
clothing 11.2
inside 11
historic 11
male 10.6
interior 10.6
cornet 10.4
historical 10.3
catholic 10.3
black 10.2
device 10.1
business 9.7
indoors 9.7
stone 9.3
travel 9.1
history 8.9
marble 8.7
couple 8.7
spirituality 8.6
golden 8.6
men 8.6
famous 8.4
city 8.3
fashion 8.3
decoration 8
women 7.9
love 7.9
arch 7.7
corporate 7.7
prayer 7.7
wall 7.7
person 7.7
music 7.7
god 7.6
traditional 7.5
tradition 7.4
tourist 7.4
professional 7.3
palace 7.3
detail 7.2
landmark 7.2
suit 7.2
baritone 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

clothing 92.7
person 88.3
text 73
man 70.1
group 67.1
old 63
suit 61.5
posing 49.3
several 10.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Female, 75.6%
Calm 88%
Confused 9.5%
Sad 0.9%
Angry 0.7%
Surprised 0.5%
Fear 0.2%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 37-45
Gender Male, 100%
Calm 89.6%
Angry 8.9%
Confused 0.7%
Sad 0.3%
Surprised 0.2%
Fear 0.1%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 49-57
Gender Male, 100%
Calm 98.2%
Confused 0.4%
Sad 0.4%
Angry 0.3%
Fear 0.2%
Surprised 0.2%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 60-70
Gender Female, 83.4%
Calm 96%
Confused 0.8%
Angry 0.8%
Surprised 0.8%
Fear 0.8%
Happy 0.4%
Sad 0.3%
Disgusted 0.2%

AWS Rekognition

Age 27-37
Gender Male, 92.5%
Calm 91.1%
Confused 7.5%
Sad 0.5%
Angry 0.3%
Disgusted 0.2%
Surprised 0.2%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 37-45
Gender Female, 84.7%
Calm 76.4%
Confused 16.8%
Angry 3.2%
Sad 2.1%
Surprised 0.7%
Fear 0.3%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 41-49
Gender Male, 99.1%
Calm 96.7%
Angry 1.5%
Sad 0.9%
Happy 0.3%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 26-36
Gender Male, 97.2%
Calm 44.7%
Confused 36.5%
Angry 12.9%
Sad 1.6%
Surprised 1.6%
Disgusted 1.4%
Happy 0.8%
Fear 0.5%

AWS Rekognition

Age 30-40
Gender Female, 95.9%
Happy 75.5%
Calm 21.2%
Surprised 1.5%
Disgusted 0.6%
Sad 0.4%
Angry 0.3%
Fear 0.3%
Confused 0.2%

AWS Rekognition

Age 23-31
Gender Male, 99.7%
Surprised 22%
Calm 20.9%
Sad 16.3%
Fear 12.7%
Angry 10.9%
Disgusted 9%
Confused 5.1%
Happy 3.2%

AWS Rekognition

Age 27-37
Gender Male, 60.5%
Calm 99.5%
Sad 0.2%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Confused 0%
Happy 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Categories

Imagga

interior objects 97.1%
paintings art 2.9%

Text analysis

Amazon

G