Human Generated Data

Title

Untitled (Group of men and youth including Negritos from the Philippine Exhibit, Louisiana Purchase Exposition, 1904 World’s Fair, St. Louis),

Date

1904

People

Artist: Jessie Tarbox Beals, American 1870 - 1942

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3160

Human Generated Data

Title

Untitled (Group of men and youth including Negritos from the Philippine Exhibit, Louisiana Purchase Exposition, 1904 World’s Fair, St. Louis),

People

Artist: Jessie Tarbox Beals, American 1870 - 1942

Date

1904

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 99.6
Person 99.6
Person 99.5
Person 99.1
Person 98.9
Person 98.2
Person 97
Person 93.2
Military Uniform 92.7
Military 92.7
People 87.8
Overcoat 78.9
Clothing 78.9
Suit 78.9
Apparel 78.9
Coat 78.9
Officer 78.1
Soldier 75.4
Army 73.5
Armored 73.5
Outdoors 73.2
Brass Section 68.1
Musical Instrument 68.1
Horn 65.2

Imagga
created on 2022-01-08

brass 92.1
wind instrument 70.5
musical instrument 48
cornet 39.1
trombone 30.7
uniform 30.3
man 26.2
helmet 26.1
military uniform 24.6
people 22.8
clothing 21.8
male 20.5
military 19.3
person 17.7
gun 17.2
soldier 16.6
war 15.4
weapon 14.9
rifle 14.8
danger 14.5
armor plate 14.1
outdoor 13
adult 12.9
protection 12.7
old 11.8
army 11.7
sport 11.5
mask 11.5
outdoors 10.4
black 10.2
consumer goods 10.1
boy 9.6
industrial 9.1
destruction 8.8
toxic 8.8
protective 8.8
nuclear 8.7
men 8.6
statue 8.6
walking 8.5
bugle 8.5
field 8.4
summer 8.3
dark 8.3
leisure 8.3
plate 8.1
family 8
radioactive 7.8
radiation 7.8
travel 7.7
death 7.7
chemical 7.7
gas 7.7
sky 7.6
two 7.6
silhouette 7.4
vacation 7.4
recreation 7.2
history 7.1
happiness 7
together 7

Google
created on 2022-01-08

Trousers 96.2
Coat 86.6
Suit 77.1
Crew 75.4
Hat 74.3
Vintage clothing 74.3
Uniform 73.6
Collar 72.4
Classic 68.2
Team 66
History 65.3
House 63.8
Stock photography 63.6
Military uniform 58.3
Window 58.1
Military person 56.8
Door 56.4
Building 55.3
Chair 55.1
Retro style 50.8

Microsoft
created on 2022-01-08

building 99.6
outdoor 99.5
ground 98.5
person 98.4
clothing 96.1
posing 91.9
man 90.4
group 89.2
standing 85.6
old 54.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Male, 100%
Sad 98.2%
Fear 0.8%
Angry 0.3%
Confused 0.2%
Calm 0.2%
Disgusted 0.1%
Happy 0.1%
Surprised 0.1%

AWS Rekognition

Age 45-53
Gender Male, 77.8%
Calm 88.8%
Confused 3.7%
Sad 3.6%
Angry 2.3%
Disgusted 0.5%
Surprised 0.4%
Happy 0.4%
Fear 0.3%

AWS Rekognition

Age 23-33
Gender Male, 99.8%
Sad 56.7%
Calm 24.3%
Confused 13.8%
Angry 2.3%
Happy 1%
Disgusted 0.9%
Fear 0.6%
Surprised 0.4%

AWS Rekognition

Age 35-43
Gender Male, 99.6%
Calm 93.8%
Angry 2.4%
Sad 1.7%
Confused 1.4%
Fear 0.2%
Happy 0.2%
Surprised 0.2%
Disgusted 0.1%

AWS Rekognition

Age 31-41
Gender Male, 99.4%
Calm 81.9%
Angry 5%
Happy 4.7%
Sad 3.9%
Confused 2.4%
Disgusted 1.2%
Fear 0.6%
Surprised 0.4%

AWS Rekognition

Age 24-34
Gender Male, 96.4%
Calm 67.8%
Happy 31.3%
Confused 0.3%
Fear 0.2%
Sad 0.1%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 27-37
Gender Male, 86.3%
Calm 86.9%
Angry 7.1%
Sad 2.8%
Confused 1.4%
Surprised 0.7%
Disgusted 0.5%
Happy 0.4%
Fear 0.3%

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 11
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Suit 78.9%

Captions

Microsoft

Ota Benga et al. posing for a photo 98.5%
Ota Benga et al. posing for a photo in front of a building 98.2%
Ota Benga et al. posing for a picture 98.1%

Text analysis

Amazon

-
...

Google

LE
LE IA
IA