Human Generated Data

Title

Untitled (parade of an English regiment)

Date

c. 1914-1918

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Richard E. Bennink, 2.2002.4121

Human Generated Data

Title

Untitled (parade of an English regiment)

People

Artist: Unidentified Artist,

Date

c. 1914-1918

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-12

Military 99.7
Military Uniform 99.6
Person 99.5
Human 99.5
Person 99.4
Person 99.3
Person 99.3
Person 99.1
Person 99
Person 98.8
Person 98.7
Army 98.5
Armored 98.5
People 98.3
Troop 98.3
Person 97.9
Person 93.3
Soldier 92.1
Crowd 88.8
Person 88.1
Person 85.3
Person 84
Person 81.5
Person 79.9
Officer 78.9
Person 77
Person 73.2
Marching 71.8
Person 66.9
Apparel 61
Clothing 61

Imagga
created on 2022-03-12

column 44.2
architecture 41.2
building 30.3
old 26.5
door 26.1
city 24.1
ancient 22.5
stone 22.1
tourism 21.5
wall 20.8
window 20.6
structure 20.4
art 18.4
house 16.7
shop 16.5
antique 16.4
barbershop 16.1
vintage 15.7
arch 15.6
history 15.2
travel 14.1
monument 14
church 13.9
historic 13.8
religion 13.4
street 12.9
palace 12.5
mercantile establishment 12.4
urban 12.2
historical 12.2
home 12
culture 12
entrance 11.6
place 11.2
brick 11.1
landmark 10.8
retro 10.7
interior 10.6
architectural 10.6
construction 10.3
famous 10.2
grunge 10.2
exterior 10.1
decoration 10
texture 9.7
statue 9.4
town 9.3
facade 9.2
frame 9.2
sculpture 9
marble 9
pattern 8.9
prison 8.8
buildings 8.5
design 8.4
destination 8.4
tourist 8.4
place of business 8.3
aged 8.1
columns 7.8
empty 7.7
outside 7.7
balcony 7.7
support 7.7
damaged 7.6
gate 7.5
style 7.4
color 7.2
dirty 7.2
wooden 7

Google
created on 2022-03-12

Microsoft
created on 2022-03-12

clothing 97
outdoor 96.1
man 92.5
text 92
group 90.7
person 89
old 85.4
posing 83.2
people 64.9
dressed 34.3
step 29.4
clothes 17.1

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 100%
Calm 68.6%
Confused 23.1%
Sad 3.7%
Angry 2.6%
Surprised 0.8%
Happy 0.5%
Disgusted 0.4%
Fear 0.4%

AWS Rekognition

Age 26-36
Gender Male, 91.5%
Angry 50.1%
Sad 17.7%
Calm 15.2%
Surprised 6.4%
Disgusted 3.7%
Fear 3.2%
Confused 2.4%
Happy 1.3%

AWS Rekognition

Age 6-14
Gender Female, 99.3%
Angry 33.2%
Calm 32.3%
Sad 29%
Disgusted 1.7%
Fear 1.5%
Confused 0.9%
Happy 0.7%
Surprised 0.6%

AWS Rekognition

Age 16-22
Gender Male, 96.6%
Sad 73.9%
Angry 21.8%
Fear 1.6%
Disgusted 0.8%
Calm 0.7%
Surprised 0.6%
Confused 0.3%
Happy 0.2%

AWS Rekognition

Age 7-17
Gender Male, 66.5%
Angry 93%
Sad 5%
Calm 0.6%
Surprised 0.4%
Disgusted 0.3%
Fear 0.3%
Confused 0.2%
Happy 0.2%

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Calm 43.9%
Confused 40.9%
Sad 8.5%
Angry 3%
Surprised 1.6%
Disgusted 1.1%
Fear 0.5%
Happy 0.5%

AWS Rekognition

Age 24-34
Gender Male, 99.8%
Calm 86.1%
Confused 8.4%
Angry 2.5%
Sad 1.1%
Disgusted 0.9%
Surprised 0.5%
Fear 0.3%
Happy 0.2%

AWS Rekognition

Age 6-14
Gender Female, 77.9%
Calm 80%
Angry 10%
Sad 8.2%
Disgusted 0.5%
Fear 0.4%
Happy 0.4%
Confused 0.3%
Surprised 0.3%

AWS Rekognition

Age 29-39
Gender Female, 70.3%
Sad 59.1%
Confused 11.3%
Calm 8.9%
Angry 8.4%
Fear 6.6%
Disgusted 2.1%
Surprised 2%
Happy 1.6%

AWS Rekognition

Age 33-41
Gender Female, 52.1%
Calm 85%
Angry 11.5%
Sad 1.2%
Confused 0.7%
Surprised 0.6%
Fear 0.4%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 25-35
Gender Male, 99.9%
Calm 69.8%
Happy 15.6%
Sad 4.3%
Surprised 2.4%
Angry 2.3%
Fear 2.1%
Disgusted 2%
Confused 1.6%

AWS Rekognition

Age 29-39
Gender Male, 99.7%
Calm 77.7%
Angry 6%
Confused 5.2%
Sad 4.2%
Disgusted 2.8%
Happy 2.1%
Surprised 1%
Fear 0.9%

AWS Rekognition

Age 41-49
Gender Male, 95.1%
Calm 62.3%
Sad 12.3%
Happy 9.3%
Confused 4.8%
Surprised 3.4%
Angry 3.3%
Disgusted 2.6%
Fear 2%

AWS Rekognition

Age 23-33
Gender Female, 95.4%
Calm 32.6%
Happy 22.1%
Confused 16.8%
Fear 10.8%
Surprised 6.6%
Sad 5.8%
Disgusted 2.8%
Angry 2.5%

AWS Rekognition

Age 34-42
Gender Male, 98%
Calm 78.1%
Confused 14.9%
Sad 2.1%
Happy 1.3%
Disgusted 1.2%
Surprised 1%
Angry 1%
Fear 0.3%

AWS Rekognition

Age 25-35
Gender Male, 98%
Calm 94.1%
Angry 1.8%
Confused 1.2%
Sad 0.9%
Disgusted 0.7%
Surprised 0.6%
Fear 0.4%
Happy 0.4%

AWS Rekognition

Age 22-30
Gender Female, 96.9%
Calm 88.6%
Angry 4.5%
Confused 2.2%
Disgusted 1.4%
Fear 1.1%
Sad 1%
Surprised 0.9%
Happy 0.3%

AWS Rekognition

Age 25-35
Gender Male, 92.6%
Happy 32.8%
Calm 27.6%
Sad 22.5%
Surprised 5.3%
Angry 5%
Disgusted 3.8%
Confused 1.9%
Fear 1%

AWS Rekognition

Age 20-28
Gender Male, 98.5%
Calm 98.4%
Surprised 0.4%
Disgusted 0.3%
Happy 0.3%
Confused 0.2%
Sad 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 25-35
Gender Male, 99.9%
Calm 99.6%
Sad 0.2%
Confused 0.1%
Surprised 0%
Disgusted 0%
Happy 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 19-27
Gender Male, 93.5%
Calm 98.2%
Happy 0.8%
Angry 0.5%
Confused 0.1%
Disgusted 0.1%
Sad 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 18-26
Gender Male, 96.9%
Calm 98.2%
Confused 0.5%
Sad 0.4%
Angry 0.3%
Surprised 0.2%
Disgusted 0.2%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Male, 99.6%
Sad 67.9%
Calm 23.6%
Disgusted 4.4%
Angry 2.6%
Confused 0.6%
Fear 0.4%
Surprised 0.3%
Happy 0.3%

AWS Rekognition

Age 23-31
Gender Male, 90.3%
Calm 97.5%
Sad 0.7%
Happy 0.6%
Confused 0.5%
Disgusted 0.4%
Angry 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Male, 95.2%
Calm 99.5%
Surprised 0.2%
Disgusted 0.1%
Happy 0.1%
Confused 0.1%
Sad 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 16-22
Gender Female, 63.4%
Calm 82.9%
Sad 6.2%
Happy 5.4%
Angry 1.7%
Confused 1.2%
Disgusted 1.2%
Surprised 0.9%
Fear 0.5%

AWS Rekognition

Age 45-51
Gender Male, 99.1%
Sad 53.9%
Calm 22%
Happy 4.8%
Disgusted 4.3%
Angry 4.1%
Fear 3.8%
Surprised 3.7%
Confused 3.4%

AWS Rekognition

Age 6-16
Gender Male, 72.6%
Sad 98.2%
Disgusted 0.8%
Calm 0.3%
Happy 0.2%
Confused 0.2%
Fear 0.1%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 30-40
Gender Male, 93.4%
Sad 36.2%
Calm 22%
Angry 17.4%
Surprised 7.7%
Disgusted 5.7%
Happy 4%
Confused 3.5%
Fear 3.4%

AWS Rekognition

Age 20-28
Gender Male, 86.8%
Angry 27.6%
Sad 27.4%
Calm 24.3%
Fear 9.8%
Disgusted 4.5%
Confused 3.1%
Happy 2%
Surprised 1.3%

AWS Rekognition

Age 26-36
Gender Female, 50%
Happy 53%
Sad 21.8%
Calm 20.7%
Confused 1.2%
Angry 1.1%
Surprised 0.8%
Fear 0.7%
Disgusted 0.7%

AWS Rekognition

Age 21-29
Gender Male, 98.6%
Sad 50.3%
Calm 41.9%
Happy 2.1%
Disgusted 1.6%
Angry 1.5%
Surprised 1.1%
Confused 0.8%
Fear 0.7%

AWS Rekognition

Age 25-35
Gender Male, 98%
Sad 38.8%
Calm 29.6%
Confused 20.1%
Angry 4.2%
Disgusted 2.9%
Surprised 2%
Fear 1.2%
Happy 1.1%

AWS Rekognition

Age 24-34
Gender Female, 68.2%
Calm 97.5%
Disgusted 0.9%
Sad 0.5%
Confused 0.3%
Happy 0.3%
Angry 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 37-45
Gender Male, 58.7%
Sad 85.7%
Calm 5.1%
Happy 2.3%
Disgusted 2.2%
Angry 1.8%
Surprised 1.1%
Confused 1.1%
Fear 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people posing for a photo 96.9%
an old photo of a group of people posing for the camera 96.6%
an old photo of a group of people posing for a picture 96.5%

Text analysis

Amazon

DÉFILÉ
D'UN
S.T.L.
ANGLAIS
843.
843. DÉFILÉ D'UN RÉCT
RÉCT

Google

843. DEFILE D'UN RÉGI ANCLAIS S.T.L.
ANCLAIS
DEFILE
D'UN
RÉGI
S.T.L.
843.