Human Generated Data

Title

Untitled (high school marching band on steps of Adams Gym)

Date

1947

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11209

Human Generated Data

Title

Untitled (high school marching band on steps of Adams Gym)

People

Artist: Harry Annas, American 1897 - 1980

Date

1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11209

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.7
Human 99.7
Person 99.6
Musician 99.3
Musical Instrument 99.3
Person 99.3
Person 99.2
Person 99
Music Band 98.8
Person 97.4
Person 97.2
Person 95.8
Person 87.8
Person 87.7
Person 85.4
Person 80.9
Leisure Activities 78.3
Brass Section 69.3
Horn 63.6
Crowd 62.5

Clarifai
created on 2023-10-27

people 100
music 99.6
instrument 98.4
drum 97.8
musician 97.5
group together 97.1
many 96.9
group 96.7
adult 96.6
band 95.8
trumpeter 95.4
man 95
jazz 94.6
street 94.1
child 92.2
soldier 91.7
boy 91.5
military 90.3
woman 90.2
drummer 90.1

Imagga
created on 2022-01-23

brass 82.8
wind instrument 64.9
musical instrument 60.2
trombone 47.8
people 24
city 22.4
cornet 20.8
man 19.5
bugle 17.8
adult 16.9
percussion instrument 16.5
male 16.3
drum 15.8
person 15.1
men 14.6
crowd 14.4
urban 14
group 13.7
architecture 13.3
street 12.9
business 12.7
old 11.8
travel 11.3
war 10.6
building 10.4
uniform 10.3
military 9.6
silhouette 9.1
world 9
businessman 8.8
tourist 8.1
to 8
music 7.9
women 7.9
clothing 7.8
life 7.8
army 7.8
statue 7.6
walking 7.6
device 7.5
tourism 7.4
historic 7.3
lifestyle 7.2
landmark 7.2
black 7.2
transportation 7.2
musician 7.2
history 7.1

Google
created on 2022-01-23

Photograph 94.2
Musical instrument 91
Window 90.9
Building 90.1
Plant 85
Style 83.8
Drum 83.7
Suit 79.8
People 78.1
House 76.4
Monochrome 75.5
Monochrome photography 74.8
Snapshot 74.3
Vintage clothing 71.1
Event 70
Pole 69.9
Hat 68.1
History 67.1
Crew 66.4
Motor vehicle 66.1

Microsoft
created on 2022-01-23

outdoor 99.8
building 99.8
musical instrument 95.7
text 94.4
drum 92.1
person 91.1
group 84.5
posing 73.7
band 73.4
people 73
black and white 65.9
clothing 64.2
white 60.3
old 60.2
music 55.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 86.5%
Surprised 4.1%
Happy 3.6%
Angry 1.9%
Sad 1.4%
Confused 1.1%
Disgusted 0.8%
Fear 0.7%

AWS Rekognition

Age 23-33
Gender Female, 99.1%
Calm 60.2%
Sad 17.5%
Happy 7.7%
Angry 6.6%
Disgusted 3%
Surprised 2%
Confused 1.8%
Fear 1.3%

AWS Rekognition

Age 22-30
Gender Male, 99.8%
Happy 87.1%
Calm 6.7%
Surprised 1.7%
Fear 1.4%
Sad 1.1%
Disgusted 0.8%
Confused 0.7%
Angry 0.5%

AWS Rekognition

Age 27-37
Gender Male, 99.5%
Calm 92.2%
Sad 7%
Disgusted 0.2%
Confused 0.2%
Angry 0.2%
Surprised 0.1%
Fear 0.1%
Happy 0%

AWS Rekognition

Age 19-27
Gender Female, 100%
Disgusted 97.5%
Angry 1%
Happy 0.5%
Calm 0.4%
Confused 0.2%
Surprised 0.2%
Sad 0.2%
Fear 0.1%

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Calm 99.2%
Sad 0.2%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Confused 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 18-26
Gender Female, 86.5%
Calm 62.5%
Sad 33.4%
Angry 1.6%
Confused 0.8%
Fear 0.5%
Surprised 0.5%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 19-27
Gender Male, 99.7%
Calm 95.6%
Angry 3.7%
Sad 0.5%
Confused 0.1%
Happy 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 18-26
Gender Male, 96.8%
Calm 99.8%
Sad 0.1%
Surprised 0%
Confused 0%
Disgusted 0%
Angry 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Happy 99.7%
Calm 0.1%
Surprised 0%
Confused 0%
Disgusted 0%
Fear 0%
Sad 0%
Angry 0%

AWS Rekognition

Age 29-39
Gender Male, 99%
Happy 93.7%
Calm 1.4%
Angry 1.4%
Surprised 1%
Sad 0.8%
Fear 0.7%
Confused 0.6%
Disgusted 0.4%

AWS Rekognition

Age 25-35
Gender Male, 57%
Calm 95.8%
Sad 1.9%
Confused 0.7%
Happy 0.7%
Angry 0.6%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 14-22
Gender Male, 99.8%
Calm 99%
Happy 0.3%
Confused 0.2%
Angry 0.2%
Surprised 0.1%
Sad 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Calm 76.7%
Happy 18.6%
Sad 2.4%
Confused 0.5%
Surprised 0.5%
Angry 0.5%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 26-36
Gender Female, 99.9%
Happy 99.1%
Disgusted 0.2%
Sad 0.2%
Confused 0.2%
Surprised 0.1%
Calm 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 23-31
Gender Female, 100%
Happy 96.3%
Calm 1%
Disgusted 0.8%
Surprised 0.6%
Angry 0.6%
Fear 0.3%
Confused 0.2%
Sad 0.2%

AWS Rekognition

Age 18-24
Gender Male, 99.1%
Calm 93.2%
Happy 6.3%
Confused 0.1%
Sad 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0%
Angry 0%

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Calm 93.3%
Happy 4.4%
Confused 0.6%
Sad 0.5%
Disgusted 0.4%
Surprised 0.4%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 20-28
Gender Female, 89.4%
Sad 98.7%
Calm 1%
Happy 0.1%
Disgusted 0%
Angry 0%
Confused 0%
Fear 0%
Surprised 0%

AWS Rekognition

Age 33-41
Gender Male, 93.5%
Sad 54.6%
Happy 37.5%
Calm 2.9%
Angry 1.9%
Disgusted 1.5%
Fear 0.7%
Surprised 0.5%
Confused 0.4%

AWS Rekognition

Age 29-39
Gender Male, 100%
Calm 51.2%
Sad 43%
Confused 1.9%
Angry 1.2%
Disgusted 1.1%
Surprised 0.7%
Happy 0.5%
Fear 0.4%

AWS Rekognition

Age 20-28
Gender Female, 95.8%
Sad 83.5%
Calm 10.6%
Confused 2.5%
Disgusted 1.6%
Angry 0.6%
Fear 0.5%
Happy 0.4%
Surprised 0.4%

AWS Rekognition

Age 20-28
Gender Female, 98.8%
Happy 86.4%
Sad 10.2%
Disgusted 0.9%
Angry 0.7%
Confused 0.6%
Fear 0.5%
Surprised 0.5%
Calm 0.3%

AWS Rekognition

Age 40-48
Gender Male, 99.6%
Calm 72.6%
Happy 18%
Sad 3.4%
Surprised 1.6%
Confused 1.3%
Angry 1.3%
Fear 1%
Disgusted 0.6%

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Calm 97.1%
Sad 1.5%
Confused 0.7%
Surprised 0.2%
Disgusted 0.2%
Fear 0.1%
Happy 0.1%
Angry 0.1%

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 98.8%
Surprised 0.5%
Happy 0.2%
Sad 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 26-36
Gender Female, 56.6%
Calm 83.6%
Happy 12.7%
Disgusted 1.7%
Sad 0.8%
Confused 0.5%
Surprised 0.3%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 16-22
Gender Female, 90.9%
Happy 54.8%
Sad 26.7%
Disgusted 8.4%
Calm 6.5%
Surprised 1.3%
Angry 1%
Fear 0.7%
Confused 0.5%

AWS Rekognition

Age 20-28
Gender Female, 100%
Happy 99.6%
Disgusted 0.1%
Angry 0.1%
Sad 0.1%
Confused 0.1%
Calm 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 23-31
Gender Female, 69.6%
Sad 98.6%
Angry 0.7%
Calm 0.4%
Confused 0.1%
Fear 0.1%
Happy 0.1%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 23-31
Gender Male, 80.7%
Happy 78.1%
Calm 20%
Surprised 0.6%
Fear 0.4%
Sad 0.4%
Disgusted 0.3%
Angry 0.2%
Confused 0.2%

AWS Rekognition

Age 18-26
Gender Male, 99.5%
Calm 89.3%
Sad 3.6%
Surprised 2.9%
Fear 1.8%
Confused 0.7%
Happy 0.7%
Angry 0.6%
Disgusted 0.4%

AWS Rekognition

Age 24-34
Gender Male, 99.7%
Happy 98.9%
Sad 0.5%
Calm 0.2%
Confused 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 21-29
Gender Male, 99.8%
Calm 92.8%
Confused 3.4%
Sad 1.7%
Angry 1%
Surprised 0.5%
Disgusted 0.2%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 29-39
Gender Female, 98.9%
Happy 77.3%
Calm 6.3%
Sad 6%
Surprised 2.5%
Fear 2.4%
Angry 2.2%
Disgusted 1.7%
Confused 1.6%

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 99%
Surprised 0.5%
Sad 0.3%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0%
Happy 0%

AWS Rekognition

Age 27-37
Gender Male, 99.9%
Happy 84.3%
Calm 14.8%
Sad 0.3%
Confused 0.2%
Surprised 0.2%
Fear 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 22-30
Gender Male, 99.8%
Calm 99.8%
Sad 0.1%
Surprised 0.1%
Confused 0%
Disgusted 0%
Angry 0%
Happy 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.7%
Person 99.6%
Person 99.3%
Person 99.2%
Person 99%
Person 97.4%
Person 97.2%
Person 95.8%
Person 87.8%
Person 87.7%
Person 85.4%
Person 80.9%

Categories

Text analysis

Amazon

SMACH
AH
MYC

Google

2MACA
2MACA