Human Generated Data

Title

Austin Hogan Speaking at St. Nicholas Arena
Date

1948
People

Artist: Morris Engel, American 1918 - 2005
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Bell, P1979.55

Human Generated Data

Title

Austin Hogan Speaking at St. Nicholas Arena

People

Artist: Morris Engel, American 1918 - 2005

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 99.9
Audience 99.9
Crowd 99.9
Person 98.5
Interior Design 97.7
Indoors 97.7
Person 95.3
Person 95
Speech 92.7
Person 91.1
Person 90.1
Person 89.2
Lecture 83.8
Face 81.2
Tie 71.2
Accessories 71.2
Accessory 71.2
People 70.8
Person 68.6
Portrait 60.6
Photography 60.6
Photo 60.6
Seminar 58.6
Classroom 58.6
School 58.6
Room 58.6
Person 53.5

Imagga
created on 2021-12-14

musical instrument 43.9
wind instrument 36.3
brass 34.5
cornet 29.4
black 27.8
man 25.5
adult 23.7
device 23.3
person 21.2
male 20.6
people 19.5
silhouette 15.7
portrait 15.5
dark 15
horn 14.7
style 13.4
performer 13.3
music 12.9
sexy 12.8
attractive 12.6
model 12.4
guitar 12.2
play 12.1
body 12
dance 11.6
posing 11.6
musician 11.5
studio 11.4
face 11.4
one 11.2
stringed instrument 10.9
sensuality 10.9
singer 10.5
hands 10.4
love 10.3
expression 10.2
fashion 9.8
pretty 9.8
human 9.7
performance 9.6
hair 9.5
accordion 9.4
lady 8.9
instrumentality 8.9
couple 8.7
women 8.7
business 8.5
instrument 8.4
player 8.3
entertainment 8.3
electronic instrument 8.2
dancer 8.2
playing 8.2
active 8.2
happy 8.1
metal 8
night 8
sax 7.8
dancing 7.7
motion 7.7
keyboard instrument 7.7
hand 7.6
guy 7.5
hot 7.5
world 7.5
action 7.4
light 7.4
figure 7.3
lifestyle 7.2
shadow 7.2
romance 7.1

Google
created on 2021-12-14

Coat 86
Font 78.8
Suit 76.2
Art 73.6
Chair 71.7
Monochrome photography 71.3
Monochrome 70.6
Flash photography 70.6
Vintage clothing 69.3
Event 63.8
Stock photography 63.3
Formal wear 63
Room 62.9
Photo caption 61.9
Visual arts 57.8
Portrait 57.6
Sitting 55.2
Photographic paper 54.9
History 53.9
Retro style 52.7

Microsoft
created on 2021-12-14

text 98.9
person 97.8
clothing 97.5
human face 93.4
man 93
television 90.1
screen 73.4
black and white 63.9
picture frame 42.2
computer 34.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 98.7%
Sad 95.2%
Calm 3.7%
Angry 0.7%
Confused 0.3%
Fear 0.1%
Surprised 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 25-39
Gender Male, 99%
Calm 94%
Angry 2.5%
Sad 2.3%
Confused 0.5%
Disgusted 0.2%
Happy 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 19-31
Gender Male, 97.9%
Calm 73.8%
Sad 21.6%
Confused 3%
Surprised 0.5%
Angry 0.5%
Disgusted 0.3%
Happy 0.3%
Fear 0.1%

AWS Rekognition

Age 23-37
Gender Male, 99%
Calm 83.5%
Angry 7.3%
Disgusted 5.8%
Surprised 1.2%
Fear 1%
Sad 0.7%
Confused 0.4%
Happy 0.1%

AWS Rekognition

Age 23-35
Gender Male, 97%
Calm 94.5%
Angry 2.3%
Sad 2.1%
Surprised 0.3%
Confused 0.3%
Disgusted 0.2%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 30-46
Gender Male, 98.4%
Calm 59%
Angry 35%
Sad 2.9%
Confused 1.3%
Fear 0.7%
Disgusted 0.6%
Happy 0.3%
Surprised 0.2%

AWS Rekognition

Age 22-34
Gender Male, 99.5%
Calm 87.2%
Fear 5.1%
Sad 3.2%
Happy 2.2%
Angry 1.2%
Surprised 0.5%
Confused 0.5%
Disgusted 0.1%

AWS Rekognition

Age 21-33
Gender Male, 98.6%
Calm 77.4%
Happy 8.4%
Sad 3.9%
Angry 3.8%
Fear 3.8%
Surprised 1.2%
Confused 0.8%
Disgusted 0.6%

AWS Rekognition

Age 39-57
Gender Male, 98.9%
Calm 72.5%
Angry 16.4%
Sad 6.9%
Confused 1.7%
Fear 1.1%
Surprised 0.9%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 23-37
Gender Male, 98.2%
Calm 41.9%
Sad 24.7%
Fear 13.3%
Confused 5.9%
Surprised 5.9%
Happy 4.6%
Angry 2.5%
Disgusted 1.2%

AWS Rekognition

Age 22-34
Gender Male, 95.7%
Calm 55.9%
Sad 28.3%
Confused 7.1%
Angry 4.5%
Fear 1.5%
Happy 1.1%
Surprised 0.9%
Disgusted 0.8%

AWS Rekognition

Age 23-37
Gender Male, 90%
Calm 81.4%
Sad 8.4%
Happy 4.3%
Confused 2.4%
Surprised 1.5%
Angry 1%
Disgusted 0.6%
Fear 0.5%

AWS Rekognition

Age 32-48
Gender Male, 99.4%
Sad 78.5%
Calm 14.5%
Fear 2.8%
Confused 2.2%
Angry 1.3%
Surprised 0.4%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 26-40
Gender Male, 84.8%
Sad 86%
Calm 9.5%
Confused 3.3%
Fear 0.6%
Angry 0.3%
Surprised 0.2%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 23-37
Gender Male, 72.8%
Calm 61.5%
Happy 24.4%
Sad 4.4%
Fear 3%
Surprised 3%
Confused 1.9%
Disgusted 0.9%
Angry 0.9%

Microsoft Cognitive Services

Age 47
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Tie 71.2%

Captions

Microsoft

a man standing in front of a television screen 68.5%
a man standing in front of a television 68.4%
a screen shot of a man 68.3%