Human Generated Data

Title

Taking no notice of a troublesome right shoulder, New York Yankee star Mickey Mantle manages a "thumbs up" sign as he overlooks the Mayo Clinic from his hotel room here on January 17th. The champion slugger will undergo nearly a week of tests at the clinic to see if the shoulder can be fixed up. Before starting on the grueling series of examinations, Mantle remarked, "It isn't sore, but I can't throw with it."
Date

January 1966
People

Artist: Gordon W. Gahan, American 1945 - 1984
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.1.91

Human Generated Data

Title

Taking no notice of a troublesome right shoulder, New York Yankee star Mickey Mantle manages a "thumbs up" sign as he overlooks the Mayo Clinic from his hotel room here on January 17th. The champion slugger will undergo nearly a week of tests at the clinic to see if the shoulder can be fixed up. Before starting on the grueling series of examinations, Mantle remarked, "It isn't sore, but I can't throw with it."

People

Artist: Gordon W. Gahan, American 1945 - 1984

Date

January 1966

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.1.91

Machine Generated Data

Tags

Amazon
created on 2019-03-22

Finger 99.9
Clothing 99.8
Hat 99.8
Apparel 99.8
Human 99.7
Person 99.7
Thumbs Up 99.6
Sun Hat 55.6

Clarifai
created on 2019-03-22

people 99.8
portrait 99.5
lid 99.5
man 99.4
adult 99.1
one 98.5
veil 95.6
monochrome 95.5
facial expression 94.7
wear 94.5
two 94.3
leader 92
administration 91.8
actor 91.7
elderly 88.8
retro 87.8
mustache 83.8
facial hair 83.2
music 81.5
fedora 80.6

Imagga
created on 2019-03-22

hat 100
cowboy hat 74.7
headdress 50.3
clothing 44.7
man 41
male 38.3
portrait 34.9
person 33.5
face 31.3
people 28.4
adult 23.3
mustache 22.2
covering 21.5
handsome 20.5
consumer goods 20.5
guy 20.4
model 20.2
serious 20
men 18.9
black 18.6
senior 17.8
shirt 17.7
beard 17.6
looking 17.6
happy 16.9
attractive 16.8
hand 16.7
cowboy 16.7
hair 16.6
fashion 16.6
suit 16.5
smile 16.4
human 15.7
boy 15.6
one 14.9
look 14.9
expression 14.5
businessman 14.1
old 13.9
western 13.6
old-timer 13.6
head 13.4
style 13.4
necktie 13.1
sexy 12.8
casual 12.7
business 12.1
grandfather 11.3
close 10.8
kid 10.6
eyes 10.3
youth 10.2
glasses 10.2
lifestyle 10.1
dark 10
child 10
fun 9.7
wearing 9.5
tie 9.5
smiling 9.4
mature 9.3
hold 9.2
studio 9.1
modern 9.1
pose 9.1
retro 9
garment 9
success 8.8
mysterious 8.7
work 8.6
smart 8.5
pretty 8.4
vintage 8.3
sombrero 8.2
children 8.2
bolo tie 8.2
bow tie 8.1
blond 8.1
eye 8
posing 8
job 8
standing 7.8
mystery 7.7
gesture 7.6
outdoors 7.5
smoke 7.4
executive 7.4
uniform 7.3
confident 7.3
cute 7.2
cool 7.1
love 7.1
military uniform 7.1

Google
created on 2019-03-22

Finger 83.3
Hat 81.4
Gesture 77.5
Gentleman 73.5
Headgear 72.3
Fashion accessory 69.1
Black-and-white 68.3
Hand 66
Photography 62.4
Thumb 59.5
Fedora 56.3
Cowboy hat 56.3
Style 51

Microsoft
created on 2019-03-22

man 99.9
person 99.9
hat 98.1
wearing 96.2
posing 69
cowboy 20.2
chapeau 6.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-59
Gender Male, 97.5%
Disgusted 2.2%
Calm 2.3%
Angry 1.1%
Sad 0.8%
Happy 88.3%
Confused 2.7%
Surprised 2.6%

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.8%
Person 99.7%

Categories

Imagga

people portraits 64%
food drinks 32.1%
paintings art 2.6%