Human Generated Data

Title

Manelito
Date

1963
People

Artist: George Krause, American born 1937
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.798

Human Generated Data

Title

Manelito

People

Artist: George Krause, American born 1937

Date

1963

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 100
Apparel 100
Hat 99.5
Human 98.3
Person 98.3
Cowboy Hat 95.6
Sun Hat 86.6

Imagga
created on 2022-01-22

hat 100
cowboy hat 100
headdress 85.3
clothing 59.5
man 41
male 39.7
person 36.5
portrait 36.3
covering 30.7
face 29.9
black 29.4
consumer goods 29
people 28.5
model 26.5
adult 25.2
handsome 24.1
guy 22.8
attractive 19.6
dark 19.2
fashion 18.1
looking 17.6
serious 17.2
cowboy 16.7
human 16.5
one 16.4
expression 16.2
old 16
senior 15.9
men 14.6
beard 14.5
sexy 14.5
hair 14.3
smile 14.3
shirt 14
boy 13.9
happy 13.8
eyes 13.8
hand 13.7
western 13.6
eye 13.4
mysterious 12.6
style 12.6
head 12.6
mystery 12.5
look 12.3
studio 12.2
pretty 11.9
posing 11.6
fun 11.2
casual 11
close 10.3
youth 10.2
costume 10.2
lifestyle 9.4
emotion 9.2
confident 9.1
pose 9.1
cool 8.9
masculine 8.8
smiling 8.7
child 8.3
alone 8.2
blond 8.1
shadow 8.1
kid 8
cute 7.9
smoking 7.8
elderly 7.7
skin 7.6
art 7.5
smoke 7.4
macho 7.4
lady 7.3
rough 7.3
sensual 7.3
make 7.3
grandfather 7.2
happiness 7.1

Google
created on 2022-01-22

Hat 94.9
Sun hat 90.8
Neck 87.7
Sleeve 87.2
Costume hat 86.4
Collar 84
Headgear 83.9
Facial hair 82.8
Beard 79.3
Fedora 77.9
Moustache 77.1
Formal wear 72.5
Blazer 70.4
Monochrome photography 68.9
Fashion accessory 67.4
Cowboy hat 66.2
Monochrome 66.1
Art 65
Vintage clothing 64.1
Portrait 57.3

Microsoft
created on 2022-01-22

hat 99.9
fashion accessory 98.4
fedora 98.3
man 98.3
cowboy hat 95.8
black 92.6
human face 92.2
sun hat 90.6
clothing 83.6
looking 81.6
text 80.5
person 78.9
portrait 68.6
white 61.5
headgear 58.3
black and white 55.5
human beard 51
costume hat 50.5
staring 48.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 99.1%
Calm 98.1%
Disgusted 0.6%
Fear 0.4%
Sad 0.3%
Angry 0.2%
Surprised 0.2%
Confused 0.1%
Happy 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.5%
Person 98.3%

Captions

Microsoft

a man wearing a hat looking at the camera 87.2%
a man wearing a hat and looking at the camera 87.1%
a man looking at the camera 87%