Human Generated Data

Title

Manelito, Spain

Date

1963-1964

People

Artist: George Krause, American born 1937

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Sam Pratt, P2003.295

Human Generated Data

Title

Manelito, Spain

People

Artist: George Krause, American born 1937

Date

1963-1964

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Clothing 100
Apparel 100
Hat 98.4
Human 98.2
Person 98.2
Cowboy Hat 93.5
Sun Hat 88.7

Imagga
created on 2022-05-28

cowboy hat 100
hat 100
headdress 72.4
clothing 51.8
man 37
portrait 36.9
person 36.2
male 36.2
black 34.1
covering 31.1
face 29.8
adult 26.5
people 26.2
consumer goods 25.7
model 22.6
handsome 20.5
dark 19.2
attractive 18.2
guy 17.8
costume 17.1
fashion 16.6
serious 16.2
human 15.7
one 15.7
expression 15.4
looking 15.2
head 15.1
look 14
studio 13.7
eye 13.4
pretty 13.3
old 13.2
senior 13.1
eyes 12.9
men 12.9
mysterious 12.6
posing 12.4
comedian 12.4
mask 12.3
beard 12.3
boy 12.2
sexy 12.1
close 12
hair 11.9
mystery 11.5
smile 11.4
hand 11.4
happy 11.3
style 11.1
fun 10.5
emotion 10.1
performer 10.1
cute 10
make 10
dress 9.9
cowboy 9.8
shirt 9.3
nose 9.1
lady 8.9
carnival 8.8
sombrero 8.7
western 8.7
elegant 8.6
grandfather 8.5
casual 8.5
disguise 8.3
pose 8.2
brunette 7.8
evil 7.8
masculine 7.8
party 7.7
art 7.6
entertainer 7.6
charming 7.6
elegance 7.6
child 7.5
alone 7.3
confident 7.3
mustache 7.2
lifestyle 7.2
body 7.2
blond 7.2
holiday 7.2

Google
created on 2022-05-28

Microsoft
created on 2022-05-28

fashion accessory 98.6
fedora 98.1
man 97.5
black 96.6
cowboy hat 95.7
human face 95.6
standing 92.1
sun hat 90.9
looking 88.7
clothing 87
person 85.7
sketch 80.3
portrait 69.5
black and white 63.9
white 62.6
headgear 61.3
hat 61.2
drawing 58.5
human beard 56.8
staring 56.7
costume hat 54.1

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 99%
Calm 95.6%
Fear 7.4%
Surprised 6.3%
Sad 2.2%
Disgusted 0.3%
Angry 0.1%
Happy 0.1%
Confused 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 98.4%
Person 98.2%

Captions

Microsoft

a man wearing a hat looking at the camera 91.7%
a man wearing a hat and looking at the camera 91.6%
a man wearing a hat posing for the camera 91.4%