Human Generated Data

Title

Mr. H. R. Wilson, eighty-six year old farmer, near Cedar Grove, North Carolina
Date

1940
People

Artist: Jack Delano, American 1914 - 1997
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2977

Human Generated Data

Title

Mr. H. R. Wilson, eighty-six year old farmer, near Cedar Grove, North Carolina

People

Artist: Jack Delano, American 1914 - 1997

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Clothing 99.8
Apparel 99.8
Person 99.8
Human 99.8
Hat 98.5
Accessories 98.1
Accessory 98.1
Tie 98.1
Face 97.2
Sun Hat 84.4
Finger 76.7
Musical Instrument 70.9
Musician 70.9
Beard 70.5
Sunglasses 65
Photography 64
Portrait 64
Photo 64
Performer 58.4
Guitarist 58.4
Leisure Activities 58.4
Guitar 58.4
Sleeve 57.1

Imagga
created on 2021-12-14

clothing 56.3
military uniform 56.3
man 55.8
male 51.1
uniform 49.9
bow tie 43.2
hat 39.3
person 38.9
portrait 37.5
necktie 37
adult 31.1
handsome 30.3
businessman 29.1
covering 28.6
consumer goods 27.8
people 26.8
men 26.6
face 26.3
suit 24.9
business 23.7
tie 22.8
smiling 21.7
cowboy hat 21.6
professional 20.4
old 20.2
senior 19.7
garment 19.6
old-timer 19.1
guy 18.7
mature 18.6
one 17.9
looking 17.6
corporate 17.2
grandfather 16.9
executive 16.7
serious 16.2
happy 15.7
confident 15.5
headdress 15.2
smile 15
shirt 14.9
head 14.3
job 14.2
success 13.7
work 13.3
model 13.2
glasses 13
occupation 12.8
expression 12.8
hand 12.2
office 12.1
black 12
lifestyle 11.6
manager 11.2
happiness 11
worker 10.9
gray 10.8
studio 10.6
elderly 10.5
human 10.5
telephone 10.5
standing 10.4
smart 10.4
casual 10.2
phone 10.1
communication 10.1
attractive 9.8
cheerful 9.8
outdoors 9.7
look 9.6
confidence 9.6
successful 9.2
modern 9.1
jacket 8.7
mobile 8.5
fashion 8.3
pose 8.2
eye 8
helmet 7.8
industry 7.7
age 7.6
hair 7.1
beard 7

Google
created on 2021-12-14

Hat 96.1
Sun hat 92.8
Vision care 91.8
Fedora 86.8
Style 83.8
Facial hair 83.4
Headgear 81
Eyewear 79
Collar 78.2
Moustache 78.1
Costume hat 76.4
Monochrome photography 74.9
Monochrome 73.8
Sky 71.8
Beard 69.4
Goggles 68.5
Fashion accessory 67.3
Wrinkle 66.2
Stock photography 64.4
Cowboy hat 60.8

Microsoft
created on 2021-12-14

man 99.9
person 99.4
fashion accessory 97.6
hat 96.9
fedora 94.4
human face 93.9
wearing 93.4
clothing 93.3
cowboy hat 88.9
text 87.8
sun hat 80.5
suit 75.8
glasses 74.2
black and white 72.8
old 64
human beard 51.5
smile 51.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-63
Gender Male, 97.3%
Calm 80.2%
Surprised 4.9%
Happy 4.6%
Angry 4.3%
Disgusted 2.7%
Confused 1.1%
Fear 1.1%
Sad 1%

Microsoft Cognitive Services

Age 68
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Hat 98.5%
Tie 98.1%
Sunglasses 65%

Captions

Microsoft

a man wearing a suit and hat 99.4%
a man wearing a hat 98.2%
a man wearing a hat and sunglasses 97.5%