Human Generated Data

Title

Farm Security Administration client, Mills Lacs Company, Minnesota
Date

July 1941
People

Artist: John Vachon, American 1914 - 1975
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mack and Paula Lee, P1998.48

Human Generated Data

Title

Farm Security Administration client, Mills Lacs Company, Minnesota

People

Artist: John Vachon, American 1914 - 1975

Date

July 1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Hat 99.7
Clothing 99.7
Apparel 99.7
Person 99.3
Human 99.3
Finger 92.1
Sun Hat 59.7
Officer 58.6
Military 58.6
Military Uniform 58.6

Imagga
created on 2022-01-09

person 44.1
man 37.7
male 32.6
scholar 31.8
intellectual 25.4
portrait 25.2
adult 23.9
people 22.9
men 22.3
face 19.9
world 17.7
harmonica 17.4
black 16.8
looking 16.8
old 16.7
human 16.5
hat 15.5
wind instrument 14.9
one 14.2
free-reed instrument 13.9
expression 12.8
businessman 12.4
senior 12.2
device 11.9
musical instrument 11.6
job 11.5
serious 11.4
statue 11.4
hand 11.4
business 10.9
performer 10.9
handsome 10.7
outdoors 10.5
smoke 10.2
phone 10.1
lifestyle 10.1
cigarette 9.7
horn 9.7
weapon 9.6
happy 9.4
two 9.3
mature 9.3
telephone 9.3
look 8.8
hair 8.7
couple 8.7
work 8.6
close 8.6
call 8.4
outdoor 8.4
attractive 8.4
joy 8.4
dark 8.4
fashion 8.3
vintage 8.3
occupation 8.3
lady 8.1
office 8
body 8
women 7.9
clothing 7.9
love 7.9
entertainer 7.9
day 7.8
happiness 7.8
standing 7.8
smoking 7.8
art 7.8
comedian 7.8
model 7.8
war 7.7
sculpture 7.7
casual 7.6
singer 7.6
communication 7.6
gray 7.2
gun 7.2
religion 7.2
smile 7.1
pistol 7.1
pretty 7

Google
created on 2022-01-09

Arm 94.3
Hat 91.5
Sun hat 88.3
Flash photography 87.8
Gesture 85.3
Black-and-white 84.9
Style 84
Headgear 82.2
Eyewear 81.4
Fedora 80.3
Cap 76.6
Monochrome 75.8
Monochrome photography 75.6
Facial hair 75
Elbow 73.5
Fashion accessory 67.3
Sky 66.4
Moustache 65.3
Stock photography 63.1
Happy 62.8

Microsoft
created on 2022-01-09

person 99.9
fashion accessory 98
text 95
fedora 93
man 92.9
sun hat 89.4
hat 89
clothing 88.6
black and white 88.2
human face 86.2
cowboy hat 84.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Male, 100%
Sad 30.8%
Angry 28.6%
Calm 22.3%
Happy 9.7%
Fear 2.4%
Surprised 2.3%
Confused 2%
Disgusted 1.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.7%
Person 99.3%

Captions

Microsoft

a man wearing a hat 91%
a man wearing a hat and glasses 82.9%
a man wearing glasses and a hat 76.7%