Human Generated Data

Title

Farm Security Administration client, Mills Lacs Company, Minnesota

Date

July 1941

People

Artist: John Vachon, American 1914 - 1975

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mack and Paula Lee, P1998.48

Human Generated Data

Title

Farm Security Administration client, Mills Lacs Company, Minnesota

People

Artist: John Vachon, American 1914 - 1975

Date

July 1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Clothing 99.7
Hat 99.7
Apparel 99.7
Human 99.3
Person 99.3
Finger 92.1
Sun Hat 59.7
Officer 58.6
Military Uniform 58.6
Military 58.6

Imagga
created on 2022-01-09

person 44.1
man 37.7
male 32.6
scholar 31.8
intellectual 25.4
portrait 25.2
adult 23.9
people 22.9
men 22.3
face 19.9
world 17.7
harmonica 17.4
black 16.8
looking 16.8
old 16.7
human 16.5
hat 15.5
wind instrument 14.9
one 14.2
free-reed instrument 13.9
expression 12.8
businessman 12.4
senior 12.2
device 11.9
musical instrument 11.6
job 11.5
serious 11.4
statue 11.4
hand 11.4
business 10.9
performer 10.9
handsome 10.7
outdoors 10.5
smoke 10.2
phone 10.1
lifestyle 10.1
cigarette 9.7
horn 9.7
weapon 9.6
happy 9.4
two 9.3
mature 9.3
telephone 9.3
look 8.8
hair 8.7
couple 8.7
work 8.6
close 8.6
call 8.4
outdoor 8.4
attractive 8.4
joy 8.4
dark 8.4
fashion 8.3
vintage 8.3
occupation 8.3
lady 8.1
office 8
body 8
women 7.9
clothing 7.9
love 7.9
entertainer 7.9
day 7.8
happiness 7.8
standing 7.8
smoking 7.8
art 7.8
comedian 7.8
model 7.8
war 7.7
sculpture 7.7
casual 7.6
singer 7.6
communication 7.6
gray 7.2
gun 7.2
religion 7.2
smile 7.1
pistol 7.1
pretty 7

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Male, 100%
Sad 30.8%
Angry 28.6%
Calm 22.3%
Happy 9.7%
Fear 2.4%
Surprised 2.3%
Confused 2%
Disgusted 1.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.7%
Person 99.3%

Captions

Microsoft

a man wearing a hat 91%
a man wearing a hat and glasses 82.9%
a man wearing glasses and a hat 76.7%