Human Generated Data

Title

Ex-Tenant Farmer on Relief Grant in the Imperial Valley
Date

1936
People

Artist: Dorothea Lange, American 1895 - 1965
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Sedgewick Memorial Collection, 2.2002.717

Human Generated Data

Title

Ex-Tenant Farmer on Relief Grant in the Imperial Valley

People

Artist: Dorothea Lange, American 1895 - 1965

Date

1936

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 100
Apparel 100
Hat 99.9
Person 99.8
Human 99.8
Person 99.4
Person 98.9
Hat 98.3
Hat 96.4
Person 96.1
Sun Hat 95.8
Person 93.4
Cowboy Hat 88.8
Person 83.6
Overcoat 69.2
Coat 69.2

Imagga
created on 2022-01-22

hat 98.9
cowboy hat 63.1
clothing 51.5
male 46.2
man 43.7
headdress 41.1
person 40.4
military uniform 37.7
uniform 34.6
portrait 31.1
people 29.6
adult 28.5
consumer goods 28.4
covering 28.2
face 25.6
senior 23.4
outdoors 23.2
men 22.3
happy 21.3
handsome 19.6
smiling 18.1
cowboy 17
hand 16
shirt 15.9
old 15.3
guy 14.8
looking 14.4
elderly 14.4
smile 14.3
one 14.2
mature 14
casual 13.6
western 12.6
job 12.4
industry 12
hair 11.9
happiness 11.8
model 11.7
grandfather 11.5
wearing 11.4
black 11.4
couple 11.3
boy 11.3
outside 11.1
suit 11
child 10.7
old-timer 10.7
attractive 10.5
serious 10.5
two 10.2
lifestyle 10.1
cheerful 9.8
work 9.4
beard 9.3
alone 9.1
helmet 9
worker 8.8
jacket 8.8
country 8.8
standing 8.7
age 8.6
expression 8.5
head 8.4
leisure 8.3
human 8.3
engineer 8.2
style 8.2
kid 8
rural 7.9
love 7.9
older 7.8
straw 7.7
construction 7.7
pretty 7.7
youth 7.7
only 7.6
skin 7.6
farmer 7.6
healthy 7.6
fashion 7.5
hold 7.4
safety 7.4
children 7.3
business 7.3
aged 7.2
farm 7.1
posing 7.1
look 7

Google
created on 2022-01-22

Hat 94.8
Sun hat 91.7
Fedora 86.9
Gesture 85.3
Style 83.9
Collar 83.7
Black-and-white 82.2
Headgear 81.9
Cap 80.6
Blazer 77.9
Vintage clothing 75.6
Cowboy hat 73.9
Monochrome photography 73.2
Monochrome 73.1
Event 71.4
Art 67.6
Fashion accessory 66.5
Suit 65.8
Stock photography 63.7
Moustache 62.8

Microsoft
created on 2022-01-22

person 99.8
man 98.5
fashion accessory 98.1
clothing 96.1
fedora 95.7
military uniform 95.4
cowboy hat 93.7
sun hat 92.3
outdoor 90.7
human face 87.6
old 85.7
hat 76.7
suit 63.2
text 62
black and white 56.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 51-59
Gender Male, 96.1%
Calm 67.8%
Angry 11.9%
Sad 5.8%
Happy 3.6%
Disgusted 3.5%
Surprised 3%
Confused 2.1%
Fear 2.1%

AWS Rekognition

Age 58-66
Gender Male, 99.3%
Calm 99.6%
Angry 0.1%
Sad 0.1%
Disgusted 0.1%
Confused 0.1%
Surprised 0%
Fear 0%
Happy 0%

Microsoft Cognitive Services

Age 59
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.9%
Person 99.8%

Captions

Microsoft

a man wearing a hat 95.7%
an old photo of a man wearing a hat 94.7%
a man wearing a suit and hat 94.6%