Human Generated Data

Title

Untitled (cotton pickers, Alexander Plantation, Pulaski County, Arkansas)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2487

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (cotton pickers, Alexander Plantation, Pulaski County, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Apparel 99.9
Clothing 99.9
Human 99.6
Person 99.6
Person 99.5
Person 99.3
Hat 97.5
Sun Hat 88.3
Face 70.6
Overcoat 68.2
Coat 68.2
Hat 66.3
Military Uniform 64.9
Military 64.9
Officer 59.6
People 59.2
Cowboy Hat 58.1
Cap 57
Sombrero 56.8

Imagga
created on 2021-12-15

man 40.3
male 39
person 29.6
people 25.6
adult 22.7
portrait 22
uniform 21.2
clothing 20.4
old 19.5
military uniform 18.9
happy 18.2
hat 17.5
men 17.2
smiling 15.9
businessman 15.9
business 15.8
senior 15
smile 15
work 14.9
worker 14.5
looking 14.4
job 14.1
doctor 14.1
professional 13.8
elderly 13.4
guy 13.3
face 12.8
two 12.7
statue 12.5
happiness 12.5
old-timer 12.2
standing 12.2
shirt 12.1
suit 12
coat 11.6
handsome 11.6
medical 11.5
couple 11.3
hand 10.6
medicine 10.6
one 10.4
hospital 10.3
black 10.2
day 10.2
holding 9.9
nurse 9.6
home 9.6
profession 9.6
ancient 9.5
casual 9.3
vintage 9.1
office 9.1
pose 9.1
care 9
aged 9
covering 9
team 8.9
family 8.9
consumer goods 8.8
building 8.7
antique 8.6
serious 8.6
builder 8.5
camera 8.3
occupation 8.2
outdoors 8.2
posing 8
love 7.9
model 7.8
sculpture 7.7
stethoscope 7.7
health 7.6
jacket 7.5
manager 7.4
mature 7.4
kin 7.4
style 7.4
20s 7.3
patient 7.3
group 7.2
hair 7.1
engineer 7.1
architecture 7

Google
created on 2021-12-15

Photograph 94.2
Hat 92.4
White 92.2
Sleeve 87.2
Headgear 85.1
Collar 84.1
Uniform 74.2
Cap 73.7
Vintage clothing 73.7
Monochrome 68
Monochrome photography 67.1
Blazer 65.1
Stock photography 64.8
Sun hat 59.2
History 55
Crew 54.7
Moustache 54.4
Art 52.5

Microsoft
created on 2021-12-15

person 99.4
outdoor 97.1
clothing 96.2
man 95
text 85.3
military uniform 82.4
human face 74.9
smile 70
hat 62.1
old 54.7
posing 44.1
work-clothing 12.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Female, 91.1%
Calm 79.3%
Sad 12.4%
Happy 5.6%
Surprised 0.8%
Fear 0.6%
Confused 0.5%
Disgusted 0.4%
Angry 0.3%

AWS Rekognition

Age 25-39
Gender Female, 91%
Calm 82.1%
Angry 5.1%
Surprised 4.4%
Disgusted 1.9%
Happy 1.9%
Confused 1.7%
Fear 1.6%
Sad 1.3%

AWS Rekognition

Age 21-33
Gender Female, 54.7%
Calm 21.1%
Confused 19.6%
Happy 15.8%
Fear 15.5%
Sad 13.1%
Disgusted 8.6%
Angry 3.4%
Surprised 2.9%

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Hat 97.5%

Captions

Microsoft

a group of people in uniform posing for a photo 89.8%
a group of people posing for a photo 87.6%
a group of people in uniform 87.5%