Human Generated Data

Title

Negro sharecropper and his wife, Pulaski County, Arkansas

Date

1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3047

Human Generated Data

Title

Negro sharecropper and his wife, Pulaski County, Arkansas

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.8
Human 99.8
Clothing 99.8
Apparel 99.8
Person 99.6
Hat 99.5
Sun Hat 89.2
Cowboy Hat 67.3
Face 66.3
Finger 55.7

Imagga
created on 2021-12-15

hat 100
cowboy hat 100
headdress 66.4
man 46.4
clothing 45.5
male 38.4
person 30.9
worker 26.9
senior 25.3
work 25.1
people 24
job 23
covering 22.6
consumer goods 22.6
men 20.6
occupation 19.2
industry 17.9
professional 17.8
portrait 17.5
happy 16.9
adult 16.2
hand 15.2
smile 14.2
couple 13.9
uniform 13.9
two 13.5
grandfather 13.4
medical 13.2
shirt 13.1
industrial 12.7
profession 12.4
engineer 12.1
looking 12
construction 12
home 12
old 11.8
handsome 11.6
helmet 11.6
health 11.1
business 10.9
kitchen 10.7
labor 10.7
elderly 10.5
builder 10.5
patient 10.4
building 10.3
hospital 10.3
doctor 10.3
equipment 9.8
hardhat 9.8
businessman 9.7
chef 9.7
farmer 9.5
guy 9.4
casual 9.3
mature 9.3
safety 9.2
foreman 9.1
cowboy 8.9
to 8.8
working 8.8
office 8.8
indoors 8.8
look 8.8
staff 8.7
western 8.7
women 8.7
architect 8.7
husband 8.6
serious 8.6
face 8.5
holding 8.2
indoor 8.2
style 8.2
family 8
interior 8
smiling 8
together 7.9
nurse 7.8
standing 7.8
contractor 7.8
sitting 7.7
collar 7.7
illness 7.6
wife 7.6
plan 7.6
site 7.5
pose 7.2
black 7.2
team 7.2
eye 7.1
hair 7.1
posing 7.1
employee 7.1
medicine 7

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

person 99.6
text 99.2
clothing 97.4
human face 96.9
smile 95.1
hat 93.6
man 92.3
fashion accessory 85.7
fedora 68.8
cowboy hat 67.6
black and white 64.6
old 63.1
sun hat 52.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-63
Gender Male, 94.8%
Calm 73.2%
Happy 19.9%
Sad 2.1%
Fear 1.4%
Angry 1.2%
Surprised 1%
Disgusted 0.6%
Confused 0.5%

AWS Rekognition

Age 36-54
Gender Male, 97.8%
Calm 96.5%
Angry 2.6%
Happy 0.5%
Sad 0.1%
Fear 0.1%
Surprised 0.1%
Disgusted 0%
Confused 0%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Hat 99.5%

Captions

Microsoft

an old photo of a man 91.4%
a man standing in front of a window 76.2%
an old photo of a man and a woman standing in a kitchen 74.1%