Human Generated Data

Title

Wife of Mr. Thaxton, farmer, near Mechanicsburg, Pennsylvania

Date

1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3017

Human Generated Data

Title

Wife of Mr. Thaxton, farmer, near Mechanicsburg, Pennsylvania

People

Artist: Ben Shahn, American 1898 - 1969

Date

1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3017

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Bonnet 99.9
Apparel 99.9
Clothing 99.9
Person 99.7
Human 99.7
Person 99.1
Home Decor 87.1
Hat 82.4
Linen 73.3
Glasses 67.4
Accessories 67.4
Accessory 67.4

Clarifai
created on 2023-10-15

people 99.9
one 98.8
two 98.1
portrait 97.8
adult 97.4
lid 95.9
child 95
woman 93.7
wear 93.3
three 92.9
elderly 92.8
family 87.9
cooking 85.9
facial expression 85.7
nostalgia 85.3
man 82.9
group 80.6
son 79.6
veil 79
retro 74

Imagga
created on 2021-12-15

shower cap 35.8
cap 32.3
headdress 31.3
person 31.3
hat 29.4
people 28.4
clothing 25.9
man 23.5
portrait 23.3
adult 22.7
smile 21.4
nurse 19.9
face 19.9
smiling 18.8
happy 18.8
senior 18.7
male 17.1
hair 16.6
old 16
waiter 15.3
health 15.3
worker 14.4
elderly 14.4
child 14.1
happiness 14.1
medical 13.2
professional 12.7
attractive 12.6
rustic 12.4
care 12.3
dining-room attendant 12.3
doctor 12.2
looking 12
home 12
one 11.9
medicine 11.4
expression 11.1
casual 11
cute 10.8
hospital 10.7
bonnet 10.6
human 10.5
couple 10.4
consumer goods 10.3
love 10.3
mature 10.2
holding 9.9
employee 9.9
cheerful 9.8
illness 9.5
women 9.5
men 9.4
lifestyle 9.4
surgeon 9.2
domestic 9.2
uniform 9.2
occupation 9.2
covering 9.2
aged 9
kitchen 8.9
kid 8.9
little 8.8
head 8.4
hand 8.4
children 8.2
childhood 8.1
indoors 7.9
day 7.8
mother 7.8
container 7.8
surgery 7.8
eyes 7.7
pretty 7.7
mask 7.7
profession 7.7
outdoor 7.6
house 7.5
camera 7.4
lady 7.3
girls 7.3
net 7.3
work 7.2
handsome 7.1
family 7.1
job 7.1
working 7.1
look 7

Google
created on 2021-12-15

Hairstyle 95.1
Photograph 94.2
Plant 92.3
White 92.2
Human 90.1
Black 89.9
Standing 86.4
Hat 85.6
Black-and-white 84.9
Style 83.8
People 78.2
Houseplant 77.2
Vintage clothing 76.3
Flowerpot 75.7
Monochrome 75.1
Snapshot 74.3
Monochrome photography 74.2
Room 69.5
Happy 69.3
Sunglasses 68

Microsoft
created on 2021-12-15

person 99.4
human face 98.8
wall 95.4
man 94.7
fashion accessory 94.6
clothing 89.2
standing 88.8
smile 86
black 81.5
white 81.2
black and white 78.5
hat 66.6
woman 66
old 65.8
text 63.1
posing 56.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 33-49
Gender Female, 99.6%
Disgusted 85.2%
Calm 5.8%
Happy 4.3%
Confused 2.2%
Sad 1.5%
Angry 0.6%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 16-28
Gender Female, 97%
Fear 63.6%
Calm 19.1%
Surprised 5.6%
Sad 4.8%
Angry 3.6%
Confused 1.8%
Happy 1.1%
Disgusted 0.4%

Microsoft Cognitive Services

Age 50
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Hat 82.4%
Glasses 67.4%

Categories

Imagga

paintings art 85.1%
people portraits 14.8%