Human Generated Data

Title

Wife of Mr. Thaxton, near Mechanicsburg, Ohio

Date

1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3024

Human Generated Data

Title

Wife of Mr. Thaxton, near Mechanicsburg, Ohio

People

Artist: Ben Shahn, American 1898 - 1969

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 99.6
Person 99.6
Person 99
Clothing 98.8
Apparel 98.8
Home Decor 92.5
Hat 81.3
Linen 80.7
Bonnet 80.2
Face 78.1
Female 75.4
People 74.5
Girl 62.4
Photography 55.6
Photo 55.6
Accessories 55.2
Glasses 55.2
Accessory 55.2

Imagga
created on 2021-12-15

shower cap 34.6
headdress 34
person 33.4
cap 32.8
hat 31.6
people 29.5
senior 28.1
portrait 27.8
adult 26.5
man 26.2
clothing 23.9
face 21.3
elderly 21.1
male 20.6
smile 19.9
smiling 18.8
happy 18.8
net 18.5
old 18.1
looking 17.6
bonnet 17.2
hair 16.6
happiness 16.4
mature 14.9
health 13.9
couple 13.1
love 12.6
medical 12.4
lifestyle 12.3
doctor 12.2
men 12
human 12
professional 11.9
casual 11.9
one 11.2
women 11.1
grandma 11
consumer goods 10.9
retired 10.7
hand 10.6
mother 10.6
medicine 10.6
retirement 10.6
worker 10.1
covering 9.9
care 9.9
attractive 9.8
cheerful 9.7
expression 9.4
child 9.3
rustic 9.2
holding 9.1
aged 9
hospital 9
surgeon 8.9
lady 8.9
family 8.9
together 8.8
mask 8.6
eyes 8.6
curler 8.5
outdoor 8.4
head 8.4
pretty 8.4
glasses 8.3
camera 8.3
occupation 8.2
alone 8.2
outdoors 8.2
container 8.1
blond 8.1
nurse 8.1
home 8
cute 7.9
model 7.8
uniform 7.7
illness 7.6
age 7.6
reading 7.6
house 7.5
fun 7.5
girls 7.3
holiday 7.2
handsome 7.1
kid 7.1
day 7.1
look 7

Google
created on 2021-12-15

Black 89.6
Plant 86.6
Style 83.9
Black-and-white 83.4
Hat 80.9
Picture frame 80.9
Window 79
Snapshot 74.3
Vintage clothing 74.1
Sleeve 73.5
Monochrome photography 72.5
Monochrome 71.6
Event 66.4
Room 64.8
History 62.9
Stock photography 62.5
Rectangle 61.9
Art 55.7
Visual arts 54.6
Portrait 53.4

Microsoft
created on 2021-12-15

human face 98
person 97.5
fashion accessory 94.7
text 90
smile 86.7
clothing 85.3
hat 84
standing 75
woman 64
white 61.9
old 59.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 41-59
Gender Female, 99.3%
Disgusted 67.1%
Calm 13.9%
Happy 9.5%
Sad 3.6%
Confused 2.9%
Fear 1.5%
Angry 1.3%
Surprised 0.3%

AWS Rekognition

Age 22-34
Gender Female, 98.6%
Fear 69.6%
Calm 10.7%
Sad 7.7%
Surprised 4.6%
Angry 3%
Confused 2.8%
Happy 1.2%
Disgusted 0.4%

Microsoft Cognitive Services

Age 49
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Hat 81.3%
Glasses 55.2%

Captions

Microsoft

a person standing in front of a window 92.8%
a man and a woman standing in front of a window 78.7%
a person standing in front of a mirror posing for the camera 78.6%