Human Generated Data

Title

Untitled (Trische family, tenant farmers, Plaquemines Parish, Louisiana)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1340
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Trische family, tenant farmers, Plaquemines Parish, Louisiana)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99.5
Human 99.5
Person 99.4
Accessory 83.3
Sunglasses 83.3
Accessories 83.3
Face 77.1
Room 72.4
Indoors 72.4
Clothing 72
Apparel 72
Food 71.3
Meal 71.3
People 69.4
Workshop 61.9

Clarifai
created on 2018-03-23

people 100
two 99.6
adult 99.6
group 99.3
three 97.7
wear 96.9
portrait 96.8
woman 96.8
actress 96.7
man 96.1
four 95.7
administration 95.5
leader 94.3
actor 93
one 92.7
offspring 92.2
group together 91.8
several 90.7
child 90.1
veil 89.2

Imagga
created on 2018-03-23

mother 45.8
hairdresser 37
parent 35.9
people 32.9
family 30.3
happy 30.1
couple 27
man 26.9
portrait 26.5
child 26.5
love 26
adult 25.9
male 24.5
grandma 24.1
senior 23.4
smile 22.8
together 21
daughter 20.4
person 20.3
smiling 20.3
happiness 19.6
home 18.4
kin 18.2
salon 17.8
husband 17.2
lifestyle 16.6
women 16.6
old 16
face 15.6
affection 14.5
loving 14.3
wife 14.2
life 14.2
kid 14.2
men 13.7
hair 13.5
married 13.4
elderly 13.4
pretty 13.3
indoors 13.2
relationship 13.1
mature 13
lady 13
sitting 12.9
grandmother 12.7
father 12.7
two 12.7
affectionate 12.6
looking 11.2
expression 11.1
care 10.7
retirement 10.6
cheerful 10.6
attractive 10.5
shop 9.9
childhood 9.9
dad 9.8
caring 9.8
kiss 9.8
tenderness 9.7
boy 9.6
grandfather 9.5
girls 9.1
son 8.8
look 8.8
barbershop 8.7
holiday 8.6
bed 8.5
brother 8.5
casual 8.5
room 8.4
fun 8.2
children 8.2
romantic 8
cute 7.9
two people 7.8
retired 7.8
eyes 7.7
hug 7.7
boyfriend 7.7
generation 7.7
laugh 7.7
togetherness 7.6
relaxation 7.5
joy 7.5
relaxed 7.5
human 7.5
hospital 7.4
20s 7.3
indoor 7.3
aged 7.2
black 7.2

Google
created on 2018-03-23

photograph 95.7
black and white 84.7
snapshot 81.8
girl 73.6
vintage clothing 70.7
monochrome photography 66.6
human behavior 62.1
family 57.7
portrait 56.3
monochrome 55.7

Microsoft
created on 2018-03-23

person 99.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-15
Gender Female, 85%
Angry 9.4%
Calm 11.1%
Happy 2.5%
Disgusted 1.4%
Surprised 46.3%
Sad 5.5%
Confused 23.8%

AWS Rekognition

Age 29-45
Gender Male, 65.4%
Disgusted 1.1%
Surprised 2.5%
Angry 2.7%
Sad 34.1%
Confused 2.6%
Happy 0.9%
Calm 56.1%

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Sunglasses 83.3%

Captions

Microsoft

a couple of people that are looking at the camera 79.6%
an old photo of a person 79.5%
a group of people standing next to a person 78.9%