Human Generated Data

Title

Trische family, tenant famers, Plaquemines Parish, Louisiana
Date

1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3044

Human Generated Data

Title

Trische family, tenant famers, Plaquemines Parish, Louisiana

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3044

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Accessory 99.9
Tie 99.9
Accessories 99.9
Human 99.7
Person 99.7
Person 99.6
Person 99.5
Clothing 98.1
Apparel 98.1
Person 97.1
Shirt 93.1
People 91.1
Sleeve 88.2
Long Sleeve 81.8
Face 74.3
Family 57.7
Building 56.8

Clarifai
created on 2023-10-15

people 99.9
portrait 99.6
child 99.6
group 99.6
three 98.4
four 98.1
family 97.6
son 97.5
group together 97.5
adult 96.4
offspring 95.1
sibling 94.4
man 93.2
monochrome 93
two 92.7
woman 91.5
wear 91.2
boy 90.9
documentary 89.9
retro 89.9

Imagga
created on 2021-12-15

kin 51.6
man 37.6
people 34
couple 32.2
senior 31.9
male 31.4
happy 28.8
adult 24.8
smiling 23.9
person 23.3
elderly 23
together 21.9
men 20.6
home 19.9
sitting 19.8
family 19.6
old 18.8
indoors 18.4
portrait 18.1
happiness 18
smile 17.8
love 17.4
husband 16.7
mother 16
businessman 15
mature 14.9
wife 14.2
grandfather 13.9
group 13.7
businesspeople 13.3
lifestyle 13
inside 12.9
70s 12.8
women 12.7
cheerful 12.2
business 12.1
grandmother 11.7
father 11.7
clothing 11.6
retirement 11.5
medical 11.5
talking 11.4
meeting 11.3
two 11
colleagues 10.7
retired 10.7
color 10.6
day 10.2
communication 10.1
horizontal 10
businesswoman 10
face 9.9
hospital 9.8
sibling 9.8
businessmen 9.7
professional 9.7
groom 9.7
looking camera 9.6
looking 9.6
enjoying 9.5
daughter 9.5
corporate 9.4
togetherness 9.4
20s 9.2
child 9.1
executive 9.1
office 9.1
aged 9.1
patient 9
handsome 8.9
worker 8.9
seniors 8.8
casual clothing 8.8
60s 8.8
40s 8.8
middle aged 8.8
two people 8.7
standing 8.7
parent 8.7
30s 8.7
grandma 8.6
laughing 8.5
friendship 8.4
teamwork 8.3
camera 8.3
wedding 8.3
occupation 8.2
team 8.1
dad 8
son 8
discussing 7.9
work 7.8
affection 7.7
mid adult 7.7
bride 7.7
married 7.7
loving 7.6
illness 7.6
bed 7.6
joy 7.5
joyful 7.3
new 7.3
hair 7.1
job 7.1
to 7.1
nurse 7
modern 7

Google
created on 2021-12-15

Shirt 95.2
Outerwear 95.1
Photograph 94.2
White 92.2
Black 89.6
Sleeve 86.9
Standing 86.4
Tie 84.5
Black-and-white 84.4
Style 84
Collar 80.7
Monochrome 76
Vintage clothing 75.7
Monochrome photography 75.6
Snapshot 74.3
Toddler 71.3
Dress shirt 70.4
Event 70.1
Room 68.9
Formal wear 66.9

Microsoft
created on 2021-12-15

person 99.1
text 98.7
smile 97.3
human face 96.6
clothing 96.2
outdoor 95.3
newspaper 82.6
posing 79.6
boy 72.1
group 62.2
man 56.3
baby 55.4
picture frame 6.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-52
Gender Male, 97.7%
Calm 51.8%
Angry 44.3%
Sad 1.5%
Fear 0.7%
Surprised 0.7%
Happy 0.4%
Confused 0.3%
Disgusted 0.3%

AWS Rekognition

Age 11-21
Gender Female, 90.1%
Angry 96.3%
Confused 1.2%
Disgusted 1.1%
Sad 0.5%
Fear 0.3%
Surprised 0.3%
Calm 0.2%
Happy 0.1%

AWS Rekognition

Age 13-25
Gender Female, 58%
Sad 92.1%
Calm 6.3%
Confused 0.7%
Fear 0.4%
Angry 0.3%
Disgusted 0.1%
Surprised 0.1%
Happy 0.1%

AWS Rekognition

Age 9-19
Gender Female, 90.3%
Angry 98.8%
Calm 0.3%
Happy 0.3%
Sad 0.2%
Confused 0.2%
Disgusted 0.2%
Fear 0%
Surprised 0%

Microsoft Cognitive Services

Age 57
Gender Male

Microsoft Cognitive Services

Age 53
Gender Female

Microsoft Cognitive Services

Age 49
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.9%
Person 99.7%

Categories

Imagga

people portraits 75.2%
paintings art 24.4%