Human Generated Data

Title

Trische family, tenant farmers, Plaquemines Parish, Louisiana
Date

1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3043

Human Generated Data

Title

Trische family, tenant farmers, Plaquemines Parish, Louisiana

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3043

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.8
Human 99.8
Person 99.5
Person 99.5
Person 98.3
Building 92.6
People 86
Clothing 83.8
Apparel 83.8
Porch 78
Urban 77.9
Outdoors 75.2
Housing 74.8
Nature 71.3
Countryside 71.3
Door 65.7
Sleeve 64.3
Face 61.5
Rural 61.4
Shelter 59.3
House 58.3
Hut 57.5
Home Decor 56.3
Family 55.8
Shorts 55

Clarifai
created on 2023-10-15

people 100
child 99.9
group 99.6
family 99.5
portrait 99.2
son 99.1
boy 97.9
four 97.2
sibling 97.2
group together 97.2
three 97
adult 96.7
offspring 96
man 95.7
wear 94.6
woman 94.3
monochrome 93.4
two 92.4
home 91.3
documentary 91.2

Imagga
created on 2021-12-15

man 44.4
kin 43.2
people 32.4
male 31.5
happy 27.6
smiling 27.5
businessman 27.4
person 25.9
adult 25.4
group 25
couple 23.5
business 22.5
together 21
men 19.7
mature 19.5
women 19
standing 18.3
portrait 18.1
team 17.9
smile 17.1
office 17.1
mother 16.3
child 15.7
colleagues 15.5
happiness 14.9
professional 14.8
businesswoman 14.5
30s 14.4
job 14.2
meeting 14.1
cheerful 13.8
two 13.6
love 13.4
family 13.3
businesspeople 13.3
walking 13.3
parent 13.1
corporate 12.9
casual 12.7
father 12.5
lifestyle 12.3
senior 12.2
teamwork 12.1
camera 12
room 11.8
40s 11.7
indoors 11.4
talking 11.4
boy 11.4
nurse 11.4
looking 11.2
suit 11
20s 11
outdoors 10.4
home 10.4
staff 10.1
occupation 10.1
dad 10
holding 9.9
daughter 9.8
discussion 9.7
four 9.6
confidence 9.6
education 9.5
color 9.5
executive 9.4
work 9.4
day 9.4
hospital 9.2
classroom 9.2
life 9.1
handsome 8.9
success 8.9
working 8.8
medical 8.8
world 8.8
loving 8.6
walk 8.6
doctor 8.5
friends 8.5
school 8.3
park 8.2
student 8.2
medicine 7.9
face 7.8
worker 7.8
husband 7.7
mid adult 7.7
health 7.6
finance 7.6
wife 7.6
communication 7.6
desk 7.6
horizontal 7.5
friendship 7.5
manager 7.4
son 7.4
building 7.3
children 7.3
black 7.3
confident 7.3
holiday 7.2
modern 7

Google
created on 2021-12-15

Dress 83.7
Adaptation 79.3
Tints and shades 75.8
Snapshot 74.3
Classic 73.9
Vintage clothing 72.8
Room 70.4
Monochrome 67.3
Monochrome photography 66.8
History 66.5
Stock photography 63.5
One-piece garment 61.2
Child 60
Photographic paper 58
Retro style 56.8
Family 54.6
Photo caption 54.4
Visual arts 51.4

Microsoft
created on 2021-12-15

text 99.5
clothing 98.9
person 96.5
outdoor 94.3
standing 91.5
smile 90.5
old 89
posing 86.2
black 82.3
footwear 80.9
white 78.2
photograph 72.2
child 71.9
human face 66.4
woman 62.4
dress 61.1
boy 50.4
vintage 28.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Female, 54.2%
Sad 86.2%
Confused 7.6%
Disgusted 3.7%
Calm 1.4%
Fear 0.3%
Surprised 0.3%
Angry 0.3%
Happy 0.2%

AWS Rekognition

Age 5-15
Gender Female, 89.8%
Angry 99.5%
Sad 0.1%
Calm 0.1%
Disgusted 0.1%
Confused 0.1%
Surprised 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 16-28
Gender Female, 94.5%
Calm 81.1%
Surprised 4.8%
Sad 4.7%
Angry 3.2%
Happy 3.1%
Fear 1.7%
Confused 0.8%
Disgusted 0.6%

AWS Rekognition

Age 28-44
Gender Female, 55.2%
Sad 98.8%
Happy 0.4%
Fear 0.2%
Calm 0.2%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Surprised 0%

AWS Rekognition

Age 1-5
Gender Male, 53.7%
Calm 48.7%
Angry 40.2%
Sad 5.4%
Happy 1.9%
Fear 1.5%
Disgusted 1%
Confused 0.8%
Surprised 0.5%

Microsoft Cognitive Services

Age 25
Gender Male

Microsoft Cognitive Services

Age 2
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Likely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Categories

Imagga

people portraits 97.3%
streetview architecture 1.1%