Human Generated Data

Title

Mrs. Mary McLean, Skyline Farms, Alabama

Date

1937

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3115

Human Generated Data

Title

Mrs. Mary McLean, Skyline Farms, Alabama

People

Artist: Ben Shahn, American 1898 - 1969

Date

1937

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3115

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 98.1
Human 98.1
Leisure Activities 95.8
Musical Instrument 90
Violin 85.7
Fiddle 85.7
Viola 85.7
Musician 84.5
Cello 66.6
Gun 65.2
Weapon 65.2
Weaponry 65.2
Portrait 57.5
Photography 57.5
Face 57.5
Photo 57.5

Clarifai
created on 2023-10-15

people 99.9
one 98.6
adult 97.9
man 97.7
two 96.6
portrait 93.4
gun 91.5
monochrome 91.3
weapon 90.6
veil 89.8
lid 88.4
wear 87.6
music 87.2
musician 86.5
three 86.2
instrument 84.7
war 83.5
actor 80.8
boy 80.7
child 79.9

Imagga
created on 2021-12-15

person 28.6
man 28.2
outdoors 24.9
people 20.1
beach 18.8
male 18.6
adult 17.6
scholar 15.9
sitting 15.5
summer 15.4
outdoor 14.5
attractive 14
men 13.7
sand 13.5
intellectual 12.7
sea 12.5
vacation 12.3
water 12
happy 11.9
recreation 11.7
guy 11.6
lifestyle 11.6
landscape 11.2
newspaper 11.1
love 11.1
active 11
sky 10.8
pretty 10.5
day 10.2
musical instrument 10.2
ocean 10.1
relaxation 10.1
sport 10
looking 9.6
work 9.4
casual 9.3
relax 9.3
portrait 9.1
fun 9
rifle 8.9
businessman 8.8
product 8.7
child 8.6
equipment 8.6
business 8.5
travel 8.5
leisure 8.3
human 8.2
park 8.2
alone 8.2
activity 8.1
shovel 8.1
sexy 8
holiday 7.9
couple 7.8
rustic 7.8
outside 7.7
youth 7.7
stone 7.6
desert 7.5
life 7.4
tool 7.3
peaceful 7.3
sunglasses 7.3
gorgeous 7.3
gun 7.2
suit 7.2
sunset 7.2
coast 7.2
face 7.1
working 7.1
stringed instrument 7.1
look 7

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

outdoor 99.2
text 98.9
person 98.3
clothing 69.6
black and white 60.3
weapon 52.1
photograph 51.5
man 51.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 30-46
Gender Female, 57.3%
Calm 90.9%
Sad 3.9%
Angry 3.2%
Happy 0.5%
Confused 0.5%
Fear 0.5%
Surprised 0.4%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%
Gun 65.2%

Captions