Human Generated Data

Title

Untitled (older man and teenager kneeling to look at gun)

Date

c. 1975

People

Artist: Ken Whitmire Associates, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1386

Human Generated Data

Title

Untitled (older man and teenager kneeling to look at gun)

People

Artist: Ken Whitmire Associates, American

Date

c. 1975

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.7
Human 99.7
Person 99.6
Hat 98.9
Clothing 98.9
Apparel 98.9
Hat 95.6
Brass Section 86.8
Musical Instrument 86.8
Horn 86.8
Outdoors 79.9
Field 77.9
Leisure Activities 70.9
Musician 68.5
Photo 65.1
Portrait 65.1
Face 65.1
Photography 65.1
Trumpet 62.8
Cornet 62.8
Shoe 57.2
Footwear 57.2

Imagga
created on 2022-01-22

musical instrument 73
banjo 68.8
brass 63
stringed instrument 55.8
wind instrument 49
field 34.3
people 26.2
person 22.9
country 22.8
male 22.7
adult 22.6
cornet 22.6
man 22.2
outdoors 20.9
portrait 20
autumn 19.3
happiness 18.8
hay 18.6
summer 18.6
outdoor 18.3
outside 18
happy 17.5
grass 17.4
youth 17
child 16.2
rural 15.8
fun 15.7
park 15.6
straw 15.4
smiling 15.2
joy 15
agriculture 14.9
hat 14.6
countryside 14.6
boy 13.9
children 13.7
attractive 13.3
forest 13
lifestyle 13
casual 12.7
active 12.6
meadow 12.5
farm 12.5
model 12.4
holding 12.4
sax 11.9
bales 11.8
cute 11.5
face 11.4
pretty 11.2
love 11
leisure 10.8
kid 10.6
look 10.5
enjoy 10.3
harvest 10.3
sitting 10.3
trombone 10
smile 10
cowboy 10
hand 9.9
bale 9.8
posing 9.8
human 9.7
together 9.6
looking 9.6
couple 9.6
jeans 9.5
wheat 9.5
farming 9.5
golden 9.4
day 9.4
natural 9.4
two 9.3
relax 9.3
emotion 9.2
farmer 9.2
girls 9.1
old 9
cheerful 8.9
family 8.9
women 8.7
crop 8.4
rest 8.3
teen 8.3
teenager 8.2
fall 8.1
activity 8.1
handsome 8
worker 8
yellow 7.9
hair 7.9
leaves 7.9
barn 7.8
brunette 7.8
agricultural 7.8
color 7.8
play 7.7
western 7.7
men 7.7
hiking 7.7
expression 7.7
serious 7.6
sit 7.6
plant 7.5
shirt 7.5
playing 7.3
pose 7.2
working 7.1
work 7.1
sky 7

Google
created on 2022-01-22

Clothing 98.7
Shoe 96.1
Photograph 94.2
Hat 93.2
Plant 92.5
Vertebrate 91.9
Musical instrument 88.3
Sun hat 85.3
Gesture 85.3
Guitar 82.7
Grass 82.6
Cap 75.8
Fedora 75.8
Monochrome photography 74.1
Vintage clothing 72.6
Monochrome 72.4
Cowboy hat 71.4
Boot 69.8
Sitting 67.6
Photo caption 64.9

Microsoft
created on 2022-01-22

person 99.7
outdoor 99.6
clothing 98.2
hat 94.4
black and white 92.2
man 91.1
human face 86.3
fashion accessory 81.2
sun hat 73.3
smile 69.5
cowboy hat 67.8
text 59.9

Face analysis

Amazon

Google

AWS Rekognition

Age 53-61
Gender Male, 83.1%
Happy 68.8%
Calm 12.1%
Confused 7.5%
Sad 4.2%
Surprised 3.6%
Angry 1.6%
Fear 1.2%
Disgusted 1%

AWS Rekognition

Age 18-26
Gender Male, 99.3%
Calm 88.7%
Sad 9.1%
Confused 0.6%
Disgusted 0.5%
Angry 0.5%
Surprised 0.2%
Fear 0.2%
Happy 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Hat 98.9%
Shoe 57.2%

Captions

Microsoft

a man sitting on the grass 94.2%
a man is sitting in the grass 93.3%
a man sitting on a bench 88.7%