Human Generated Data

Title

San Quentin

Date

1971

People

Artist: Peter Beard, American born 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Richard and Ronay Menschel Fund for the Acquisition of Photographs, P2002.1.1

Human Generated Data

Title

San Quentin

People

Artist: Peter Beard, American born 1938

Date

1971

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.8
Human 99.8
Person 99.7
Person 97.8
Musician 97.3
Musical Instrument 97.3
Guitarist 97.3
Leisure Activities 97.3
Performer 97.3
Person 96.9
Guitar 94.5
Pedestrian 90.9
Shoe 80.2
Apparel 80.2
Footwear 80.2
Clothing 80.2
Overcoat 75.7
Suit 68.1
Photography 58
Photo 58
Face 55.5
Portrait 55.5
Coat 51.8

Imagga
created on 2022-01-08

wind instrument 48.5
musical instrument 41.1
brass 40.1
man 33.6
people 28.5
cornet 28.1
sax 25.7
business 25.5
male 24.8
men 21.5
businessman 20.3
person 20.2
silhouette 19.9
photographer 19.2
accordion 18.5
urban 18.4
adult 18.3
city 17.5
corporate 17.2
professional 15.5
black 15.2
keyboard instrument 14.8
suit 13.8
group 13.7
women 13.4
trombone 12.5
clothing 12.3
fashion 12.1
window 11.9
crowd 11.5
job 11.5
world 11.4
office 11.3
occupation 11
device 10.8
walking 10.4
building 10.3
executive 10.3
protection 10
danger 10
holding 9.9
success 9.7
life 9.6
musician 9.6
standing 9.6
work 9.4
manager 9.3
dark 9.2
outdoor 9.2
walk 8.6
travel 8.5
portrait 8.4
attractive 8.4
uniform 8.3
worker 8
day 7.8
architecture 7.8
scene 7.8
boss 7.6
career 7.6
power 7.6
bag 7.5
meeting 7.5
human 7.5
outdoors 7.5
style 7.4
street 7.4
back 7.3
industrial 7.3
team 7.2
shadow 7.2
night 7.1
military uniform 7.1
working 7.1
indoors 7
briefcase 7
modern 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

text 99.2
person 98.1
clothing 96.5
man 93.8
standing 91.2
musical instrument 90.5
black and white 84.3
posing 65
concert 57.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 84.4%
Sad 11.4%
Confused 1.7%
Surprised 0.8%
Happy 0.6%
Angry 0.6%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 23-31
Gender Male, 100%
Angry 49.7%
Sad 31.3%
Calm 12.2%
Confused 3.6%
Disgusted 1.1%
Fear 0.7%
Surprised 0.7%
Happy 0.7%

AWS Rekognition

Age 51-59
Gender Male, 99.9%
Calm 99.3%
Sad 0.4%
Confused 0.1%
Angry 0.1%
Fear 0%
Disgusted 0%
Surprised 0%
Happy 0%

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Guitar 94.5%
Shoe 80.2%
Coat 51.8%

Captions

Microsoft

a man standing in front of a group of people posing for a photo 83.4%
a man standing in front of a group of people posing for the camera 83.3%
a group of people standing in front of a building 83.2%

Text analysis

Amazon

Beard
summer
1972
Quentin
(T.C.
San
Peter Beard
5675 San Quentin summer (T.C.
Peter
5675

Google

aummer
tiBebley
Beanedlis
Quenten
L15 Sam Quenten aummer T.c, tiBebley Beanedlis
Sam
L15
T.c,