Human Generated Data

Title

Untitled (Morgantown, Scotts Run, West Virginia)
Date

October 1935, printed later
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3370
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Morgantown, Scotts Run, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3370

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Clothing 100
Coat 100
Face 100
Head 100
Photography 100
Portrait 100
Hat 99.9
Person 99.7
Adult 99.7
Male 99.7
Man 99.7
Cap 76.4
Sun Hat 61.1
People 57.6
Baseball Cap 57.6
Smoke 56.7
Outdoors 56.2
Jacket 55.9
Garden 55.6
Gardener 55.6
Gardening 55.6
Nature 55.6
Overcoat 55.6
Formal Wear 55.4
Suit 55.4

Clarifai
created on 2018-05-10

people 99.9
adult 98.7
man 97.9
portrait 97.3
lid 96.7
wear 96.7
one 96.6
uniform 91.8
monochrome 89.2
military 89.1
veil 87.4
outfit 86
war 84.6
administration 83.3
recreation 81
retro 79.2
child 78.5
indoors 77.4
three 77.2
musician 76.1

Imagga
created on 2023-10-07

bow tie 81.1
necktie 67.1
man 49.7
male 44.7
person 37.3
businessman 34.4
garment 33.9
adult 31.8
business 29.2
portrait 29.1
professional 28.9
people 26.2
work 25.9
office 24.2
looking 24
men 23.2
clothing 21.3
smiling 20.3
computer 20
working 19.4
serious 19.1
handsome 18.7
smile 18.5
suit 18.4
doctor 17.9
job 16.8
corporate 16.3
worker 15.7
one 15.7
black 15.6
lifestyle 15.2
hospital 15
medicine 15
mature 14.9
standing 14.8
bartender 14.4
happy 14.4
tie 14.2
face 14.2
stethoscope 14.2
executive 14
medical 13.2
indoors 13.2
manager 13
success 12.9
occupation 12.8
laptop 12.8
casual 12.7
care 12.3
desk 12.3
senior 12.2
uniform 12.1
glasses 12
coat 12
student 11.9
technology 11.9
confident 11.8
old 11.1
employee 11
elderly 10.5
look 10.5
attractive 10.5
health 10.4
shirt 10.3
head 10.1
human 9.7
call 9.7
telephone 9.7
thinking 9.5
guy 9.5
happiness 9.4
friendly 9.1
indoor 9.1
waiter 9.1
color 8.9
hair 8.7
busy 8.7
education 8.7
clinic 8.6
sitting 8.6
studio 8.4
hand 8.4
camera 8.3
holding 8.3
jacket 8.2
surgeon 7.8
physician 7.8
masculine 7.8
expertise 7.8
exam 7.7
profession 7.7
help 7.4
dining-room attendant 7.3
old-timer 7.3
cheerful 7.3
patient 7

Google
created on 2018-05-10

photograph 95.8
black and white 92.4
monochrome photography 84.3
snapshot 81.8
male 80.9
photography 80.6
standing 78.6
monochrome 69.7
human behavior 67.5
vintage clothing 55.1
stock photography 54.6
gentleman 51.7

Microsoft
created on 2018-05-10

man 98.5
person 97.2
old 75

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-44
Gender Male, 100%
Sad 100%
Surprised 6.3%
Fear 6%
Angry 4.3%
Calm 3.2%
Happy 0.3%
Confused 0.2%
Disgusted 0.1%

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Adult 99.7%
Male 99.7%
Man 99.7%

Captions

Microsoft
created on 2018-05-10

an old photo of a man 92.4%
a black and white photo of a man 89.8%
a man wearing a black hat 87.6%

Text analysis

Amazon

WHEAT
AK
MILLO-
VINO
VINO MELLO
MELLO
AK SACK T
T
WHEAT WHEAT
SACK
NISAS WHEAT
MILLO
05 MILLO MILLO-
WA
05
NISAS

Google

SAck 7
SAck
7