Human Generated Data

Title

Untitled (Columbus, Ohio)
Date

August 1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.233
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Columbus, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.233

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Sitting 99.9
Person 99.7
Adult 99.7
Male 99.7
Man 99.7
Person 99.2
Adult 99.2
Male 99.2
Man 99.2
Clothing 97.6
Hat 97.6
Face 94
Head 94
Photography 94
Portrait 94
Pants 82.8
Cap 78.2
Footwear 75.8
Shoe 75.8
Body Part 57.3
Hand 57.3
Baseball Cap 56.8
Finger 56.7
Bench 56.7
Furniture 56.7
Shirt 55.8
Garden 55.5
Gardening 55.5
Nature 55.5
Outdoors 55.5
Brick 55.4
Text 55.2
Reading 55.1

Clarifai
created on 2018-05-11

people 99.9
man 97.6
adult 97.6
two 93.3
sit 93.2
group together 92.7
elderly 92.2
three 92.2
woman 91
portrait 91
group 90.2
administration 89.6
wear 86
war 85.5
four 83.4
military 83.3
sitting 83.2
uniform 82.1
several 79.3
actor 76.8

Imagga
created on 2023-10-05

senior 48.7
grandfather 46.4
man 45
elderly 39.2
person 33
male 32.7
retired 31
people 30.7
couple 26.1
retirement 25.9
old 25.8
happy 25.7
mature 25.1
adult 23.1
home 23.1
smiling 21
patient 20.7
portrait 19.4
together 18.4
camera 16.6
70s 15.7
older 15.5
sitting 15.5
family 15.1
medical 15
cap 15
surgeon 14.7
men 14.6
married 14.4
love 14.2
glasses 13.9
pensioner 13.3
happiness 13.3
health 13.2
smile 12.8
father 12.7
half length 12.7
kin 12.4
doctor 12.2
casual 11.9
women 11.9
active 11.8
aged 11.8
worker 11.6
husband 11.4
nurse 11.4
grandma 11.4
wife 11.4
laughing 11.3
professional 11.2
lifestyle 10.8
grandmother 10.8
old-timer 10.6
shower cap 10.5
hospital 10.5
outdoors 10.4
room 10.4
enjoying 10.4
work 10.3
leisure 10
facing camera 9.9
sick person 9.9
seniors 9.8
surgery 9.8
case 9.8
indoors 9.7
illness 9.5
hair 9.5
day 9.4
friendship 9.4
hand 9.1
relaxing 9.1
care 9.1
medicine 8.8
casual clothing 8.8
dad 8.6
adults 8.5
friends 8.5
emotion 8.3
fun 8.2
teacher 8.2
lady 8.1
to 8
surgical 7.9
gray hair 7.9
face 7.8
mask 7.7
aging 7.7
relaxed 7.5
human 7.5
holding 7.4
joyful 7.3
occupation 7.3
gray 7.2
looking 7.2
equipment 7.2
working 7.1

Google
created on 2018-05-11

photograph 96.3
sitting 93
person 92.8
black and white 92
human behavior 84.1
monochrome photography 83.5
snapshot 81.8
photography 81.5
standing 78.7
human 71.1
monochrome 68.1
vintage clothing 64.6
senior citizen 62.8
stock photography 62.7
family 60
gentleman 54.7
conversation 51.3
elder 50.5

Microsoft
created on 2018-05-11

person 95.2
outdoor 93.2
old 72.1
older 23.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 66-76
Gender Male, 100%
Angry 62.8%
Calm 27.6%
Confused 7%
Surprised 6.4%
Fear 6%
Sad 2.5%
Disgusted 0.6%
Happy 0.5%

Microsoft Cognitive Services

Age 74
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Adult
Male
Man
Shoe
Person 99.7%
Person 99.2%
Adult 99.7%
Adult 99.2%
Male 99.7%
Male 99.2%
Man 99.7%
Man 99.2%
Shoe 75.8%

Categories

Imagga

people portraits 56.2%
paintings art 41.4%
pets animals 2.1%

Captions

Microsoft
created on 2018-05-11

a vintage photo of a man sitting on a bench 84.5%
a man sitting on a bench 83.9%
a vintage photo of a man 83.8%

Text analysis

Amazon

25
E
25 C
O
STO O
STO
C