Human Generated Data

Title

Untitled (Columbus, Ohio)
Date

August 1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2483
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Columbus, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2483

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Sitting 99.9
Person 99.7
Adult 99.7
Male 99.7
Man 99.7
Person 99.3
Adult 99.3
Male 99.3
Man 99.3
Face 95
Head 95
Photography 95
Portrait 95
Clothing 89.5
Footwear 89.5
Shoe 89.5
Pants 89.2
Body Part 87.1
Finger 87.1
Hand 87.1
Furniture 62.2
Architecture 57.7
Building 57.7
House 57.7
Housing 57.7
Staircase 57.7
Bench 57.4
Shirt 57.3
Brick 57.3
Hat 56
Stick 55.8
Reading 55.1

Clarifai
created on 2018-05-10

people 99.9
man 98.7
adult 98.2
sit 96.2
two 95.9
elderly 95.8
woman 94.6
group 94.1
group together 93.6
portrait 93.2
three 93
wear 90.3
four 88.9
administration 88.7
war 86.5
street 85.8
sitting 85.1
several 84.4
military 84.2
lid 78.3

Imagga
created on 2023-10-07

grandfather 54.9
senior 54.3
man 49.7
elderly 41.2
person 34.9
old 34.8
male 34
retired 31
people 30.1
mature 27.9
retirement 27.8
happy 27.6
portrait 25.9
adult 25.5
couple 25.3
old-timer 25.2
home 22.3
smiling 21
men 18.9
older 18.4
patient 17.8
glasses 17.6
casual 16.9
camera 16.6
pensioner 16.2
love 15.8
70s 15.7
smile 15.7
face 15.6
looking 15.2
kin 14.9
happiness 14.9
sitting 14.6
family 14.2
together 14
aged 13.6
grandmother 12.7
outdoors 12.7
hair 12.7
father 12.5
age 12.4
medical 12.4
wife 12.3
lifestyle 12.3
grandma 12.1
surgeon 12
half length 11.7
married 11.5
husband 11.4
laughing 11.3
seniors 10.8
indoors 10.5
enjoying 10.4
doctor 10.3
cap 10.2
active 10.1
leisure 10
gray 9.9
facing camera 9.9
health 9.7
hand 9.1
sick person 9.1
professional 9.1
lady 8.9
case 8.9
handsome 8.9
worker 8.9
gray hair 8.9
60s 8.8
look 8.8
work 8.7
women 8.7
day 8.6
room 8.6
friends 8.5
relaxed 8.4
joyful 8.3
relaxing 8.2
hospital 7.9
surgery 7.8
nurse 7.7
illness 7.6
serious 7.6
marriage 7.6
one person 7.5
care 7.4
cheerful 7.3
business 7.3
romance 7.1
romantic 7.1
dad 7.1
to 7.1
working 7.1
businessman 7.1
medicine 7

Google
created on 2018-05-10

photograph 96.3
sitting 94.2
person 94
black and white 92.2
human behavior 85.4
monochrome photography 84.6
standing 83.5
photography 83.2
snapshot 81.8
senior citizen 74.2
family 69.4
monochrome 68.9
human 68.5
gentleman 64
vintage clothing 62.9
conversation 58.9
stock photography 57.8

Microsoft
created on 2018-05-10

outdoor 98
person 96.2
sitting 94.1
old 78.5
older 29.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 66-76
Gender Male, 100%
Angry 93.1%
Surprised 6.3%
Fear 5.9%
Confused 4.3%
Sad 2.2%
Calm 1.7%
Disgusted 0.2%
Happy 0.1%

Microsoft Cognitive Services

Age 75
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Adult
Male
Man
Shoe
Person 99.7%
Person 99.3%
Adult 99.7%
Adult 99.3%
Male 99.7%
Male 99.3%
Man 99.7%
Man 99.3%
Shoe 89.5%

Categories

Imagga

paintings art 52.8%
people portraits 45.8%
pets animals 1.1%

Captions

Microsoft
created on 2018-05-10

a man sitting on a bench 91.1%
an old man sitting on a bench 90.3%
an old photo of a man sitting on a bench 90.2%

Text analysis

Amazon

25
E
STO
STO O
O
25 C
C