Human Generated Data

Title

Untitled (New York City)
Date

1932-1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3033
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3033

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Face 100
Head 100
Photography 100
Portrait 100
Baseball Cap 100
Cap 100
Clothing 100
Person 99.3
Adult 99.3
Male 99.3
Man 99.3
Person 99.1
Adult 99.1
Male 99.1
Man 99.1
Person 96.8
People 77.2
Hat 71.6
Hat 66.6
Military 60.3
Firearm 59.6
Weapon 59.6
Body Part 57.9
Finger 57.9
Hand 57.9
Coat 57.7
Military Uniform 56.6
Captain 56.6
Officer 56.6
Gun 56
Rifle 56
Jacket 55.4
Soldier 55.2

Clarifai
created on 2018-05-10

people 99.9
adult 98.8
man 98.7
one 98.5
lid 98.3
portrait 98.3
veil 97.7
wear 97.1
administration 90.7
military 90.4
leader 89.1
elderly 88.7
outfit 87.6
war 85.5
group 84.1
two 83.5
facial hair 83.4
three 82.6
soldier 82.2
uniform 79.8

Imagga
created on 2023-10-06

grandfather 89.8
man 44.4
senior 42.2
hat 40.8
male 38.6
people 31.8
happy 30.1
couple 28.8
elderly 28.7
portrait 28.5
person 27.8
outdoors 26.9
old 26.5
mature 26
adult 24.6
retirement 20.2
together 20.2
casual 19.5
smile 19.2
love 18.9
smiling 18.8
cowboy 17.9
face 17.8
father 17.5
retired 17.5
men 17.2
two 16.9
lifestyle 16.6
happiness 16.5
husband 16.2
looking 16
parent 15.6
affection 15.5
wife 15.2
handsome 15.2
dad 14.5
aged 14.5
hair 14.3
family 14.2
mother 13.7
western 13.6
married 13.4
shirt 13.1
70s 12.8
clothing 12.7
style 12.6
loving 12.4
age 12.4
guy 12.3
child 12.2
standing 12.2
hand 12.2
model 11.7
older 11.7
affectionate 11.6
romantic 11.6
relationship 11.2
home 10.4
expression 10.2
park 9.9
romance 9.8
fashion 9.8
attractive 9.8
lady 9.7
middle aged 9.7
fun 9.7
wearing 9.5
horse 9.5
outside 9.4
cowboy hat 9.3
hairdresser 9.2
grandma 9.2
close 9.1
old-timer 9
cheerful 8.9
interior 8.8
grandmother 8.8
60s 8.8
look 8.8
boy 8.7
work 8.6
pair 8.5
friendship 8.4
emotion 8.3
relaxing 8.2
pose 8.2
beard 8.2
active 8.1
posing 8
cowgirl 7.9
gray hair 7.9
hug 7.7
aging 7.7
gesture 7.6
adults 7.6
laughing 7.6
head 7.6
friends 7.5
hold 7.4
countryside 7.3
children 7.3
gray 7.2

Google
created on 2018-05-10

photograph 96.3
soldier 89.4
black and white 87.9
military officer 86
military person 84.6
standing 82.7
snapshot 81.8
military 79.5
vintage clothing 76
monochrome photography 75.9
monochrome 68.9
human behavior 66.6
headgear 66.5
troop 61.4
non commissioned officer 59.6
staff 57.9
stock photography 56.2
senior citizen 55
militia 54.9

Microsoft
created on 2018-05-10

person 98.9
old 96.2
man 95.8
older 32.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.1%
Happy 0%
Confused 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 41-49
Gender Male, 100%
Calm 98%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Happy 0.6%
Confused 0.4%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 38-46
Gender Male, 89.2%
Calm 96.3%
Surprised 6.4%
Fear 6.3%
Sad 2.4%
Happy 0.8%
Confused 0.4%
Angry 0.2%
Disgusted 0.1%

Microsoft Cognitive Services

Age 41
Gender Male

Microsoft Cognitive Services

Age 59
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Adult 99.3%
Male 99.3%
Man 99.3%
Hat 71.6%

Categories

Imagga

people portraits 76.9%
events parties 17.5%
paintings art 2.6%

Captions

Microsoft
created on 2018-05-10

a vintage photo of a man 97.2%
a vintage photo of a man wearing a hat 96%
an old photo of a man 95.9%