Human Generated Data

Title

Untitled (New York City)
Date

1932-1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.671
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.671

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Baseball Cap 100
Cap 100
Clothing 100
Face 100
Head 100
Photography 100
Portrait 100
Person 99.3
Adult 99.3
Male 99.3
Man 99.3
Person 99
Adult 99
Male 99
Man 99
People 98.5
Person 95.7
Male 95.7
Boy 95.7
Child 95.7
Coat 82.3
Jacket 81.8
Person 71
Hat 64.3
Military 57.4
Body Part 57.4
Finger 57.4
Hand 57.4
Hat 56.5
Military Uniform 56.1
Accessories 55.1
Glasses 55.1
Soldier 55.1

Clarifai
created on 2018-05-10

people 99.9
adult 99
portrait 98.9
lid 98.9
man 98.3
one 98.2
veil 98.1
wear 97
military 89.9
two 89.6
three 89.5
group 89.5
war 88.7
facial expression 87.7
administration 87.6
outfit 85.1
facial hair 82.6
cowboy hat 82.5
elderly 80.1
cap 79.2

Imagga
created on 2023-10-05

military uniform 62
uniform 51.5
hat 47.3
man 44.3
clothing 43.1
grandfather 42.8
male 38.5
person 30.7
senior 30
people 29.6
old 29.3
portrait 27.2
consumer goods 27
covering 26.7
elderly 23
happy 21.3
adult 20.1
outdoors 19.4
smile 19.2
mature 18.6
face 18.5
couple 18.3
men 16.3
two 16.1
cowboy 15.7
together 14.9
guy 14.9
model 14.8
father 14.6
aged 14.5
hair 14.3
family 14.2
shirt 14
hand 13.7
western 13.6
happiness 13.3
casual 12.7
style 12.6
smiling 12.3
commodity 12.3
cowboy hat 12.1
love 11.8
retired 11.6
parent 11.4
lady 11.4
looking 11.2
beard 11.1
kin 11
mother 11
dad 11
lifestyle 10.8
handsome 10.7
retirement 10.6
human 10.5
pose 10
fashion 9.8
older 9.7
one 9.7
boy 9.6
age 9.5
vintage 9.1
black 9
private 9
posing 8.9
70s 8.8
child 8.8
husband 8.6
loving 8.6
wearing 8.6
close 8.6
wife 8.5
expression 8.5
relationship 8.4
head 8.4
attractive 8.4
leisure 8.3
retro 8.2
old-timer 8.2
interior 8
country 7.9
standing 7.8
pair 7.6
headdress 7.6
emotion 7.4
cheerful 7.3
active 7.2
activity 7.2
history 7.2
romantic 7.1
work 7.1
look 7

Google
created on 2018-05-10

photograph 95.9
human behavior 83.1
soldier 82.9
snapshot 81.8
vintage clothing 78.1
military officer 76.7
military person 75.5
military 69.6
headgear 69.5
black and white 67.7
senior citizen 60.2

Microsoft
created on 2018-05-10

person 99.4
man 93
military uniform 87
old 72.9
older 26.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.1%
Happy 0.1%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 48-54
Gender Male, 100%
Calm 99.2%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.2%
Disgusted 0.2%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 42-50
Gender Female, 59.5%
Calm 87.3%
Fear 7.4%
Surprised 6.7%
Happy 3.5%
Sad 2.6%
Confused 2.1%
Angry 0.6%
Disgusted 0.3%

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Adult 99.3%
Male 99.3%
Man 99.3%
Boy 95.7%
Child 95.7%
Hat 64.3%

Categories

Imagga

people portraits 92.2%
paintings art 6%

Captions

Microsoft
created on 2018-05-10

a man wearing a hat 95.7%
an old photo of a man 95.5%
a man wearing a uniform 94.8%