Human Generated Data

Title

Untitled (New York City)
Date

1932-1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2737
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2737

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Face 100
Head 100
Photography 100
Portrait 100
Cap 100
Clothing 100
Baseball Cap 100
People 99.3
Person 99.2
Adult 99.2
Male 99.2
Man 99.2
Person 99.1
Adult 99.1
Male 99.1
Man 99.1
Person 95.3
Coat 87
Firearm 83.8
Weapon 83.8
Person 82.1
Hat 77.8
Hat 71.6
Body Part 57.4
Finger 57.4
Hand 57.4
Gun 57.1
Rifle 57.1
Military 56.4
Jacket 56.2
Military Uniform 56

Clarifai
created on 2018-05-10

people 99.9
adult 99.1
lid 99.1
veil 99
man 98.6
portrait 98.5
wear 98.3
one 96.1
military 96.1
uniform 94.5
administration 92.7
two 92.4
war 91.9
outfit 91.8
three 89.9
soldier 89.7
facial expression 88.2
elderly 86.7
cap 86.5
military uniform 86.5

Imagga
created on 2023-10-06

hat 39.8
man 36.9
male 34.3
person 32.2
senior 30.9
outdoors 29.9
adult 29.1
happy 26.3
people 25.6
smile 21.4
mature 20.4
clothing 20.3
portrait 20.1
smiling 19.5
elderly 19.1
couple 18.3
men 18
old 16.7
happiness 16.4
casual 16.1
military uniform 16.1
face 15.6
looking 15.2
two 14.4
uniform 14.2
grandfather 14
together 14
oriental 13.3
standing 13
cowboy hat 12.8
child 11.7
leisure 11.6
retirement 11.5
lady 11.4
one 11.2
sitting 11.2
lifestyle 10.8
outdoor 10.7
wife 10.4
friends 10.3
cowboy 10
beard 9.9
active 9.9
attractive 9.8
cheerful 9.8
retired 9.7
husband 9.5
love 9.5
outside 9.4
shirt 9.3
model 9.3
world 9.2
emotion 9.2
joy 9.2
relaxing 9.1
park 9.1
aged 9
fashion 9
guy 9
summer 9
covering 8.8
60s 8.8
consumer goods 8.8
hair 8.7
wearing 8.6
expression 8.5
sit 8.5
engineer 8.5
sport 8.5
friendship 8.4
horizontal 8.4
hand 8.4
life 8.3
vacation 8.2
handsome 8
spectator 8
work 7.8
married 7.7
beach 7.6
fun 7.5
holding 7.4
style 7.4
color 7.2
father 7.2
posing 7.1

Google
created on 2018-05-10

photograph 95.9
soldier 88.4
black and white 87.5
military officer 84.9
military 83.8
standing 83.7
military person 83.4
snapshot 81.8
monochrome photography 76.4
monochrome 68.2
human behavior 65.4
army 64.9
vintage clothing 62.1
militia 61.8
troop 61.4
vehicle 60.7
stock photography 55.9
non commissioned officer 54
staff 53.4

Microsoft
created on 2018-05-10

man 96.2
outdoor 94.7
person 91.2
old 75.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.1%
Happy 0%
Angry 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 99.3%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.2%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 31-41
Gender Female, 77.6%
Calm 42.2%
Fear 35.3%
Sad 9.1%
Surprised 7.7%
Happy 4.6%
Confused 3.9%
Angry 2.8%
Disgusted 0.8%

Microsoft Cognitive Services

Age 52
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Adult 99.2%
Male 99.2%
Man 99.2%
Hat 77.8%

Captions

Microsoft
created on 2018-05-10

an old photo of a man 97.2%
a black and white photo of a man 95.2%
old photo of a man 95.1%