Human Generated Data

Title

Untitled (Ohio?)

Date

c. 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3522

Human Generated Data

Title

Untitled (Ohio?)

People

Artist: Ben Shahn, American 1898 - 1969

Date

c. 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3522

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Hat 99.8
Clothing 99.8
Apparel 99.8
Hat 99.7
Person 99.6
Human 99.6
Person 99.6
Person 97.5
Person 89.3
Sun Hat 87.1
Overcoat 83.6
Coat 83.6
Suit 82.5
Suit 80.5
Cowboy Hat 58.7
People 58.5
Handrail 57.3
Banister 57.3
Tarmac 57.3
Asphalt 57.3

Clarifai
created on 2023-10-25

lid 99.9
people 99.9
man 99.4
veil 98.8
fedora 98.4
portrait 98
two 98
three 97.5
adult 97.4
elderly 95
group 94.8
group together 93.6
administration 92
leader 89.6
law 88.6
retro 87.8
train 86.7
railway 86.4
cowboy 86.3
four 85.8

Imagga
created on 2022-01-08

hat 100
cowboy hat 72.9
headdress 65.8
clothing 54.4
man 49.1
male 41.9
person 37.9
suit 34.6
sombrero 33.1
portrait 28.5
people 27.3
covering 27.2
adult 27.2
consumer goods 25.3
handsome 20.5
businessman 20.3
face 19.2
men 18.9
business 18.8
happy 17.5
cowboy 17
smile 16.4
black 15.7
hand 15.2
senior 15
shirt 14.9
one 14.9
guy 14.7
smiling 13.7
looking 13.6
attractive 13.3
model 13.2
professional 12.8
scholar 12.2
style 11.9
work 11.8
old-timer 11.7
worker 11.6
western 11.6
job 11.5
executive 11.4
tie 11.4
fashion 11.3
standing 11.3
corporate 11.2
old 11.2
two 11
occupation 11
engineer 10.8
look 10.5
success 10.5
couple 10.5
outdoors 10.5
smart 10.4
hair 10.3
intellectual 9.8
serious 9.5
construction 9.4
garment 9.4
industry 9.4
expression 9.4
manager 9.3
studio 9.1
posing 8.9
working 8.8
together 8.8
boy 8.7
love 8.7
helmet 8.7
outside 8.6
meeting 8.5
mature 8.4
dark 8.4
bow tie 8.3
holding 8.3
human 8.3
pose 8.2
cap 8.1
lifestyle 8
building 7.9
happiness 7.8
architect 7.7
elegant 7.7
pretty 7.7
mystery 7.7
youth 7.7
formal 7.6
casual 7.6
wearing 7.6
horse 7.6
career 7.6
head 7.6
pair 7.6
site 7.5
fun 7.5
necktie 7.4
safety 7.4
friendly 7.3
builder 7.2
eye 7.2

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

person 100
man 99.9
fashion accessory 99.8
fedora 99.5
cowboy hat 97.9
sun hat 96.5
clothing 96.1
hat 94.8
human face 86.3
looking 85.8
suit 83.8
window 82.6
wearing 81.4
text 78.5
standing 77.8
black and white 65.4
old 52.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 52-60
Gender Male, 100%
Calm 80.7%
Angry 15.6%
Sad 1.7%
Confused 0.9%
Disgusted 0.5%
Surprised 0.3%
Fear 0.2%
Happy 0.1%

AWS Rekognition

Age 25-35
Gender Male, 100%
Angry 37.7%
Confused 37.7%
Disgusted 9.2%
Calm 7.8%
Surprised 2.7%
Sad 2.6%
Fear 1.4%
Happy 1%

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Calm 96.3%
Sad 3.2%
Confused 0.1%
Fear 0.1%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 67-77
Gender Male, 99.9%
Calm 93.9%
Angry 5.9%
Surprised 0%
Confused 0%
Sad 0%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 39-47
Gender Female, 64.6%
Calm 76.8%
Disgusted 6.1%
Angry 5.4%
Sad 4.8%
Surprised 2.3%
Confused 2%
Happy 1.6%
Fear 0.9%

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.8%
Person 99.6%
Suit 82.5%

Captions