Human Generated Data

Title

Untitled (medicine show, Huntingdon, Tennessee)
Date

October 1935, printed later
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3602

Human Generated Data

Title

Untitled (medicine show, Huntingdon, Tennessee)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3602

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Sun Hat 100
Face 99.8
Head 99.8
Photography 99.8
Portrait 99.8
Hat 98.8
Person 98.7
Adult 98.7
Male 98.7
Man 98.7
Person 98.4
Adult 98.4
Bride 98.4
Female 98.4
Wedding 98.4
Woman 98.4
Hat 98
Person 95.9
Adult 95.9
Male 95.9
Man 95.9
Person 92.4
Adult 92.4
Male 92.4
Man 92.4
Formal Wear 90.1
Suit 90.1
Brick 74.3
Person 71.4
Smoke 68.9
Hat 57.2
Cowboy Hat 55

Clarifai
created on 2018-05-10

people 99.7
lid 99.7
veil 99.3
fedora 98.6
man 97.5
adult 97.4
group 95.9
wear 95.3
leader 95
elderly 95
group together 94.3
outfit 93.1
administration 91.8
cowboy hat 91.7
two 91.6
facial expression 88.1
portrait 87.8
cowboy 84.8
three 84.7
actor 82.9

Imagga
created on 2023-10-06

hat 100
cowboy hat 59.4
headdress 39.5
man 37.7
clothing 34
male 33.4
person 33.4
portrait 31.1
face 27.7
people 27.3
grandfather 26.5
cowboy 25
happy 24.5
adult 23.9
senior 22.5
smile 22.1
outdoors 20.9
smiling 19.5
shirt 17.8
old 17.4
men 16.3
looking 16
old-timer 15.3
hand 15.2
mature 14.9
couple 14.8
attractive 14.7
western 14.5
casual 14.4
hair 14.3
happiness 14.1
guy 13.9
consumer goods 13.8
covering 13.8
outside 13.7
straw 13.5
beach 13.5
one 13.4
elderly 13.4
mustache 13.3
lifestyle 13
summer 12.9
fashion 12.8
pretty 12.6
handsome 12.5
look 12.3
boy 12.2
style 11.9
head 11.8
model 11.7
sombrero 11.3
fun 11.2
expression 11.1
two 11
cowgirl 10.9
black 10.8
leisure 10.8
cute 10.8
posing 10.7
child 10.5
husband 10.5
horse 10.4
love 10.3
outdoor 9.9
eye 9.8
vacation 9.8
human 9.8
standing 9.6
wearing 9.5
beard 9.5
oriental 9.4
enjoy 9.4
farmer 9.3
hold 9.2
dark 9.2
cheerful 8.9
sexy 8.8
worker 8.8
together 8.8
work 8.6
serious 8.6
close 8.6
industry 8.5
joy 8.4
pose 8.2
brown 8.1
romance 8
farm 8
romantic 8
kid 8
brunette 7.8
play 7.8
affection 7.7
construction 7.7
married 7.7
sky 7.7
enjoying 7.6
smoke 7.4
vintage 7.4
suit 7.3
alone 7.3
lady 7.3
make 7.3
sun 7.2
family 7.1
travel 7
sea 7
autumn 7

Google
created on 2018-05-10

photograph 96.5
man 94.3
black and white 93
monochrome photography 88
photography 84.8
snapshot 81.8
gentleman 81.4
fashion accessory 81.3
male 80.6
headgear 79.4
monochrome 72.1
interaction 70.5
fedora 60.9
stock photography 57.9
smile 57.3
hat 54.5
vintage clothing 54.5
portrait 51.4
portrait photography 50.7

Microsoft
created on 2018-05-10

person 99.7
man 98.4
hat 96.8
outdoor 89.2
old 56.3
crowd 1.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 98.3%
Surprised 6.6%
Fear 5.9%
Sad 2.2%
Disgusted 0.3%
Happy 0.3%
Angry 0.2%
Confused 0.1%

Microsoft Cognitive Services

Age 24
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 98.8%
Person 98.7%
Adult 98.7%
Male 98.7%
Man 98.7%
Bride 98.4%
Female 98.4%
Woman 98.4%
Suit 90.1%

Categories

Imagga

paintings art 95.5%
people portraits 2.2%
pets animals 1.4%

Captions

Microsoft
created on 2018-05-10

a man wearing a hat 97.6%
a man wearing a black hat 96.4%
a man wearing a suit and hat 96.3%