Human Generated Data

Title

Untitled (Virgil Thaxton, near Mechanicsburg, Ohio)
Date

July 1938-August 1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2757
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Virgil Thaxton, near Mechanicsburg, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 1938-August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2757

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 100
Hat 99.4
Adult 99.2
Male 99.2
Man 99.2
Person 99.2
Animal 95.4
Mammal 95.4
Pig 95.4
Face 93.1
Head 93.1
Photography 93.1
Portrait 93.1
Person 83.7
Livestock 76.6
Sheep 76.6
Outdoors 76
Sun Hat 74
Pig 73.8
Nature 60.5
Hog 58

Clarifai
created on 2018-05-10

people 100
one 99.6
adult 99.5
two 99
man 98.3
lid 97.1
wear 96.5
veil 95.9
mammal 94.5
group 92.5
three 91.8
portrait 89.6
group together 87.4
leader 87.2
administration 87.1
canine 87
vehicle 85.3
watercraft 81.7
four 80.2
dog 78.7

Imagga
created on 2023-10-05

hat 39.1
cowboy hat 22.3
male 22.1
person 21.7
man 20.8
old 19.5
cowboy 19
building 18.5
people 18.4
clothing 18.4
statue 18.3
sculpture 17.1
adult 16.9
outdoors 16.4
headdress 14.1
pen 12.7
architecture 12.5
stone 11.8
portrait 11.6
structure 11.2
men 11.2
face 10.7
happy 10.6
travel 10.6
enclosure 10.6
culture 10.3
house 10
lady 9.7
senior 9.4
seller 9.2
city 9.1
tourism 9.1
child 9.1
black 9
religion 9
art 8.7
ancient 8.6
two 8.5
builder 8.4
hand 8.4
covering 8.3
vintage 8.3
uniform 8
military uniform 7.9
hair 7.9
urban 7.9
consumer goods 7.9
outside 7.7
construction 7.7
outdoor 7.6
horse 7.6
human 7.5
emotion 7.4
water 7.3
lifestyle 7.2
body 7.2
home 7.2
history 7.2
smile 7.1
guy 7.1
job 7.1
working 7.1
worker 7

Google
created on 2018-05-10

photograph 95.5
black and white 92
man 91.7
monochrome photography 83.8
snapshot 81.8
male 81.4
monochrome 71
human 70
human behavior 66.6
stock photography 54.5

Microsoft
created on 2018-05-10

person 95.2
outdoor 90.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Calm 89.6%
Surprised 8.2%
Fear 6.2%
Angry 2.9%
Sad 2.2%
Disgusted 1.5%
Confused 0.8%
Happy 0.7%

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.4%
Adult 99.2%
Male 99.2%
Man 99.2%
Person 99.2%
Pig 95.4%
Sheep 76.6%

Captions

Microsoft
created on 2018-05-10

an old photo of a man 76.7%
a man standing next to a window 53.2%
a man wearing a hat 53.1%