Human Generated Data

Title

Untitled (Ohio?)
Date

c. 1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3508

Human Generated Data

Title

Untitled (Ohio?)

People

Artist: Ben Shahn, American 1898 - 1969

Date

c. 1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 100
Apparel 100
Hat 99.9
Person 99.5
Human 99.5
Person 98.6
Person 98.4
Hat 97.7
Overcoat 87.9
Coat 87.9
Person 83
Cowboy Hat 72.4
Sun Hat 70.8
Jacket 55.9
Pants 55.2
Suit 55

Imagga
created on 2022-01-08

cowboy hat 100
hat 100
headdress 73.9
clothing 67.8
man 41
male 39
consumer goods 35.4
covering 34.9
portrait 31.7
person 31.7
people 27.9
military uniform 27.6
adult 25.9
uniform 25
smile 22.1
happy 21.3
cowboy 21.2
shirt 20.5
smiling 19.5
face 19.2
sombrero 18.7
handsome 18.7
suit 17.7
senior 15.9
western 15.5
attractive 15.4
two 15.2
wearing 15.2
model 14.8
guy 14.7
hand 14.4
black 14.4
style 14.1
outdoors 13.4
engineer 12.9
expression 12.8
hair 12.7
work 12.6
standing 12.2
fashion 12.1
men 12
looking 12
construction 12
one 11.9
helmet 11.8
posing 11.5
horse 11.4
boy 11.3
mature 11.2
industry 11.1
business 10.9
pose 10.9
lifestyle 10.8
architect 10.6
job 10.6
couple 10.5
old 10.4
outside 10.3
occupation 10.1
jacket 9.8
hardhat 9.8
together 9.6
elderly 9.6
happiness 9.4
manager 9.3
professional 9.3
human 9
fun 9
worker 8.8
look 8.8
engineering 8.6
casual 8.5
pretty 8.4
dark 8.4
cheerful 8.1
success 8
cowgirl 7.9
cap 7.9
love 7.9
pair 7.6
smart 7.5
child 7.5
holding 7.4
close 7.4
safety 7.4
sexy 7.2
building 7.1
women 7.1
kid 7.1

Google
created on 2022-01-08

Hat 95.2
Sun hat 92.5
Fedora 86.6
Sleeve 86.4
Collar 83.4
Headgear 83.3
Black-and-white 82.5
Blazer 74.9
Vintage clothing 74.1
Monochrome photography 73.7
Monochrome 71.6
Landscape 68.6
Cowboy hat 66
Event 63.6
Stock photography 62.7
Fashion accessory 61.1
Tree 59.7
Uniform 55.3
Working animal 54.1
Classic 53.4

Microsoft
created on 2022-01-08

hat 99.9
fashion accessory 99.6
fedora 98.9
outdoor 98.8
person 98.5
text 97.7
cowboy hat 97.6
sun hat 96.4
clothing 90.4
man 81.9
human face 78.5
old 43.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 94.3%
Sad 4.5%
Confused 0.5%
Angry 0.3%
Surprised 0.2%
Disgusted 0.1%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 53-61
Gender Male, 99.8%
Calm 99.9%
Sad 0%
Angry 0%
Confused 0%
Surprised 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 48-54
Gender Male, 100%
Calm 60.4%
Angry 31.1%
Sad 2.7%
Confused 2.3%
Disgusted 1%
Surprised 1%
Fear 0.8%
Happy 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.9%
Person 99.5%
Jacket 55.9%

Captions

Microsoft

a couple of people that are standing in an old photo of a person 79.8%
a person wearing a hat 79.7%
a couple of people that are standing in front of a store 65.4%