Human Generated Data

Title

Untitled (unemployed trappers, Plaquemines Parish, Louisiana)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3186
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (unemployed trappers, Plaquemines Parish, Louisiana)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3186

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Photography 99.9
Face 99.9
Head 99.9
Portrait 99.9
Sun Hat 99.9
Person 99.4
Adult 99.4
Male 99.4
Man 99.4
Person 98.8
Adult 98.8
Male 98.8
Man 98.8
Person 98.3
Hat 97.9
Food 94.7
Fruit 94.7
Plant 94.7
Produce 94.7
Body Part 87.4
Finger 87.4
Hand 87.4
Cap 56
Smoke 55.9
Sitting 55

Clarifai
created on 2018-05-10

people 100
adult 99.2
two 98.2
man 97.7
portrait 97.5
group 97.4
wear 96.3
veil 95.9
three 95.6
one 94.8
group together 93.3
administration 92.1
lid 91.5
woman 90.8
several 90.1
four 89.8
sit 86.9
war 81.9
recreation 81.5
elderly 81.3

Imagga
created on 2023-10-06

hat 66.6
cowboy hat 40.1
male 39
man 38.3
person 28.9
headdress 28.6
people 28.4
clothing 26
adult 25.2
happy 22.5
portrait 21.3
smile 19.2
sitting 18
face 16.3
looking 16
work 15.7
men 15.4
cowboy 15.1
worker 15.1
working 15
two 14.4
smiling 13.7
one 13.4
happiness 13.3
black 13.2
indoors 13.2
job 12.4
senior 12.2
building 12.1
guy 12
outdoors 11.9
casual 11.9
old 11.8
child 11.7
handsome 11.6
hand 11.4
old-timer 11.4
western 10.6
business 10.3
shirt 10.3
industry 10.2
covering 10.1
model 10.1
occupation 10.1
passenger 10.1
consumer goods 9.6
look 9.6
couple 9.6
home 9.6
boy 9.6
attractive 9.1
helmet 8.9
cheerful 8.9
lifestyle 8.7
construction 8.5
sit 8.5
pair 8.5
professional 8.5
travel 8.4
office 8.3
friendly 8.2
grandfather 8.2
alone 8.2
children 8.2
seller 8
businessman 7.9
sombrero 7.9
jacket 7.9
girlfriend 7.7
husband 7.6
head 7.6
fashion 7.5
mature 7.4
emotion 7.4
20s 7.3
world 7.3
industrial 7.3
computer 7.2
suit 7.2
hair 7.1
love 7.1
interior 7.1
country 7
together 7

Google
created on 2018-05-10

photograph 96.2
black 95.2
black and white 92.7
person 92.3
monochrome photography 86.8
photography 82.2
sitting 82
snapshot 81.8
human behavior 81.2
monochrome 68.1
vintage clothing 63.1
stock photography 55.9

Microsoft
created on 2018-05-10

person 99.8
man 96.9
outdoor 90.4
old 46.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-64
Gender Male, 99.9%
Sad 99.8%
Angry 12.9%
Calm 12.4%
Surprised 6.4%
Fear 6.1%
Confused 1.9%
Disgusted 0.8%
Happy 0.3%

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 95.3%
Surprised 6.3%
Fear 6.1%
Sad 2.9%
Confused 1.1%
Happy 0.4%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 18-26
Gender Female, 99.9%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.5%
Angry 0%
Confused 0%
Happy 0%
Disgusted 0%

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Adult 99.4%
Male 99.4%
Man 99.4%
Hat 97.9%

Categories

Imagga

paintings art 62.3%
pets animals 18.6%
nature landscape 15%
people portraits 3.4%

Captions

Microsoft
created on 2018-05-10

an old photo of a man 92.5%
a group of people sitting at a bus stop 61%
a man sitting on a bus 37.4%