Human Generated Data

Title

Untitled (Smithland, Kentucky)

Date

October 1935, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3418

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Smithland, Kentucky)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3418

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Clothing 100
Apparel 100
Person 99.1
Human 99.1
Person 99
Person 98.4
Sun Hat 91.7
Hat 91.7
Suit 84.4
Overcoat 84.4
Coat 84.4
Cowboy Hat 66.9

Clarifai
created on 2023-10-15

people 99.9
two 98.3
adult 97.9
lid 97.1
man 96.4
portrait 95.8
child 95.8
three 95.5
woman 95.4
group together 93.3
group 93
monochrome 92.5
veil 92.4
four 91.3
street 90.9
wear 90.8
home 90.7
family 89.2
furniture 88.6
one 87.3

Imagga
created on 2021-12-15

barbershop 35.5
shop 33.7
mercantile establishment 25.2
man 21.5
window 19.7
place of business 17
people 16.2
architecture 14.8
door 14.7
old 14.6
male 13.5
adult 13
building 12.9
history 12.5
city 12.5
person 12.1
sitting 11.2
glass 10.9
house 10.9
urban 10.5
sliding door 10.5
black 10.4
life 9.7
men 9.4
hairdresser 9.3
business 9.1
establishment 9
interior 8.8
home 8.8
chair 8.8
couple 8.7
light 8.7
love 8.7
wall 8.5
travel 8.4
stone 8.4
historic 8.2
happy 8.1
dress 8.1
working 7.9
indoors 7.9
office 7.9
loom 7.9
movable barrier 7.9
happiness 7.8
ancient 7.8
entrance 7.7
modern 7.7
construction 7.7
industry 7.7
fashion 7.5
wood 7.5
outdoors 7.5
alone 7.3
boutique 7.3
work 7.2
portrait 7.1

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

clothing 96.8
human face 96.3
person 94
black and white 88.9
window 86
text 74.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 33-49
Gender Male, 92.5%
Happy 81.2%
Calm 15.6%
Sad 1%
Surprised 0.6%
Fear 0.5%
Confused 0.5%
Angry 0.4%
Disgusted 0.1%

AWS Rekognition

Age 21-33
Gender Female, 68.1%
Fear 92.9%
Sad 2.3%
Angry 2.3%
Confused 1%
Surprised 0.9%
Disgusted 0.3%
Calm 0.2%
Happy 0.1%

AWS Rekognition

Age 15-27
Gender Female, 82.7%
Calm 74.4%
Sad 20.1%
Confused 2.5%
Angry 2%
Fear 0.4%
Surprised 0.4%
Disgusted 0.2%
Happy 0.2%

Microsoft Cognitive Services

Age 20
Gender Male

Microsoft Cognitive Services

Age 43
Gender Male

Microsoft Cognitive Services

Age 9
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Possible
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Suit 84.4%