Human Generated Data

Title

Untitled (Worthington, Ohio)

Date

August 1938, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3465

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Worthington, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3465

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Sun Hat 99.8
Adult 99.5
Male 99.5
Man 99.5
Person 99.5
Adult 99.4
Male 99.4
Man 99.4
Person 99.4
Adult 99.3
Male 99.3
Man 99.3
Person 99.3
Adult 99.1
Male 99.1
Man 99.1
Person 99.1
Adult 96.9
Male 96.9
Man 96.9
Person 96.9
Pants 91.2
Shirt 77.9
Shop 77
Cap 76.5
Face 72.7
Head 72.7
Hat 71.4
Hat 64.9
Coat 63.5
Indoors 57.6
Baseball Cap 55.6
Restaurant 55.3
Outdoors 55.1

Clarifai
created on 2018-05-10

people 99.8
adult 98.5
group 95.4
street 94.9
group together 94.5
man 93.2
stock 92.1
woman 90.9
several 87.4
administration 86.9
child 85.3
commerce 85
segregation 82.1
transportation system 81.4
offense 79.6
police 79.2
law 78.4
newspaper 77.8
many 77.4
wear 76.4

Imagga
created on 2023-10-06

barbershop 100
shop 100
mercantile establishment 100
place of business 74.9
establishment 38.5
door 26.6
old 25.1
building 21.2
wall 20.5
house 19.2
vintage 18.2
architecture 18
city 15.8
retro 15.6
urban 14.8
window 14.7
sign 13.5
antique 13
ancient 12.1
travel 12
street 12
wood 11.7
entrance 11.6
brick 11.3
texture 11.1
aged 10.9
dirty 10.8
wooden 9.7
closed 9.6
empty 9.4
man 9.4
glass 9.3
exterior 9.2
historic 9.2
structure 9.2
history 8.9
people 8.9
home 8.8
decoration 8.8
grunge 8.5
tourism 8.2
transportation 8.1
male 7.8
brown 7.4
design 7.3
transport 7.3
road 7.2

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 99.4
person 93.2
people 83.5
standing 77.5
shop 11.3

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 52-60
Gender Male, 83.7%
Happy 97.7%
Surprised 6.5%
Fear 6%
Sad 2.2%
Calm 0.4%
Confused 0.3%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 47-53
Gender Male, 99.8%
Calm 54.2%
Angry 24.1%
Disgusted 9.5%
Surprised 8.8%
Fear 6%
Confused 3.7%
Sad 3.4%
Happy 0.5%

AWS Rekognition

Age 40-48
Gender Male, 99.7%
Happy 50.5%
Calm 15.6%
Sad 12.1%
Surprised 9.9%
Disgusted 7%
Fear 6.3%
Confused 3.9%
Angry 3.2%

Microsoft Cognitive Services

Age 42
Gender Male

Feature analysis

Amazon

Adult 99.5%
Male 99.5%
Man 99.5%
Person 99.5%
Hat 71.4%
Coat 63.5%

Text analysis

Amazon

HOME
EGGS
MEATS
POULTRY
BROS.
AND
CHAPIN
DRESSED
P
T

Google

HOME ULTRY AND DRESSED EGGS MEATS CHAPIN BROS
HOME
ULTRY
AND
DRESSED
EGGS
MEATS
CHAPIN
BROS