Human Generated Data

Title

Untitled (liquor store, Newark, Ohio)
Date

July 1938-August 1938, printed later
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3406
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (liquor store, Newark, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 1938-August 1938, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3406

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 100
Adult 99.6
Male 99.6
Man 99.6
Person 99.6
Sun Hat 98.6
Person 97.2
Adult 96.6
Male 96.6
Man 96.6
Person 96.6
Adult 93.3
Male 93.3
Man 93.3
Person 93.3
Face 92.7
Head 92.7
Person 91.5
Shop 88.2
Person 86.8
Shirt 81.3
Person 74.8
Person 70
Person 68.7
Text 67.1
Hat 66.5
Book 57.9
Publication 57.9
Photography 57.6
Portrait 57.6
Cap 57.4
Indoors 57.1
Restaurant 57.1
Cafeteria 55.3
Baseball Cap 55.2
Alcohol 55.1
Beverage 55.1

Clarifai
created on 2018-05-10

people 100
adult 99.2
monochrome 98.9
man 97.6
lid 94.6
group 93.8
uniform 93
portrait 92.4
child 91.6
group together 91.4
woman 90.8
street 89.8
wear 88
two 87.5
sit 87.5
baseball 86.8
nostalgia 85.6
vertical 85.3
four 84.4
coverage 82.1

Imagga
created on 2023-10-05

newspaper 100
product 79.2
creation 61.5
book jacket 21
vintage 19
daily 18.8
old 18.1
shop 17
jacket 16.3
black 15
barbershop 14.1
ancient 13
grunge 12.8
architecture 12.5
wrapping 12.4
art 12.4
wall 12
mercantile establishment 12
people 11.7
business 11.5
retro 11.5
light 11.4
window 11.3
antique 11.2
office 11
glass 10.9
man 10.7
building 10.7
urban 10.5
texture 10.4
sky 10.2
finance 10.1
aged 9.9
outdoors 9.7
male 9.2
letter 9.2
person 9.1
design 9
financial 8.9
stamp 8.7
house 8.4
frame 8.3
city 8.3
covering 8.3
one 8.2
dirty 8.1
detail 8
place of business 8
structure 8
postmark 7.9
postage 7.9
postal 7.8
mail 7.7
post 7.6
symbol 7.4
exterior 7.4
travel 7
modern 7

Google
created on 2018-05-10

photograph 95.5
black and white 87.7
snapshot 81.8
monochrome photography 73.2
poster 67.6
monochrome 65.4
vintage clothing 63.9
human behavior 54.8
history 54.3

Microsoft
created on 2018-05-10

person 98.2
text 95.6
outdoor 94.4
old 60.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 13-21
Gender Male, 100%
Calm 92.2%
Surprised 6.4%
Fear 5.9%
Sad 4.4%
Confused 1%
Angry 1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 18-26
Gender Female, 50.6%
Calm 72.2%
Happy 10.4%
Fear 7.2%
Sad 7.2%
Surprised 6.5%
Confused 3.2%
Angry 0.9%
Disgusted 0.8%

Microsoft Cognitive Services

Age 24
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.6%
Male 99.6%
Man 99.6%
Person 99.6%
Hat 66.5%

Captions

Microsoft
created on 2018-05-10

an old photo of a person 85.1%
an old photo of a person 84.3%
old photo of a person 81.9%

Text analysis

Amazon

GIN
BEER
BASKET
DAVEY
PICNIC
ARTY
P ARTY
MARTIN L DAVEY
P
MARTIN L
BASKET are PICNIC
OOR
WINES
are

Google

GIN
GIN