Human Generated Data

Title

Untitled (roadside inns, central Ohio)

Date

July 1938-August 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3614

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (roadside inns, central Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 1938-August 1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 97.2
Person 97.2
Word 95.4
Meal 93.9
Food 93.9
Text 84.7
Restaurant 79.4
Outdoors 77.9
Kiosk 74.3
Neighborhood 72.2
Urban 72.2
Building 72.2
Spoke 72.1
Machine 72.1
Nature 71.4
Sign 63.9
Symbol 63.9
Road 63.7
Cafeteria 61.4
Housing 60.4
Apparel 60.2
Clothing 60.2
Pants 60.2
Alloy Wheel 57.7
Wheel 57.7
Cafe 57
Canopy 56.7
Shop 55.9
Deli 55.9

Imagga
created on 2021-12-15

flag 64.4
emblem 54.6
sign 40.6
billboard 32.6
graffito 25.7
road 23.5
signboard 22.7
structure 21.4
shop 20.8
traffic 20
decoration 17.9
building 17.8
street 17.5
sky 17.2
transportation 17
city 15.8
barbershop 15.2
signs 13.6
mercantile establishment 13
direction 12.4
warning 11.5
light 11.4
clouds 11
urban 10.5
post 10.5
danger 10
old 9.8
outdoors 9.7
landscape 9.7
perspective 9.4
outside 9.4
exterior 9.2
information 8.9
notice 8.7
closed 8.7
place of business 8.6
way 8.6
arrow 8.5
tree 8.5
travel 8.5
car 8.3
transport 8.2
new 8.1
road sign 7.9
highway 7.7
construction 7.7
wall 7.7
outdoor 7.6
house 7.5
symbol 7.4
safety 7.4
speed 7.3
architecture 7

Google
created on 2021-12-15

Plant 91.5
Building 90.9
Black 89.5
Window 88.1
Black-and-white 86.1
Style 83.8
Font 83
Motor vehicle 81.4
Monochrome photography 76.9
Monochrome 76.2
Art 73.7
Signage 70
Grass 68.8
Advertising 67.7
Street 64.9
History 64.4
Vintage clothing 63.6
Stock photography 63.5
Room 61.2
House 60.4

Microsoft
created on 2021-12-15

text 99.9
outdoor 99.8
sign 99.8
person 85.8
clothing 79.9
black and white 67.9
billboard 67.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Female, 91.6%
Calm 94.8%
Sad 4.2%
Angry 0.4%
Surprised 0.3%
Disgusted 0.1%
Fear 0.1%
Happy 0.1%
Confused 0.1%

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.2%

Captions

Microsoft

a sign in front of a building 97.6%
a sign on the side of a building 97.5%
a sign on a pole in front of a building 94%

Text analysis

Amazon

FOR
CREDIT
CREDIT CARDS
CARDS
6
15
$
OHIO
HONORED
OHIO STAT
BELL
APPROVED
APPROVED DEALER
DEALER
STAT
SANDWICHES
FOR 54
$ 100
54
OIL
GALS
100
INCLAIR
Coca-Cola
GAT
MINE

Google

APPROVED DEALER JINCLAIR CREDIT CARDS SANDWICHES HONORED GALS FOR $100 OHIO STAT DIL 15 FOR SA
CREDIT
CARDS
OHIO
15
APPROVED
STAT
SA
JINCLAIR
SANDWICHES
FOR
$100
HONORED
DIL
DEALER
GALS