Human Generated Data

Title

Untitled (two men and motorcycle with sidecar)

Date

early 20th century

People

Artist: Caufield and Shook, American 1903 - 1978

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.162

Human Generated Data

Title

Untitled (two men and motorcycle with sidecar)

People

Artist: Caufield and Shook, American 1903 - 1978

Date

early 20th century

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Machine 99.7
Wheel 99.7
Wheel 99.5
Person 98.3
Human 98.3
Person 98.1
Transportation 92.5
Vehicle 92.5
Motorcycle 81.9
Automobile 81.7
Tricycle 64.2
Spoke 59.4
Model T 59.2
Antique Car 59.2
Car 54.5

Imagga
created on 2021-12-14

shop 94.7
barbershop 89.5
mercantile establishment 72.3
place of business 48.2
building 36.8
city 33.3
street 30.4
architecture 29.7
establishment 25
old 23.7
urban 22.7
tobacco shop 21.4
wall 19.7
window 18.5
brick 17.9
sign 17.3
door 17.1
house 16.7
wheeled vehicle 16.4
town 15.8
historic 14.7
jinrikisha 14.5
travel 14.1
stall 13.8
tricycle 13
vehicle 12.6
transportation 12.6
exterior 12
structure 11.9
road 11.7
cart 11.4
home 11.2
england 10.5
buildings 10.4
facade 10.3
gas pump 10
glass 9.3
stone 9.3
public 8.7
entrance 8.7
wagon 8.7
antique 8.7
windows 8.6
construction 8.6
vintage 8.3
tourism 8.3
transport 8.2
history 8
light 8
pump 7.9
ancient 7.8
sidewalk 7.7
sky 7.7
outdoor 7.6
traffic 7.6
classic 7.4
retro 7.4
tourist 7.3
black 7.2
bookshop 7.1

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

building 99.8
outdoor 99.8
text 99.6
street 99
road 98.1
city 96
black and white 95
wheel 90.3
land vehicle 88.2
monochrome 85.5
vehicle 82.4
black 74.4
store 72.4
people 57.7
tire 52.7
shop 31.1

Face analysis

Amazon

Google

AWS Rekognition

Age 22-34
Gender Male, 99.6%
Calm 67.6%
Confused 27.4%
Sad 2.1%
Surprised 1.2%
Angry 0.6%
Happy 0.5%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 28-44
Gender Male, 92.5%
Calm 70.1%
Confused 14.4%
Surprised 6.6%
Angry 3.5%
Fear 3.2%
Sad 1.6%
Disgusted 0.4%
Happy 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Wheel 99.7%
Person 98.3%
Motorcycle 81.9%
Car 54.5%

Captions

Microsoft

a person riding a motorcycle in front of a store 82%
a group of people on a motorcycle in front of a store 80.8%
a close up of a person riding a motorcycle in front of a store 76.7%

Text analysis

Amazon

6520
SERVICE
QUICK SERVICE
QUICK
REPAIR
INSTALLATIONS
OPEN
CASH
EMERGENCY
LIGHT&POWER
WORK
ALL WORK
STRICTLY CASH
ALL
ELECTRIC
DAY&NIGHT
DAY
STRICTLY
ELECTRICAL
ELECTRICAN
REPAIR SERVICE
MAN
CALL
of
REPAIRS
DAWSON'S
callcity
OPEN DAY and NIGHT
FOR
PS
and NIGHT
DAWSONS
GET
REPAIRS ONALLY LIGHT&POWER
APPLIANCES-
CITY
DAWSON'S Дом LIN MOTORCYCLE FOR MAN EMERGENCY ELECTRICAL 17 callcity APPLIANCES- 6520 ELECTRIC II REPAIR INSTALLATIONS SERVICE
EMERGINCY ELECTRIC
IT OPEN
MILL
TV
MOTORCYCLE
MILL GET DUCK
ANDYOD
NEW
ONALLY
EGT
adidas
LIN
de
17
450
>12
EMERGINCY
a
Son-Sale
AILY
ONA
DEF O EGT
WE
IT
con Arst
DISONIMAZAR
II
MA
no
DUCK
and
дл
CLUCH
MA AAUT REPHOES
STZEPTIET
and OTHER
Home
DEF O
FRES STZEPTIET
3mg
REPHOES
Дом
FRES
OTHER
AAUT
/suress
ACHI
PIN

Google

STeiCTy CASH RAARGAT OPEN ONMoDAY'S OPEN DAY and NIGHT DRAIS CHALLICIPICALAPLANCS IKHTË POWER INSTALLATIONS DAY &NIGHT al laty 6520 CALL 6520 QUICK SERVICE EireTRICAM DEWSON'S fon-SALE SERVICE CITY 6520
CASH
and
NIGHT
CHALLICIPICALAPLANCS
CALL
SERVICE
EireTRICAM
QUICK
fon-SALE
6520
RAARGAT
POWER
INSTALLATIONS
DAY
STeiCTy
OPEN
ONMoDAY'S
IKHTË
&NIGHT
al
laty
DEWSON'S
DRAIS
CITY