Skip to main content
CrystalDocs
Search documentation
Search
Browse Docs
CrystalShards
About
module
Merlin::Tokenizer(IdentT)
Instance methods
tokenize
(str :
String
, filename :
String
|
Nil
= nil) :
Array
(
MatchedToken
(
IdentT
))
Source