diff options
| author | Laurenz <laurmaedje@gmail.com> | 2020-01-06 12:50:20 +0100 |
|---|---|---|
| committer | Laurenz <laurmaedje@gmail.com> | 2020-01-06 12:50:20 +0100 |
| commit | a93b1ab003affb0d72e9da4007b04a2a6cfd4462 (patch) | |
| tree | bdc6f1c14259e7745fa59c7e51d8327ee5df3061 /src/syntax/tokens.rs | |
| parent | 2ee5810fecb96a8d4e0d078faecc8c91096d6881 (diff) | |
Formatting 🛀
Diffstat (limited to 'src/syntax/tokens.rs')
| -rw-r--r-- | src/syntax/tokens.rs | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/src/syntax/tokens.rs b/src/syntax/tokens.rs index 85e89be4..f5854d8f 100644 --- a/src/syntax/tokens.rs +++ b/src/syntax/tokens.rs @@ -5,6 +5,7 @@ use smallvec::SmallVec; use super::*; + /// Builds an iterator over the tokens of the source code. pub fn tokenize(src: &str) -> Tokens { Tokens::new(src) |