|
há 3 semanas atrás | |
---|---|---|
.. | ||
LICENSE | há 3 semanas atrás | |
README.md | há 3 semanas atrás | |
index.d.ts | há 3 semanas atrás | |
index.js | há 3 semanas atrás | |
package.json | há 3 semanas atrás |
The tiny, regex powered, lenient, almost spec-compliant JavaScript tokenizer that never fails.
const jsTokens = require("js-tokens");
const jsString = 'JSON.stringify({k:3.14**2}, null /*replacer*/, "\\t")';
Array.from(jsTokens(jsString), (token) => token.value).join("|");
// JSON|.|stringify|(|{|k|:|3.14|**|2|}|,| |null| |/*replacer*/|,| |"\t"|)