js-tokens

  • Version 9.0.0
  • Published
  • 16.1 kB
  • No dependencies
  • MIT license

Install

npm i js-tokens
yarn add js-tokens
pnpm add js-tokens

Overview

Tiny JavaScript tokenizer.

Index

Functions

Type Aliases

Functions

function jsTokens

jsTokens: typeof jsTokens;

    Type Aliases

    type JSXToken

    type JSXToken =
    | { type: 'JSXString'; value: string; closed: boolean }
    | { type: 'JSXText'; value: string }
    | { type: 'JSXIdentifier'; value: string }
    | { type: 'JSXPunctuator'; value: string }
    | { type: 'JSXInvalid'; value: string };

      type Token

      type Token =
      | { type: 'StringLiteral'; value: string; closed: boolean }
      | { type: 'NoSubstitutionTemplate'; value: string; closed: boolean }
      | { type: 'TemplateHead'; value: string }
      | { type: 'TemplateMiddle'; value: string }
      | { type: 'TemplateTail'; value: string; closed: boolean }
      | { type: 'RegularExpressionLiteral'; value: string; closed: boolean }
      | { type: 'MultiLineComment'; value: string; closed: boolean }
      | { type: 'SingleLineComment'; value: string }
      | { type: 'HashbangComment'; value: string }
      | { type: 'IdentifierName'; value: string }
      | { type: 'PrivateIdentifier'; value: string }
      | { type: 'NumericLiteral'; value: string }
      | { type: 'Punctuator'; value: string }
      | { type: 'WhiteSpace'; value: string }
      | { type: 'LineTerminatorSequence'; value: string }
      | { type: 'Invalid'; value: string };

        Package Files (1)

        Dependencies (0)

        No dependencies.

        Dev Dependencies (0)

        No dev dependencies.

        Peer Dependencies (0)

        No peer dependencies.

        Badge

        To add a badge like this onejsDocs.io badgeto your package's README, use the codes available below.

        You may also use Shields.io to create a custom badge linking to https://www.jsdocs.io/package/js-tokens.

        • Markdown
          [![jsDocs.io](https://img.shields.io/badge/jsDocs.io-reference-blue)](https://www.jsdocs.io/package/js-tokens)
        • HTML
          <a href="https://www.jsdocs.io/package/js-tokens"><img src="https://img.shields.io/badge/jsDocs.io-reference-blue" alt="jsDocs.io"></a>