gpt-tokenizer 2.1.2

A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models

gpt-tokenizer@2.1.2 was published on 2023-10-07. Its manifest declares 1 runtime dependency and 0 peer requirements. Type declarations are bundled according to the package metadata. No Node.js engine requirement is declared in this manifest.

All gpt-tokenizer versions · Permanent reference to 2.1.2 · Latest release

Package specifications

Version2.1.2
License declarationMIT
Published2023-10-07T00:57:25.208Z
Node.js requirementNot declared
Type declarationsBundled declarations
Runtime dependency count1
Peer requirement count0
Optional dependency count0
Minified sizeMeasurement not available yet
Minified + gzipMeasurement not available yet
Unpacked distribution size43205.62 KiB
Published file count418
Package typeNot declared
ES module entryesm/main.js
Default entryesm/main.js
Side effects declarationNot declared
Direct advisories0
Resolved graph dependencies1
Repository stars857
Repository forks65

Install gpt-tokenizer 2.1.2

npm install gpt-tokenizer@2.1.2
pnpm add gpt-tokenizer@2.1.2
yarn add gpt-tokenizer@2.1.2

Runtime dependencies

Peer requirements

  • None declared

Optional dependencies

  • None declared

Resolved dependency graph

This deps.dev graph describes a generic 64-bit Linux environment, not your application lockfile.

How to interpret the specifications

Bundlephobia measurements use its standard package build and may exclude peer dependencies. Unpacked npm distribution size includes shipped files and is a different measurement. Module declarations do not prove tree-shaking or runtime compatibility.

Advisories apply to this package version directly; transitive dependencies need separate inspection. Repository signals describe the whole repository and are current observations, including on historical-version pages.

Evidence and freshness