Typal
typal
Keeps Types In XML files And Converts Them To (1) JavaScript JSDoc, (2) Closure Externs and (3) Markdown Documentation. It is the alternative to TypeScript definitions and utilises the power of JSDoc for excellent developer experience, documentation readability and compiler annotation. It also makes integration between Google Closure Compiler and VSCode easy, using the JSDoc notations that are understood by both at the same time.
The package's main use is as the CLI tool to generate typedefs, but it also has an API for parsing types and properties with regular expressions.
yarn add -D typal
Table Of Contents
Purpose
The main purpose of this package is to generate JSDoc annotations that are understood both by VSCode, and compatible with Google Closure Compiler via its externs system. The project deliberately deviates from TypeScript and is meant for JavaScript development, and it proves that typing can be achieved perfectly well with JSDoc. It's idea is to store files in an XML file, and then embed them in JS and README files and externs.
The solutions provided by Typal are:
- Manage types from an external XML location.
- Compile types into JSDoc compatible both with GCC and VSCode.
- Compile types as externs for GCC and use in other packages.
- Place types' descriptions as formatted tables in markdown (used in Documentary).
- Improve the DevX by increasing the visibility of functions' APIs.
To tune in, start with the Wiki Page:
🥇🥈🥉Naïve, JSDoc And Closure Use Cases For Typedefs
CLI
Typal is the command-line utility that is used to manage JSDoc types in JavaScript source files. The typedefs are now sourced from the types.xml
file and embedded on demand. There are 3 modes to embedding types:
-
Standard, no flags required: places only VSCode compatible code. Can be used when no Closure-compilation will be performed on packages. Does not utilise namespaces. Expands the parameters of complex types for better visibility.
Show Standard JSDoc
|
const prog = (conf, options) => {}
|
-
Closure with -c
flag: suppresses standard typedefs' annotations so that Closure Compiler does not show warnings. Introduces namespaces for internal as well as external APIs to make types' sources more visible.
Show Closure JSDoc
|
const prog = (conf, options) => {}
|
-
Externs with -e
flag: generates types only understood by the Google Closure Compiler, primarily in the externs.js
file. These types do not have any meaning for the coding process and are only used in compilation either as types for programs, or externs for libraries.
Show Externs JSDoc
|
var _typal = {}
_typal.Conf
|
Typal Arguments
$ typal source [--closure|externs] [-o output] [-vh]
The following arguments are supported by this software.
Argument | Short | Description |
---|
source | | The path to the source file or directory with files to embed types into. Can specify multiple values, e.g., typal types/index.js types/vendor.js . |
--output | -o | The destination where to save output.
If not passed, the file will be overwritten.
If - is passed, prints to stdout. |
--closure | -c | Whether to generate types in Closure mode. |
--externs | -e | Whether to generate externs for GCC. |
--types | -t | Comma-separated location of files to read types from. |
--migrate | -m | Extracts types from JavaScript source code and saves them
into the types.xml file specified in the output option. |
--help | -h | Print the help information and exit. |
--version | -v | Show the version's number and exit. |
Typal will look for its marker in the source files, and insert all types definitions below it. There must be a single new line after the marker, even at the bottom of the file. It is possible to override the arguments, or pass them via the marker itself. When these are specified, there is no need to supply them via the CLI.
function sourceCode() {}
_
- closure: enable the closure mode;
- externs: enable the externs mode;
- noSuppress: don't add
@suppress
annotations (see the files section below). - ignore:_nsType,Type: the types to ignore when placing JSDoc into JS files. This can be useful, for example, when the package is built with Depack and has no dependencies, but depends on imported types from other packages. Therefore, these imported types need to be vendored using a separate file, and then imported from there, rather than from their original source file. See
@zoroaster/mask/types/vendor.js
and @zoroaster/mask/types/index.js
for a practical application. - skipNsDecl: Disables the declaration of the namespace. The types will still be prefixed with a namespace, but it won't be declared at the top as
/** @const */ var ns = {}
. This is useful when the externs are split by multiple files, and the namespace will only need to appear in one of them, otherwise the Variable _ns declared more than once.
error will be thrown.
Missing Types Warnings
When placing JSDoc into source code files where functions are annotated with @params
, Typal in addition to expanding object arguments into the developer-friendly notation as discussed above, will check to see if the types were found in the xml files specified in via the /* typal types.xml */
marker to warn of possible errors. This feature aims at helping to identify when some annotations were not done properly, e.g., when missing a namespace, an import, or when type names become outdated. This does not work for record types such as {}
since although we have a parser for types themselves, we only use a regular expression which cannot understand things like @param {{ s: string, t }}
at the moment. Also only Closure-style types are parsed, i.e., VSCode JSDoc is not supported right now, and the union must be explicitly put in parenthesis.
function example (
writable, readable,
type, missingType,
array, promise, object, union,
error,
string,
) {}
Detected type marker: example/warnings.xml
Type stream.Readable was not found.
example/warnings.js:3:11
Type _ns.MissingType was not found.
example/warnings.js:5:11
Type _ns.MissingType in Array<_ns.MissingType> was not found.
example/warnings.js:6:11
Type MissingType in Promise<MissingType> was not found.
example/warnings.js:7:11
Type _ns.MissingType in Object<string, _ns.MissingType> was not found.
example/warnings.js:8:11
Type Type in (Type | MissingType | _ns.Type) was not found.
example/warnings.js:9:11
Type MissingType in (Type | MissingType | _ns.Type) was not found.
example/warnings.js:9:11
Error while parsing the type (s: string) => number
Expecting closing )
example/warnings.js:10:11
Type MissingType in MissingType & Type2 was not found.
example/warnings.js:11:11
Keeping Types In Separate File
If the types are numerous and it is desired to put them in a separate JS file (like types.d.ts
but for JSDoc) and then import them in code from there for expansions of function's configs, it is possible with the -t
argument pointing to the location of XML files. Keeping all files in a types.js
file allows to import them from anywhere in the code, or other packages (the file needs to be added to the files
field of package.json
, if such field exists).
For example, we can create a types.js
file with the typal
marker:
export {}
The types can be placed in there with typal types.js
command. We also add the noSuppress
command because the file will not be imported and checked by the Google Closure Compiler therefore the @suppress
annotations would be redundant. Now the aim is to update the source code which has a variable of a particular type that we want to expand and we run typal src/index.js -t types/index.xml
to do that:
function example(config = {}) {
const { test } = config
}
function example(config = {}) {
const { test } = config
}
Any external types referenced in properties must be manually imported, because otherwise their types will be unknown in the scope of the file. This can be done with the snippet that can be put either in the workspace directory as .vscode/import.code-snippets
, or configured to be included in User Snippets (⌘⇧ P > Preferences: Configure User Snippets).
{
"Import Type And Suppress": {
"prefix": "@typedef",
"body": [
"/**",
" * @suppress {nonStandardJsDocs}",
" * @typedef {import('$1')$2} $3",
" */"
],
"description": "Insert import typedef"
}
}
In future, we plan to introduce full-scale management of types so that all import statements will be added automatically by Typal.
Migration
When there are JSDoc types written in JavaScript files, and they need to be put in the types.xml
file, it can be done automatically with the --migrate
command. In this case, Typal will scan the source code for the type definitions and their properties, defined as @prop
or @property
tags, and place them either in the output file when specified, or print to the stdout. This will help to move all types into XML declarations, which can then be manually adjusted if necessary, and embedded into the source code using the /* typal types.xml */
marker, and in README documentation using Documentary.
Using Migrate Command |
---|
|
For example, the types above can be extracted into the types file using the typal src/index.js -m [-o types/index.xml] command.
|
<types>
<import name="StorageEngine" from="koa-multer" />
<import name="IncomingMessage" from="http" />
<import name="File" from="koa-multer" />
<type name="Example" desc="An example type." />
<type name="SessionConfig" desc="Description of Session Config.">
<prop string name="key">
The cookie key.
</prop>
<prop type="number|'session'" name="maxAge" default="86400000">
maxAge in ms. Default is 1 day.
</prop>
<prop boolean name="overwrite" default="true">
Can overwrite or not.
</prop>
<prop boolean name="httpOnly" default="true">
httpOnly or not or not.
</prop>
<prop boolean name="signed" default="false">
Signed or not.
</prop>
<prop opt boolean name="rolling">
Force a session identifier cookie to be set.
</prop>
<prop opt boolean name="renew">
Renew session when session is nearly expired.
</prop>
</type>
</types>
|
Schema
The XML schema supports types, imports, properties and functions (which are aliases to properties with special attributes used to construct a function type).
📝 Typal Schema
<types>
<import from="http" name="IncomingMessage"
link="https://nodejs.org/api/http.html#incoming_message"
desc="The readable stream from the connection." />
<type name="Example" >
<prop type="string" name="test">The property.</prop>
<fn async args="number" return="boolean">A method property.</fn>
</type>
</types>
Markdown Documentation
Typal allows to paste types into documentation using the Documentary package. It will also link the types it knows about for easier navigation. The supported types are based on the Google Closure Compiler types and include the following:
Type
: A type which can be linked.
Example
: An example type which can link to other types.
Name | Type | Description |
---|
type | ?Type | The type itself, possibly nullable. |
union | !(Type | string) | The union of types. |
record | { t: Type, r } | The record with a type. |
application | Object<string, Type> | The application with a type. |
function | function(this: Type, string, !Type): Type | The function with arguments and return type. |
variable-args | function(...Type) | Functions with ... for variable argument types. |
vscode-function | (type: Type, s: string) => Type | Linking in the VSCode (TypeScript) functions are not supported at the moment. |
API
The package is available by importing its named functions and classes:
import { Type, Property, getNameWithDefault, parseFile } from 'typal'
Its primary use is in Documentary, and the API is therefore semi-private.
class Type
This class represents the type.
class Property
This class represents the properties of the type.
getNameWithDefault(
name: string,
defaultValue: ?(string|boolean|number),
type: string=,
parentParam: string=,
): string
Returns the name of a property with its default value, and surrounded by square brackets if default is given. If type is boolean or number, the default value is not surrounded by "". The default values are only used for VSCode because GCC does not use this information.
import { getNameWithDefault } from 'typal'
console.log(getNameWithDefault('arg', 'test', 'string'))
console.log(getNameWithDefault('hello', true, 'boolean', 'arg'))
console.log(getNameWithDefault('world', 27, 'number', 'arg'))
arg="test"
arg.hello=true
arg.world=27
parseFile(
xml: string,
rootNamespace: string=,
): { types, imports, namespace }
Returns the string parsed into Types and Properties.
Given the following types file:
<types>
<import name="ServerResponse" from="http" />
<type name="SetHeaders"
type="(s: ServerResponse) => void"
closure="function(http.ServerResponse)"
desc="Function to set custom headers on response." />
<type name="StaticConfig" desc="Options to setup `koa-static`.">
<prop string name="root">
Root directory string.
</prop>
<prop number name="maxage" default="0">
Browser cache max-age in milliseconds.
</prop>
<prop boolean name="hidden" default="false">
Allow transfer of hidden files.
</prop>
</type>
</types>
It can be parsed using the following call:
import read from '@wrote/read'
import { parseFile } from 'typal'
const getFile = async () => {
const file = await read('test/fixture/types.xml')
const res = parseFile(file)
return res
}
The result will contain Types and Imports:
{ namespace: undefined,
types:
[ Type {
name: 'SetHeaders',
type: '(s: ServerResponse) => void',
closureType: 'function(http.ServerResponse)',
description: 'Function to set custom headers on response.',
noToc: false,
spread: false,
import: false,
noExpand: false,
link: null,
properties: [],
namespace: null,
isConstructor: false,
isInterface: false,
isRecord: false,
extends: null },
Type {
name: 'StaticConfig',
type: null,
closureType: null,
description: 'Options to setup `koa-static`.',
noToc: false,
spread: false,
import: false,
noExpand: false,
link: null,
properties:
[ Property {
name: 'root',
description: 'Root directory string.',
type: 'string',
closureType: 'string',
hasDefault: false,
default: null,
optional: false,
aliases: [],
parsed: { name: 'string' },
noParams: false },
Property {
name: 'maxage',
description: 'Browser cache max-age in milliseconds.',
type: 'number',
closureType: 'number',
hasDefault: true,
default: 0,
optional: true,
aliases: [],
parsed: null,
noParams: false },
Property {
name: 'hidden',
description: 'Allow transfer of hidden files.',
type: 'boolean',
closureType: 'boolean',
hasDefault: true,
default: false,
optional: true,
aliases: [],
parsed: null,
noParams: false } ],
namespace: null,
isConstructor: false,
isInterface: false,
isRecord: false,
extends: null } ],
imports:
[ Import {
ns: 'http',
name: 'ServerResponse',
from: 'http',
desc: undefined,
link: undefined } ],
Imports:
[ Type {
name: 'ServerResponse',
type: 'import(\'http\').ServerResponse',
closureType: 'import(\'http\').ServerResponse',
description: null,
noToc: true,
spread: false,
import: true,
noExpand: false,
link: null,
properties: [],
namespace: 'http',
isConstructor: false,
isInterface: false,
isRecord: false,
extends: null } ] }
Root Namespace
Passing the rootNamespace
allows to ignore the given namespace in types and properties. This can be used for compiling documentation when only single namespace is used, and readers can assume where the types come from. However, this should only be used when printing to docs, but when compiling JSDoc, the full namespaces should be used to allow integration with externs.
Given the following types file which uses namespaces:
<types namespace="ns">
<type name="HelloWorld" desc="The example type.">
</type>
<type type="ns.HelloWorld" name="GoodMorning"
desc="Life is seeing sunlight every day." />
</type>
<type name="Conf" desc="The configuration object">
<prop type="ns.HelloWorld" name="propName">
The property description.
</prop>
</type>
</types>
It can be parsed so that the ns.
prefix is ignored:
import read from '@wrote/read'
import { parseFile } from 'typal'
const getFile = async () => {
const file = await read('example/root.xml')
const res = parseFile(file, 'ns')
return res
}
{ namespace: 'ns',
types:
[ Type {
name: 'HelloWorld',
type: null,
closureType: null,
description: 'The example type.',
noToc: false,
spread: false,
import: false,
noExpand: false,
link: null,
properties: [],
namespace: null,
isConstructor: false,
isInterface: false,
isRecord: false,
extends: null },
Type {
name: 'GoodMorning',
type: 'HelloWorld',
closureType: 'ns.HelloWorld',
description: 'Life is seeing sunlight every day.',
noToc: false,
spread: false,
import: false,
noExpand: false,
link: null,
properties: [],
namespace: null,
isConstructor: false,
isInterface: false,
isRecord: false,
extends: null },
Type {
name: 'Conf',
type: null,
closureType: null,
description: 'The configuration object',
noToc: false,
spread: false,
import: false,
noExpand: false,
link: null,
properties:
[ Property {
name: 'propName',
description: 'The property description.',
type: 'HelloWorld',
closureType: 'ns.HelloWorld',
hasDefault: false,
default: null,
optional: false,
aliases: [],
parsed: { name: 'ns.HelloWorld' },
noParams: false } ],
namespace: null,
isConstructor: false,
isInterface: false,
isRecord: false,
extends: null } ],
imports: [],
Imports: [] }
Optional And Default
- Optional (
opt
) means that the property of a type can be undefined
. - Default (
default
) means that when not given, the property will take the default
value. - In configs, default implies optional. However, in other types, it does not have to be so.
- Currently, default will trigger optional. Possibly fix that and make specifying optionals implicit.
Copyright