📝 tslog: Beautiful logging experience for TypeScript and JavaScript
Powerful, fast and expressive logging for TypeScript and JavaScript
Highlights
⚡ Fast and powerful
🪶 Lightweight and flexible
🏗 Universal: Works in Browsers and Node.js
👮️ Fully typed with TypeScript support (native source maps)
🗃 Pretty or JSON
output
📝 Customizable log level
⭕️ Supports circular structures
🦸 Custom pluggable loggers
💅 Object and error interpolation
🤓 Stack trace and pretty errors
👨👧👦 Sub-logger with inheritance
🙊 Mask/hide secrets and keys
📦 CJS & ESM with tree shaking support
✍️ Well documented and tested
Example
import { Logger, ILogObj } from "tslog";
const log: Logger<ILogObj> = new Logger();
log.silly("I am a silly log.");
Donations help me allocate more time for my open source work.
Install
npm install tslog
In order to run a native ES module in Node.js, you have to do two things:
- Set
"type": "module"
in package.json
. - For now, start with
--experimental-specifier-resolution=node
Example package.json
{
"name": "NAME",
"version": "1.0.0",
"main": "index.js",
// here:
"type": "module",
"scripts": {
"build": "tsc -p .",
// and here:
"start": "node --enable-source-maps --experimental-specifier-resolution=node index.js"
},
"dependencies": {
"tslog": "^4"
},
"devDependencies": {
"typescript": "^4"
},
"engines": {
"node": ">=16"
}
}
With this package.json
you can simply build and run it:
npm run build
npm start
Otherwise:
ESM: Node.js with JavaScript:
node --enable-source-maps --experimental-specifier-resolution=node
CJS: Node.js with JavaScript:
node --enable-source-maps
ESM: Node.js with TypeScript and ts-node
:
node --enable-source-maps --experimental-specifier-resolution=node --no-warnings --loader ts-node/esm
CJS: Node.js with TypeScript and ts-node
:
node --enable-source-maps --no-warnings --loader ts-node/cjs
Browser:
<!doctype html>
<html lang="en">
<head>
<title>tslog example</title>
</head>
<body>
<h1>Example</h1>
<script src="tslog.js"></script>
<script>
const logger = new tslog.Logger();
logger.silly("I am a silly log.");
</script>
</body>
</html>
Enable TypeScript source map support:
This feature enables tslog
to reference a correct line number in your TypeScript source code.
// tsconfig.json
{
// ...
compilerOptions: {
// ...
"inlineSourceMap": true, // <!-- here
// we recommend using a current ES version
target: "es2020",
},
}
Simple example
import { Logger } from "tslog";
const logger = new Logger({ name: "myLogger" });
logger.silly("I am a silly log.");
logger.trace("I am a trace log.");
logger.debug("I am a debug log.");
logger.info("I am an info log.");
logger.warn("I am a warn log with a json object:", { foo: "bar" });
logger.error("I am an error log.");
logger.fatal(new Error("I am a pretty Error with a stacktrace."));
All Features
- Universal: Works in browsers and Node.js
- Tested: Great code coverage, CI
- Super customizable: Every aspect can be overwritten
- Fully typed: Written in TypeScript, with native TypeScript support
- Default log level:
silly
, trace
, debug
, info
, warn
, error
, fatal
(different colors) - Customizable log level: BaseLogger with configurable log level
- Pretty & JSON output: Structured/pretty,
JSON
or suppressed output - Attachable transports: Send logs to an external log aggregation services, file system, database, or email/slack/sms/you name it...
- Minimum log level per output:
minLevel
level can be set individually per transport - Native source maps lookup: Shows exact position also in TypeScript code (compile-to-JS), one click to IDE position
- Pretty Error: Errors and stack traces printed in a structured way and fully accessible through JSON (e.g. external Log services)
- ES Modules: import syntax with (tree-shaking)
- Object/JSON highlighting: Nicely prints out objects
- Instance Name: (Server-side only) Logs capture instance name (default host name) making it easy to distinguish logs coming from different instances
- Named Logger: Logger can be named (e.g. useful for packages/modules and monorepos)
- Sub-logger with inheritance: Powerful sub-loggers with settings inheritance, also at runtime
- Secrets masking: Prevent passwords and secrets from sneaking into log files by masking them
- Short paths: Paths are relative to the root of the application folder
- Prefixes: Prefix log messages and bequeath prefixes to child loggers
API documentation
tslog >= v4
is a major rewrite and introduces breaking changes.
Please, follow this documentation when migrating.
Lifecycle of a log message
Every incoming log message runs through a number of steps before being displayed or handed over to a "transport". Every step can be overwritten and adjusted.
- log message Log message comes in through the
BaseLogger.log()
method - mask If masking is configured, log message gets recursively masked
- toLogObj Log message gets transformed into a log object: A default typed log object can be passed to constructor as a second parameter and will be cloned and enriched with the incoming log parameters. Error properties will be handled accordingly. If there is only one log property, and it's an object, both objects (cloned default
logObj
as well as the log property object) will be merged. If there are more than one, they will be put into properties called "0", "1", ... and so on. Alternatively, log message properties can be put into a property with a name configured with the argumentsArrayName
setting. - addMetaToLogObj Additional meta information, like date, runtime and source code position of the log will be gathered and added to the
_meta
property or any other one configured with the setting metaProperty
. - format In case of "pretty" configuration, a log object will be formatted based on the templates configured in settings. Meta will be formatted by the method
_prettyFormatLogObjMeta
and the actual log payload will be formatted by prettyFormatLogObj
. Both steps can be overwritten with the settings formatMeta
and formatLogObj
. - transport Last step is to "transport" a log message to every attached transport from the setting
attachedTransports
. Last step is the actual transport, either JSON (transportJSON
), formatted (transportFormatted
) or omitted, if its set to "hidden". Both default transports can also be overwritten by the corresponding setting.
❗Performance
By default, tslog
is optimized for the best developer experience and includes some default settings that may impact performance in production environments.
To ensure optimal performance in production, we recommend modifying these settings, such as hideLogPositionForProduction
(s. below), as needed.
Default log level
tslog
comes with default log level 0: silly
, 1: trace
, 2: debug
, 3: info
, 4: warn
, 5: error
, 6: fatal
.
Tip: Each logging method has a return type, which is a JSON representation of the log message (ILogObj
).
import { Logger } from "tslog";
const log = new Logger();
log.silly("I am a silly log.");
log.trace("I am a trace log.");
log.debug("I am a debug log.");
log.info("I am an info log.");
log.warn("I am a warn log with a json object:", { foo: "bar" });
log.error("I am an error log.");
log.fatal(new Error("I am a pretty Error with a stacktrace."));
Custom log level
In addition to the default log level, custom log level can be defined in the same way tslog
does it under the hood, by extending the BaseLogger
and utilizing the log
method.
log
method expects the following parameters:
- logLevelId - Log level ID e.g. 0
- logLevelName - Log level name e.g. silly
- args - Multiple log attributes that should be logged.
Tip: Also the generic logging method (log()) returns a JSON representation of the log message (ILogObject
).
import { BaseLogger, ILogObjMeta, ISettingsParam, ILogObj } from "./BaseLogger";
export class CustomLogger<LogObj> extends BaseLogger<LogObj> {
constructor(settings?: ISettingsParam<LogObj>, logObj?: LogObj) {
super(settings, logObj, 5);
}
public custom(...args: unknown[]): LogObj & ILogObjMeta | undefined {
return super.log(8, "CUSTOM", ...args);
}
}
Sub-logger
Each tslog
-Logger instance can create sub-loggers and bequeath its settings to a child.
It is also possible to overwrite the LogObj
when creating a child.
Sub-loggers are a powerful feature when building a modular application and due to its inheritance make it easy to configure the entire application.
Use getSubLogger()
to create a child logger based on the current instance.
Example:
const mainLogger = new Logger({ type: "pretty", name: "MainLogger" });
mainLogger.silly("foo bar");
const firstSubLogger = mainLogger.getSubLogger({ name: "FirstSubLogger" });
firstSubLogger.silly("foo bar 1");
Sub-logger with LogObj
You can also overwrite the LogObj
(s. below), when you create a sub-logger:
const mainLogObj = { main: true, sub: false };
const mainLogger = new Logger({ type: "pretty", name: "MainLogger" }, mainLogObj);
mainLogger.silly("foo bar");
const subLogObj = { main: false, sub: true };
const firstSubLogger = mainLogger.getSubLogger({ name: "FirstSubLogger" }, subLogObj);
firstSubLogger.silly("foo bar 1");
Settings
tslog
is highly customizable and pretty much every aspect can be either configured or overwritten.
A settings
object is the first parameter passed to the tslog
constructor:
const logger = new Logger<ILogObj>({ }, defaultLogObject);
Changing settings at runtime
settings
is a public property and can also be changed on runtime.
Example on changing minLevel
on runtime:
const logger = new Logger({
minLevel: 1
});
logger.log(1, "level_one", "LOG1");
logger.log(2, "level_two", "LOG2");
logger.settings.minLevel = 2;
logger.log(1, "level_one", "LOG3");
logger.log(2, "level_two", "LOG4");
Type: pretty, json, hidden
pretty
Default setting prints out a formatted structured "pretty" log entry.json
prints out a JSON
formatted log entry.hidden
suppresses any output whatsoever and can be used with attached loggers for example.
Hint: Each JSON log is printed in one line, making it easily parsable by external services.
const defaultPrettyLogger = new Logger();
const prettyLogger = new Logger({type: "pretty"});
const jsonLogger = new Logger({type: "json"});
const hiddenLogger = new Logger({type: "hidden"});
name
Each logger has an optional name.
You can find the name of the logger responsible for a log inside the Meta
-object or printed in pretty
mode.
Names get also inherited to sub-loggers and can be found inside the Meta
-object parentNames
as well as printed out with a separator (e.g. :
) in pretty
mode.
Simple name example:
new Logger({ name: "myLogger" });
Sub-loggers with an inherited name:
const mainLogger = new Logger({ type: "pretty", name: "MainLogger" });
mainLogger.silly("foo bar");
const firstSubLogger = mainLogger.getSubLogger({ name: "FirstSubLogger" });
firstSubLogger.silly("foo bar 1");
const secondSubLogger = firstSubLogger.getSubLogger({ name: "SecondSubLogger" });
secondSubLogger.silly("foo bar 2");
Output:
2022-11-17 10:45:47.705 SILLY [/examples/nodejs/index2.ts:51 MainLogger] foo bar
2022-11-17 10:45:47.706 SILLY [/examples/nodejs/index2.ts:54 MainLogger:FirstSubLogger ] foo bar 1
2022-11-17 10:45:47.706 SILLY [/examples/nodejs/index2.ts:57 MainLogger:FirstSubLogger:SecondSubLogger] foo bar 2
minLevel
You can ignore every log message from being processed until a certain severity.
Default severities are:
0: silly
, 1: trace
, 2: debug
, 3: info
, 4: warn
, 5: error
, 6: fatal
const suppressSilly = new Logger({ minLevel: 1 });
suppressSilly.silly("Will be hidden");
suppressSilly.trace("Will be visible");
argumentsArrayName
tslog
< 4 wrote all parameters into an arguments array. In tslog
>= 4 the main object becomes home for all log parameters, and they get merged with the default logObj
.
If you still want to put them into a separated parameter, you can do so by defining the argumentsArrayName
.
const logger = new Logger({
type: "json",
argumentsArrayName: "argumentsArray",
});
const logMsg = logger.silly("Test1", "Test2");
hideLogPositionForProduction (default: false
)
By default, tslog
gathers and includes the log code position in the meta information of a logObj
o improve the developer experience.
However, this can significantly impact performance and slow down execution times in production.
To improve performance, you can disable this functionality by setting the option hideLogPositionForProduction
to true
.
Pretty templates and styles (color settings)
Enables you to overwrite the looks of a formatted "pretty" log message by providing a template string.
Following settings are available for styling:
-
Templates:
prettyLogTemplate
: template string for log messages. Possible placeholders:
{{yyyy}}
: year{{mm}}
: month{{dd}}
: day{{hh}}
: hour{{MM}}
: minute{{ss}}
: seconds{{ms}}
: milliseconds{{dateIsoStr}}
: Shortcut for {{yyyy}}.{{mm}}.{{dd}} {{hh}}:{{MM}}:{{ss}}:{{ms}}
{{rawIsoStr}}
: Renders the date and time in ISO format (e.g.: YYYY-MM-DDTHH:mm:ss.SSSZ){{logLevelName}}
: name of the log level{{name}}
: optional name of the current logger and his parents (e.g. "ParentLogger:ThisLogger"){{nameWithDelimiterPrefix}}
: optional name of the current logger (s. above) with a delimiter in the beginning{{nameWithDelimiterSuffix}}
: optional name of the current logger (s. above) with a delimiter at the end{{fullFilePath}}
: a full path starting from /
root{{filePathWithLine}}
: a full path below the project path with line number{{fileNameWithLine}}
: file name with line number
prettyErrorTemplate
: template string for error message. Possible placeholders:
{{errorName}}
: name of the error{{errorMessage}}
: error message{{errorStack}}
: Placeholder for all stack lines defined by prettyErrorStackTemplate
prettyErrorStackTemplate
: template string for error stack trace lines. Possible placeholders:
{{fileName}}
: name of the file{{fileNameWithLine}}
: file name with line number{{filePathWithLine}}
: a full path below the project path with a line number{{method}}
: optional name of the invoking method
prettyErrorParentNamesSeparator
: separator to be used when joining names ot the parent logger, and the current one (default: :
)prettyErrorLoggerNameDelimiter
: if a logger name is set this delimiter will be added afterwardsprettyInspectOptions
: Available options
Customizing template tokens
It's possible to add user defined tokes, by overwriting the addPlaceholders
in the settings.overwrite
. this callback allows to add or overwrite tokens in the placeholderValues
.
for example, to add the token: {{custom}}
;
const logger = new Logger({
type: "pretty",
prettyLogTemplate: "{{custom}} ",
overwrite: {
addPlaceholders: (logObjMeta: IMeta, placeholderValues: Record<string, string>) => {
placeholderValues["custom"] = "test";
},
},
});
this would yield in the token {{custom}}
being replaced with "test"
-
Styling:
stylePrettyLogs
: defines whether logs should be styled and colorizedprettyLogStyles
: provides colors and styles for different placeholders and can also be dependent on the value (e.g. log level)
- Level 1: template placeholder (defines a style for a certain template placeholder, s. above, without brackets).
- Level 2: Either a string with one style (e.g.
white
), or an array of styles (e.g. ["bold", "white"]
), or a nested object with key being a value. - Level 3: Optional nested style based on placeholder values. Key is the value of the template placeholder and value is either a string of a style, or an array of styles (s. above), e.g.
{ SILLY: ["bold", "white"] }
which means: value "SILLY" should get a style of "bold" and "white". *
means any value other than the defined.
prettyInspectOptions
: When a (potentially nested) object is printed out in Node.js, we use util.formatWithOptions
under the hood. With prettyInspectOptions
you can define the output. Possible values
-
Time zone support:
prettyLogTimeZone
: Set timezone of pretty log messages to either UTC
(default) or local
(based on your server/browser configuration)
Log meta information
tslog
collects meta information for every log, like runtime, code position etc. The meta information collected depends on the runtime (browser or Node.js) and is accessible through the LogObj
.
You can define the property containing this meta information with metaProperty
, which is "_meta" by default.
Pretty templates and styles (color settings)
const logger = new Logger({
prettyLogTemplate: "{{yyyy}}.{{mm}}.{{dd}} {{hh}}:{{MM}}:{{ss}}:{{ms}}\t{{logLevelName}}\t[{{filePathWithLine}}{{name}}]\t",
prettyErrorTemplate: "\n{{errorName}} {{errorMessage}}\nerror stack:\n{{errorStack}}",
prettyErrorStackTemplate: " • {{fileName}}\t{{method}}\n\t{{filePathWithLine}}",
prettyErrorParentNamesSeparator: ":",
prettyErrorLoggerNameDelimiter: "\t",
stylePrettyLogs: true,
prettyLogTimeZone: "UTC",
prettyLogStyles: {
logLevelName: {
"*": ["bold", "black", "bgWhiteBright", "dim"],
SILLY: ["bold", "white"],
TRACE: ["bold", "whiteBright"],
DEBUG: ["bold", "green"],
INFO: ["bold", "blue"],
WARN: ["bold", "yellow"],
ERROR: ["bold", "red"],
FATAL: ["bold", "redBright"],
},
dateIsoStr: "white",
filePathWithLine: "white",
name: ["white", "bold"],
nameWithDelimiterPrefix: ["white", "bold"],
nameWithDelimiterSuffix: ["white", "bold"],
errorName: ["bold", "bgRedBright", "whiteBright"],
fileName: ["yellow"],
fileNameWithLine: "white",
},
});
Masking secrets in logs
One of the most common ways of a password/secret breach is through log files.
Given the central position of tslog
as the collecting hub of all application logs, it's only natural to use it as a filter.
There are multiple ways of masking secrets, before they get exposed:
maskPlaceholder
: Placeholder to replaced masked secrets with, Default: [***]
maskValuesOfKeys
: Array of keys to replace the values with the placeholder (maskPlaceholder
). Default: ["password"]
maskValuesOfKeysCaseInsensitive
: Should the keys be matched case-insensitive (e.g. "password" would replace "password" as well as "Password", and "PASSWORD"). Default: false
maskValuesRegEx
: For even more flexibility, you can also replace strings and object values with a RegEx.
Prefixing logs
Prefix every log message with an array of additional attributes.
Prefixes propagate to sub-loggers and can help to follow a chain of promises.
In addition to AsyncLocalStorage
, prefixes can help further distinguish different parts of a request.
Hint: A good example could be a GraphQL request, that by design could consist of multiple queries and/or mutations.
Example:
const logger = new Logger({
prefix: ["main-prefix", "parent-prefix"],
});
logger.info("MainLogger message");
const childLogger = logger.getSubLogger({
prefix: ["child1-prefix"],
});
childLogger.info("child1 message");
const grandchildLogger = childLogger.getSubLogger({
prefix: ["grandchild1-prefix"],
});
grandchildLogger.silly("grandchild1 message");
Attach additional transports
tslog
focuses on the one thing it does well: capturing logs.
Therefore, there is no built-in file system logging, log rotation, or similar.
Per default all logs go to console
, which can be overwritten (s. below).
However, you can easily attach as many transports as you wish, enabling you to do fancy stuff
like sending messages to Slack or Telegram in case of an urgent error or forwarding them to a log aggregator service.
Attached transports are also inherited by sub-loggers.
Simple transport example
Here is a very simple implementation used in our jest tests.
This example will suppress logs from being sent to console
(type: "hidden"
) and will instead collect them in an array
.
const transports: any[] = [];
const logger = new Logger({ type: "hidden" });
logger.attachTransport((logObj) => {
transports.push(logObj);
});
const logMsg = logger.info("Log message");
Storing logs in a file
Here is an example of how to store all logs in a file.
import { Logger } from "tslog";
import { appendFileSync } from "fs";
const logger = new Logger();
logger.attachTransport((logObj) => {
appendFileSync("logs.txt", JSON.stringify(logObj) + "\n");
});
logger.debug("I am a debug log.");
logger.info("I am an info log.");
logger.warn("I am a warn log with a json object:", { foo: "bar" });
Storing logs in a file system with rotating files
If you want to limit the file size of the stored logs, a good practice is to use file rotation, where old logs will be deleted automatically.
There is a great library called rotating-file-stream
solving this problem for us and even adding features like compression, file size limit etc.
- First you need to install this library:
npm i rotating-file-stream
- Combine it with
tslog
:
import { Logger } from "tslog";
import { createStream } from "rotating-file-stream";
const stream = createStream("tslog.log", {
size: "10M",
interval: "1d",
compress: "gzip",
});
const logger = new Logger();
logger.attachTransport((logObj) => {
stream.write(JSON.stringify(logObject) + "\n");
});
logger.debug("I am a debug log.");
logger.info("I am an info log.");
logger.warn("I am a warn log with a json object:", { foo: "bar" });
Overwriting default behavior
One of the key advantages of tslog
>= 4 is that you can overwrite pretty much every aspect of the log processing described in "Lifecycle of a log message".
For every log:
const logger = new Logger({
overwrite: {
mask: (args: unknown[]): unknown[] => {
},
toLogObj: (args: unknown[], clonesLogObj?: LogObj): unknown => {
},
addMeta: (logObj: any, logLevelId: number, logLevelName: string) => {
}
},
});
For pretty
logs:
const logger = new Logger({
type: "pretty",
overwrite: {
formatMeta: (meta?: IMeta) => {
},
formatLogObj: <LogObj>(maskedArgs: unknown[], settings: ISettings<LogObj>) => {
},
transportFormatted: (logMetaMarkup: string, logArgs: unknown[], logErrors: string[], settings: unknown) => {
},
},
});
For JSON
logs (no formatting happens here):
const logger = new Logger({
type: "json",
overwrite: {
transportJSON: (logObjWithMeta: any) => {
},
},
});
Defining and accessing logObj
As described in "Lifecycle of a log message", every log message goes through some lifecycle steps and becomes an object representation of the log with the name logObj
.
A default logObj can be passed to the tslog
constructor and will be cloned and merged into the log message. This makes tslog
>= 4 highly configurable and easy to integrate into any 3rd party service.
The entire logObj
will be printed out in JSON
mode and also returned by every log method.
Tip: All properties of the default LogObj
containing function calls will be executed for every log message making use cases possible like requestId
(s. below).
interface ILogObj {
foo: string;
}
const defaultLogObject: ILogObj = {
foo: "bar",
};
const logger = new Logger<ILogObj>({ type: "json" }, defaultLogObject);
const logMsg = logger.info("Test");
Backwards compatibility
tslog
follows a semantic release policy. A major version change indicates breaking changes.
tslog >=4
is less limiting when it comes to configuration. There are many use cases (especially when it comes to integration with 3rd party services) that now can be achieved elegantly and were not possible before.
RequestID: Mark a request (e.g. HTTP) call with AsyncLocalStorage and tslog
Node.js 13.10 introduced a new feature called AsyncLocalStorage.
** Keep track of all subsequent calls and promises originated from a single request (e.g. HTTP).**
In a real world application a call to an API would lead to many logs produced across the entire application.
When debugging it can be quite handy to be able to group all logs based on a unique identifier, e.g. requestId
.
Some providers (e.g. Heroku
) already set a X-Request-ID
header, which we are going to use or fallback to a short ID generated by nanoid
.
In this example every subsequent logger is a sub-logger of the main logger and thus inherits all of its settings making requestId
available throughout the entire application without any further ado.
tslog
works with any API framework (like Express
, Koa
, Hapi
and so on), but in this example we are using Koa
.
import { AsyncLocalStorage } from "async_hooks";
import Koa from "koa";
import { customAlphabet } from "nanoid";
import { Logger } from "tslog";
interface ILogObj {
requestId?: string | (() => string | undefined);
}
const asyncLocalStorage: AsyncLocalStorage<{ requestId: string }> = new AsyncLocalStorage();
const defaultLogObject: ILogObj = {
requestId: () => asyncLocalStorage.getStore()?.requestId,
};
const logger = new Logger<ILogObj>({ type: "json" }, defaultLogObject);
export { logger };
logger.info("Test log without requestId");
const koaApp = new Koa();
koaApp.use(async (ctx: Koa.Context, next: Koa.Next) => {
const requestId: string = (ctx.request.headers["x-request-id"] as string) ?? customAlphabet("1234567890abcdefghijklmnopqrstuvwxyz", 6)();
await asyncLocalStorage.run({ requestId }, async () => {
return next();
});
});
koaApp.use(async (ctx: Koa.Context, next) => {
logger.silly({ originalUrl: ctx.originalUrl, status: ctx.response.status, message: ctx.response.message });
const subLogger = logger.getSubLogger();
subLogger.info("Log containing requestId");
return await next();
});
koaApp.listen(3000);
logger.info("Server running on port 3000");