mdx_bleach

mdx_bleach

mdx_bleach is a Python-Markdown extension that sanitizes the output of untrusted Markdown documents based on a whitelist. The extension is based on Bleach, a robust whitelist-based HTML sanitizer.

By design, all HTML markup is allowed in Markdown documents. Unless written inside a code block, raw HTML is not escaped and is therefore rendered by the web browsers. While this is a nice authoring feature, it also exposes some XSS vulnerabilities. That becomes a problem when the source of a Markdown document is untrusted.

mdx_bleach intends to provide a safer and more flexible alternative to Python-Markdown's deprecated safe mode.

Installation

pip install mdx_bleach

Basic Usage

>>> import markdown
>>> from mdx_bleach.extension import BleachExtension
>>> bleach = BleachExtension()
>>> md = markdown.Markdown(extensions=[bleach])
>>> md.convert('<span>is not allowed</span>')
u'<p>&lt;span&gt;is not allowed&lt;/span&gt;</p>'

Because the <span> tag isn't allowed by default, mdx_bleach escapes it. The default whitelists can be found in mdx_bleach.whitelist.

Configuration

To configure mdx_bleach, pass the following keyword arguments to BleachExtension:

• tags Tag Whitelist
• attributes Attribute Whitelist
• styles Styles Whitelist
• protocols Protocols Whitelist
• strip Stripping Markup
• strip_comments Stripping Comments

The following example reflects the default configuration:

from mdx_bleach.whitelist import ALLOWED_TAGS, ALLOWED_ATTRIBUTES, ALLOWED_STYLES, ALLOWED_PROTOCOLS
bleach = BleachExtension(tags=ALLOWED_TAGS, attributes=ALLOWED_ATTRIBUTES,
    styles=ALLOWED_STYLES, protocols=ALLOWED_PROTOCOLS, strip=False, strip_comments=True)
md = markdown.Markdown(extensions=[bleach])

Tag Whitelist

The tags kwarg is a whitelist of allowed HTML tags. It should be a list, tuple, or other iterable. Any other HTML tags will be escaped or stripped from the text. This applies to the HTML output that Markdown produces.

Since Markdown commonly generates HTML elements like p, a, img, etc. it is recommended to allow no less than the default tag whitelist found in mdx_bleach.whitelist.ALLOWED_TAGS.

For example:

>>> from mdx_bleach.whitelist import ALLOWED_TAGS
>>> bleach = BleachExtension(tags=ALLOWED_TAGS + ['small'])
>>> md = markdown.Markdown(extensions=[bleach])
>>> md.convert('<small>is allowed</small>')
u'<p><small>is allowed</small></p>'

This will allow authored small tags and any tag from the default whitelist. Note that if a third party extension that can generate more specific tags is installed, you might want to whitelist those additional tags as well.

Attribute Whitelist

The attributes kwarg is a whitelist of attributes. It can be a list, in which case the attributes are allowed for any tag, or a dictionary, in which case the keys are tag names (or a wildcard: * for all tags) and the values are lists of allowed attributes.

The default value is a conservative dictionary found in mdx_bleach.whitelist.ALLOWED_ATTRIBUTES. If you override the attributes kwarg and still want to support images and links, make sure to allow the href and title attributes in <a> tags, as well as the src, title and alt attributes in <img> tags.

For example:

attrs = {
    '*': ['class'],
    'a': ['href', 'title', 'rel'],
    'img': ['src', 'title', 'alt'],
}
bleach = BleachExtension(attributes=attrs)

In this case, the class attribute is allowed on any allowed element (from the tags argument), <a> tags are allowed to have href, title and rel attributes, and so on.

You can also use a callable (instead of a list). If the callable returns True, the attribute is allowed. Otherwise, it is stripped.

For example:

def filter_src(name, value):
    if name in ('alt', 'title', 'height', 'width'):
        return True
    if name == 'src':
        p = urlparse(value)
        return (not p.netloc) or p.netloc == 'mydomain.com'
    return False

Styles Whitelist

If you allow the style attribute, you will also need to whitelist styles authors are allowed to set, for example color and background-color. The default value is an empty list.

For example, to allow authors to set the color and font-weight of span elements:

tags = ALLOWED_TAGS + ['span']
attrs = ALLOWED_ATTRIBUTES.copy()
attrs['span'] =  ['style']
styles = ['color', 'font-weight']
bleach = BleachExtension(tags=tags, attributes=attrs, styles=styles)

Protocol Whitelist

If you allow tags that have attributes containing a URI value (like the href attribute of an anchor tag,) you may want to adapt the accepted protocols. The default list only allows http, https and mailto.

For example, this sets allowed protocols to http, https and smb:

protocols = ['http', 'https', 'smb']
bleach = BleachExtension(protocols=protocols)

This adds smb to the bleach-specified set of allowed protocols:

bleach = BleachExtension(protocols=ALLOWED_PROTOCOLS + ['smb'])

Stripping Markup

By default, Bleach escapes disallowed or invalid markup. For example:

>>> md = markdown.Markdown(extensions=[BleachExtension()])
>>> md.convert('<span>is not allowed</span>')
u'<p>&lt;span&gt;is not allowed&lt;/span&gt;'

If you would rather Bleach stripped this markup entirely, you can pass strip=True:

>>> md = markdown.Markdown(extensions=[BleachExtension(strip=True)])
>>> md.convert('<span>is not allowed</span>')
u'<p>is not allowed</p>'

Stripping Comments

By default, Bleach will strip out HTML comments. To disable this behavior, set strip_comments=False:

>>> html = 'my<!-- commented --> html'

>>> md = markdown.Markdown(extensions=[BleachExtension()])
>>> md.convert(html)
u'<p>my html</p>'

>>> md = markdown.Markdown(extensions=[BleachExtension(strip_comments=False)])
>>> md.convert(html)
u'<p>my<!-- commented --> html</p>'

Links

• Source
• Bleach
• Markdown
• Python-Markdown