| [0.22.0] |
| |
| * Removed `pre` from blocktags scanner. `pre` is handled separately |
| in rule 1 and needn't be handled in rule 6. |
| * Added `iframe` to list of blocktags, as per spec change. |
| * Fixed bug with `HRULE` after blank line. This previously caused cmark |
| to break out of a list, thinking it had two consecutive blanks. |
| * Check for empty string before trying to look at line ending. |
| * Make sure every line fed to `S_process_line` ends with `\n` (#72). |
| So `S_process_line` sees only unix style line endings. Ultimately we |
| probably want a better solution, allowing the line ending style of |
| the input file to be preserved. This solution forces output with newlines. |
| * Improved `cmark_strbuf_normalize_whitespace` (#73). Now all characters |
| that satisfy `cmark_isspace` are recognized as whitespace. Previously |
| `\r` and `\t` (and others) weren't included. |
| * Treat line ending with EOF as ending with newline (#71). |
| * Fixed `--hardbreaks` with `\r\n` line breaks (#68). |
| * Disallow list item starting with multiple blank lines (jgm/CommonMark#332). |
| * Allow tabs before closing `#`s in ATX header |
| * Removed `cmark_strbuf_printf` and `cmark_strbuf_vprintf`. |
| These are no longer needed, and cause complications for MSVC. |
| Also removed `HAVE_VA_COPY` and `HAVE_C99_SNPRINTF` feature tests. |
| * Added option to disable tests (Kevin Wojniak). |
| * Added `CMARK_INLINE` macro. |
| * Removed need to disable MSVC warnings 4267, 4244, 4800 |
| (Kevin Wojniak). |
| * Fixed MSVC inline errors when cmark is included in sources that |
| don't have the same set of disabled warnings (Kevin Wojniak). |
| * Fix `FileNotFoundError` errors on tests when cmark is built from |
| another project via `add_subdirectory()` (Kevin Wojniak). |
| * Prefix `utf8proc` functions to avoid conflict with existing library |
| (Kevin Wojniak). |
| * Avoid name clash between Windows `.pdb` files (Nick Wellnhofer). |
| * Improved `smart_punct.txt` (see jgm/commonmark.js#61). |
| * Set `POSITION_INDEPENDENT_CODE` `ON` for static library (see #39). |
| * `make bench`: allow overriding `BENCHFILE`. Previously if you did |
| this, it would clopper `BENCHFILE` with the default bench file. |
| * `make bench`: Use -10 priority with renice. |
| * Improved `make_autolink`. Ensures that title is chunk with empty |
| string rather than NULL, as with other links. |
| * Added `clang-check` target. |
| * Travis: split `roundtrip_test` and `leakcheck` (OGINO Masanori). |
| * Use clang-format, llvm style, for formatting. Reformatted all source files. |
| Added `format` target to Makefile. Removed `astyle` target. |
| Updated `.editorconfig`. |
| |
| [0.21.0] |
| |
| * Updated to version 0.21 of spec. |
| * Added latex renderer (#31). New exported function in API: |
| `cmark_render_latex`. New source file: `src/latex.hs`. |
| * Updates for new HTML block spec. Removed old `html_block_tag` scanner. |
| Added new `html_block_start` and `html_block_start_7`, as well |
| as `html_block_end_n` for n = 1-5. Rewrote block parser for new HTML |
| block spec. |
| * We no longer preprocess tabs to spaces before parsing. |
| Instead, we keep track of both the byte offset and |
| the (virtual) column as we parse block starts. |
| This allows us to handle tabs without converting |
| to spaces first. Tabs are left as tabs in the output, as |
| per the revised spec. |
| * Removed utf8 validation by default. We now replace null characters |
| in the line splitting code. |
| * Added `CMARK_OPT_VALIDATE_UTF8` option and command-line option |
| `--validate-utf8`. This option causes cmark to check for valid |
| UTF-8, replacing invalid sequences with the replacement |
| character, U+FFFD. Previously this was done by default in |
| connection with tab expansion, but we no longer do it by |
| default with the new tab treatment. (Many applications will |
| know that the input is valid UTF-8, so validation will not |
| be necessary.) |
| * Added `CMARK_OPT_SAFE` option and `--safe` command-line flag. |
| + Added `CMARK_OPT_SAFE`. This option disables rendering of raw HTML |
| and potentially dangerous links. |
| + Added `--safe` option in command-line program. |
| + Updated `cmark.3` man page. |
| + Added `scan_dangerous_url` to scanners. |
| + In HTML, suppress rendering of raw HTML and potentially dangerous |
| links if `CMARK_OPT_SAFE`. Dangerous URLs are those that begin |
| with `javascript:`, `vbscript:`, `file:`, or `data:` (except for |
| `image/png`, `image/gif`, `image/jpeg`, or `image/webp` mime types). |
| + Added `api_test` for `OPT_CMARK_SAFE`. |
| + Rewrote `README.md` on security. |
| * Limit ordered list start to 9 digits, per spec. |
| * Added width parameter to `render_man` (API change). |
| * Extracted common renderer code from latex, man, and commonmark |
| renderers into a separate module, `renderer.[ch]` (#63). To write a |
| renderer now, you only need to write a character escaping function |
| and a node rendering function. You pass these to `cmark_render` |
| and it handles all the plumbing (including line wrapping) for you. |
| So far this is an internal module, but we might consider adding |
| it to the API in the future. |
| * commonmark writer: correctly handle email autolinks. |
| * commonmark writer: escape `!`. |
| * Fixed soft breaks in commonmark renderer. |
| * Fixed scanner for link url. re2c returns the longest match, so we |
| were getting bad results with `[link](foo\(and\(bar\)\))` |
| which it would parse as containing a bare `\` followed by |
| an in-parens chunk ending with the final paren. |
| * Allow non-initial hyphens in html tag names. This allows for |
| custom tags, see jgm/CommonMark#239. |
| * Updated `test/smart_punct.txt`. |
| * Implemented new treatment of hyphens with `--smart`, converting |
| sequences of hyphens to sequences of em and en dashes that contain no |
| hyphens. |
| * HTML renderer: properly split info on first space char (see |
| jgm/commonmark.js#54). |
| * Changed version variables to functions (#60, Andrius Bentkus). |
| This is easier to access using ffi, since some languages, like C# |
| like to use only function interfaces for accessing library |
| functionality. |
| * `process_emphasis`: Fixed setting lower bound to potential openers. |
| Renamed `potential_openers` -> `openers_bottom`. |
| Renamed `start_delim` -> `stack_bottom`. |
| * Added case for #59 to `pathological_test.py`. |
| * Fixed emphasis/link parsing bug (#59). |
| * Fixed off-by-one error in line splitting routine. |
| This caused certain NULLs not to be replaced. |
| * Don't rtrim in `subject_from_buffer`. This gives bad results in |
| parsing reference links, where we might have trailing blanks |
| (`finalize` removes the bytes parsed as a reference definition; |
| before this change, some blank bytes might remain on the line). |
| + Added `column` and `first_nonspace_column` fields to `parser`. |
| + Added utility function to advance the offset, computing |
| the virtual column too. Note that we don't need to deal with |
| UTF-8 here at all. Only ASCII occurs in block starts. |
| + Significant performance improvement due to the fact that |
| we're not doing UTF-8 validation. |
| * Fixed entity lookup table. The old one had many errors. |
| The new one is derived from the list in the npm entities package. |
| Since the sequences can now be longer (multi-code-point), we |
| have bumped the length limit from 4 to 8, which also affects |
| `houdini_html_u.c`. An example of the kind of error that was fixed: |
| `≧̸` should be rendered as "≧̸" (U+02267 U+00338), but it was |
| being rendered as "≧" (which is the same as `≧`). |
| * Replace gperf-based entity lookup with binary tree lookup. |
| The primary advantage is a big reduction in the size of |
| the compiled library and executable (> 100K). |
| There should be no measurable performance difference in |
| normal documents. I detected only a slight performance |
| hit in a file containing 1,000,000 entities. |
| + Removed `src/html_unescape.gperf` and `src/html_unescape.h`. |
| + Added `src/entities.h` (generated by `tools/make_entities_h.py`). |
| + Added binary tree lookup functions to `houdini_html_u.c`, and |
| use the data in `src/entities.h`. |
| * Renamed `entities.h` -> `entities.inc`, and |
| `tools/make_entities_h.py` -> `tools/make_entitis_inc.py`. |
| * Fixed cases like |
| ``` |
| [ref]: url |
| "title" ok |
| ``` |
| Here we should parse the first line as a reference. |
| * `inlines.c`: Added utility functions to skip spaces and line endings. |
| * Fixed backslashes in link destinations that are not part of escapes |
| (jgm/commonmark#45). |
| * `process_line`: Removed "add newline if line doesn't have one." |
| This isn't actually needed. |
| * Small logic fixes and a simplification in `process_emphasis`. |
| * Added more pathological tests: |
| + Many link closers with no openers. |
| + Many link openers with no closers. |
| + Many emph openers with no closers. |
| + Many closers with no openers. |
| + `"*a_ " * 20000`. |
| * Fixed `process_emphasis` to handle new pathological cases. |
| Now we have an array of pointers (`potential_openers`), |
| keyed to the delim char. When we've failed to match a potential opener |
| prior to point X in the delimiter stack, we reset `potential_openers` |
| for that opener type to X, and thus avoid having to look again through |
| all the openers we've already rejected. |
| * `process_inlines`: remove closers from delim stack when possible. |
| When they have no matching openers and cannot be openers themselves, |
| we can safely remove them. This helps with a performance case: |
| `"a_ " * 20000` (jgm/commonmark.js#43). |
| * Roll utf8proc_charlen into utf8proc_valid (Nick Wellnhofer). |
| Speeds up "make bench" by another percent. |
| * `spec_tests.py`: allow `→` for tab in HTML examples. |
| * `normalize.py`: don't collapse whitespace in pre contexts. |
| * Use utf-8 aware re2c. |
| * Makefile afl target: removed `-m none`, added `CMARK_OPTS`. |
| * README: added `make afl` instructions. |
| * Limit generated generated `cmark.3` to 72 character line width. |
| * Travis: switched to containerized build system. |
| * Removed `debug.h`. (It uses GNU extensions, and we don't need it anyway.) |
| * Removed sundown from benchmarks, because the reading was anomalous. |
| sundown had an arbitrary 16MB limit on buffers, and the benchmark |
| input exceeded that. So who knows what we were actually testing? |
| Added hoedown, sundown's successor, which is a better comparison. |
| |
| [0.20.0] |
| |
| * Fixed bug in list item parsing when items indented >= 4 spaces (#52). |
| * Don't allow link labels with no non-whitespace characters |
| (jgm/CommonMark#322). |
| * Fixed multiple issues with numeric entities (#33, Nick Wellnhofer). |
| * Support CR and CRLF line endings (Ben Trask). |
| * Added test for different line endings to `api_test`. |
| * Allow NULL value in string setters (Nick Wellnhofer). (NULL |
| produces a 0-length string value.) Internally, URL and |
| title are now stored as `cmark_chunk` rather than `char *`. |
| * Fixed memory leak in `cmark_consolidate_text_nodes` (#32). |
| * Fixed `is_autolink` in the CommonMark renderer (#50). Previously *any* |
| link with an absolute URL was treated as an autolink. |
| * Cope with broken `snprintf` on Windows (Nick Wellnhofer). On Windows, |
| `snprintf` returns -1 if the output was truncated. Fall back to |
| Windows-specific `_scprintf`. |
| * Switched length parameter on `cmark_markdown_to_html`, |
| `cmark_parser_feed`, and `cmark_parse_document` from `int` |
| to `size_t` (#53, Nick Wellnhofer). |
| * Use a custom type `bufsize_t` for all string sizes and indices. |
| This allows to switch to 64-bit string buffers by changing a single |
| typedef and a macro definition (Nick Wellnhofer). |
| * Hardened the `strbuf` code, checking for integer overflows and |
| adding range checks (Nick Wellnhofer). |
| * Removed unused function `cmark_strbuf_attach` (Nick Wellnhofer). |
| * Fixed all implicit 64-bit to 32-bit conversions that |
| `-Wshorten-64-to-32` warns about (Nick Wellnhofer). |
| * Added helper function `cmark_strbuf_safe_strlen` that converts |
| from `size_t` to `bufsize_t` and throws an error in case of |
| an overflow (Nick Wellnhofer). |
| * Abort on `strbuf` out of memory errors (Nick Wellnhofer). |
| Previously such errors were not being trapped. This involves |
| some internal changes to the `buffer` library that do not affect |
| the API. |
| * Factored out `S_find_first_nonspace` in `S_proces_line`. |
| Added fields `offset`, `first_nonspace`, `indent`, and `blank` |
| to `cmark_parser` struct. This just removes some repetition. |
| * Added Racket Racket (5.3+) wrapper (Eli Barzilay). |
| * Removed `-pg` from Debug build flags (#47). |
| * Added Ubsan build target, to check for undefined behavior. |
| * Improved `make leakcheck`. We now return an error status if anything |
| in the loop fails. We now check `--smart` and `--normalize` options. |
| * Removed `wrapper3.py`, made `wrapper.py` work with python 2 and 3. |
| Also improved the wrapper to work with Windows, and to use smart |
| punctuation (as an example). |
| * In `wrapper.rb`, added argument for options. |
| * Revised luajit wrapper. |
| * Added build status badges to README.md. |
| * Added links to go, perl, ruby, R, and Haskell bindings to README.md. |
| |
| [0.19.0] |
| |
| * Fixed `_` emphasis parsing to conform to spec (jgm/CommonMark#317). |
| * Updated `spec.txt`. |
| * Compile static library with `-DCMARK_STATIC_DEFINE` (Nick Wellnhofer). |
| * Suppress warnings about Windows runtime library files (Nick Wellnhofer). |
| Visual Studio Express editions do not include the redistributable files. |
| Set `CMAKE_INSTALL_SYSTEM_RUNTIME_LIBS_NO_WARNINGS` to suppress warnings. |
| * Added appyeyor: Windows continuous integration (`appveyor.yml`). |
| * Use `os.path.join` in `test/cmark.py` for proper cross-platform paths. |
| * Fixed `Makefile.nmake`. |
| * Improved `make afl`: added `test/afl_dictionary`, increased timeout |
| for hangs. |
| * Improved README with a description of the library's strengths. |
| * Pass-through Unicode non-characters (Nick Wellnhofer). |
| Despite their name, Unicode non-characters are valid code points. They |
| should be passed through by a library like libcmark. |
| * Check return status of `utf8proc_iterate` (#27). |
| |
| [0.18.3] |
| |
| * Include patch level in soname (Nick Wellnhofer). Minor version is |
| tied to spec version, so this allows breaking the ABI between spec |
| releases. |
| * Install compiler-provided system runtime libraries (Changjiang Yang). |
| * Use `strbuf_printf` instead of `snprintf`. `snprintf` is not |
| available on some platforms (Visual Studio 2013 and earlier). |
| * Fixed memory access bug: "invalid read of size 1" on input `[link](<>)`. |
| |
| [0.18.2] |
| |
| * Added commonmark renderer: `cmark_render_commonmark`. In addition |
| to options, this takes a `width` parameter. A value of 0 disables |
| wrapping; a positive value wraps the document to the specified |
| width. Note that width is automatically set to 0 if the |
| `CMARK_OPT_HARDBREAKS` option is set. |
| * The `cmark` executable now allows `-t commonmark` for output as |
| CommonMark. A `--width` option has been added to specify wrapping |
| width. |
| * Added `roundtrip_test` Makefile target. This runs all the spec |
| through the commonmark renderer, and then through the commonmark |
| parser, and compares normalized HTML to the test. All tests pass |
| with the current parser and renderer, giving us some confidence that |
| the commonmark renderer is sufficiently robust. Eventually this |
| should be pythonized and put in the cmake test routine. |
| * Removed an unnecessary check in `blocks.c`. By the time we check |
| for a list start, we've already checked for a horizontal rule, so |
| we don't need to repeat that check here. Thanks to Robin Stocker for |
| pointing out a similar redundancy in commonmark.js. |
| * Fixed bug in `cmark_strbuf_unescape` (`buffer.c`). The old function |
| gave incorrect results on input like `\\*`, since the next backslash |
| would be treated as escaping the `*` instead of being escaped itself. |
| * `scanners.re`: added `_scan_scheme`, `scan_scheme`, used in the |
| commonmark renderer. |
| * Check for `CMAKE_C_COMPILER` (not `CC_COMPILER`) when setting C flags. |
| * Update code examples in documentation, adding new parser option |
| argument, and using `CMARK_OPT_DEFAULT` (Nick Wellnhofer). |
| * Added options parameter to `cmark_markdown_to_html`. |
| * Removed obsolete reference to `CMARK_NODE_LINK_LABEL`. |
| * `make leakcheck` now checks all output formats. |
| * `test/cmark.py`: set default options for `markdown_to_html`. |
| * Warn about buggy re2c versions (Nick Wellnhofer). |
| |
| [0.18.1] |
| |
| * Build static version of library in default build (#11). |
| * `cmark.h`: Add missing argument to `cmark_parser_new` (#12). |
| |
| [0.18] |
| |
| * Switch to 2-clause BSD license, with agreement of contributors. |
| * Added Profile build type, `make prof` target. |
| * Fixed autolink scanner to conform to the spec. Backslash escapes |
| not allowed in autolinks. |
| * Don't rely on strnlen being available (Nick Wellnhofer). |
| * Updated scanners for new whitespace definition. |
| * Added `CMARK_OPT_SMART` and `--smart` option, `smart.c`, `smart.h`. |
| * Added test for `--smart` option. |
| * Fixed segfault with --normalize (closes #7). |
| * Moved normalization step from XML renderer to `cmark_parser_finish`. |
| * Added options parameter to `cmark_parse_document`, `cmark_parse_file`. |
| * Fixed man renderer's escaping for unicode characters. |
| * Don't require python3 to make `cmark.3` man page. |
| * Use ASCII escapes for punctuation characters for portability. |
| * Made `options` an int rather than a long, for consistency. |
| * Packed `cmark_node` struct to fit into 128 bytes. |
| This gives a small performance boost and lowers memory usage. |
| * Repacked `delimiter` struct to avoid hole. |
| * Fixed use-after-free bug, which arose when a paragraph containing |
| only reference links and blank space was finalized (#9). |
| Avoid using `parser->current` in the loop that creates new |
| blocks, since `finalize` in `add_child` may have removed |
| the current parser (if it contains only reference definitions). |
| This isn't a great solution; in the long run we need to rewrite |
| to make the logic clearer and to make it harder to make |
| mistakes like this one. |
| * Added 'Asan' build type. `make asan` will link against ASan; the |
| resulting executable will do checks for memory access issues. |
| Thanks @JordanMilne for the suggestion. |
| * Add Makefile target to fuzz with AFL (Nick Wellnhofer) |
| The variable `$AFL_PATH` must point to the directory containing the AFL |
| binaries. It can be set as an environment variable or passed to make on |
| the command line. |
| |
| [0.17] |
| |
| * Stripped out all JavaScript related code and documentation, moving |
| it to a separate repository (<https://github.com/jgm/commonmark.js>). |
| * Improved Makefile targets, so that `cmake` is run again only when |
| necessary (Nick Wellnhofer). |
| * Added `INSTALL_PREFIX` to the Makefile, allowing installation to a |
| location other than `/usr/local` without invoking `cmake` |
| manually (Nick Wellnhofer). |
| * `make test` now guarantees that the project will |
| be rebuilt before tests are run (Nick Wellnhofer). |
| * Prohibited overriding of some Makefile variables (Nick Wellnhofer). |
| * Provide version number and string, both as macros |
| (`CMARK_VERSION`, `CMARK_VERSION_STRING`) and as symbols |
| (`cmark_version`, `cmark_version_string`) (Nick Wellnhofer). All of |
| these come from `cmark_version.h`, which is constructed from a |
| template `cmark_version.h.in` and data in `CMakeLists.txt`. |
| * Avoid calling `free` on null pointer. |
| * Added an accessor for an iterator's root node (`cmark_iter_get_root`). |
| * Added user data field for nodes (Nick Wellnhofer). This is |
| intended mainly for use in bindings for dynamic languages, where |
| it could store a pointer to a target language object (#287). But |
| it can be used for anything. |
| * Man renderer: properly escape multiline strings. |
| * Added assertion to raise error if finalize is called on a closed block. |
| * Implemented the new spec rule for emphasis and strong emphasis with `_`. |
| * Moved the check for fence-close with the other checks for end-of-block. |
| * Fixed a bug with loose list detection with items containings |
| fenced code blocks (#285). |
| * Removed recursive algorithm in `ends_with_blank_line` (#286). |
| * Minor code reformatting: renamed parameters. |
| |
| [0.16] |
| |
| * Added xml renderer (XML representation of the CommonMark AST, |
| which is described in `CommonMark.dtd`). |
| * Reduced size of gperf entity table (Nick Wellnhofer). |
| * Reworked iterators to allow deletion of nodes during iteration |
| (Nick Wellnhofer). |
| * Optimized `S_is_leaf`. |
| * Added `cmark_iter_reset` to iterator API. |
| * Added `cmark_consolidate_text_nodes` to API to combine adjacent |
| text nodes. |
| * Added `CMARK_OPT_NORMALIZE` to options (this combines adjacent |
| text nodes). |
| * Added `--normalize` option to command-line program. |
| * Improved regex for HTML comments in inline parsing. |
| * Python is no longer required for a basic build from the |
| repository. |
