3 Commits

Author	SHA1	Message	Date
kenkeiras	998a183fd2	Dig deeper in cut-by-token approach.	2018-04-15 17:47:04 +02:00
kenkeiras	d601ae3f83	Increase logging, add failing tokenization tests.	2018-04-15 17:08:01 +02:00
kenkeiras	fc37450565	Add (non-passing) tokenization.	2018-04-15 16:41:07 +02:00