This project contains scripts to generate data tables used to support Unicode for the Scala Native and Scala.js platforms.
The tables or sequences generated are used to support java.lang.Character
and also re2s
in Scala Native which is used to support regular
expressions (regex) including java.util.regex._
.
Scala Native currently tracks JDK8 which uses Unicode 6.2.0. The starting
point for this project was Unicode 7.0.0 which was somewhat arbitrarily
used for the first uppercase/lowercase
implementation. JDK11 which is
the next production release of Java tracks Unicode 10.0.0. The
disadvantage to the newer standards is that they contain more code
points which translates to more data and larger binary sizes. This runs
in a detrimental direction to goal #4 below but has added
fonts and emojis.
The overall goals of this project are as follows:
regex
and Character
can be sharedThe documentation and databases can be found on the
Unicode Server. Some Data and docs are
added to this project in the docs
directory for easy access. Most of the
written documentation is located at the Unicode sit and linked to from
this README.
The code charts and other docs are highly useful. Links are provided to there version specified below from the original location. The following are from Unicode 7.0.0. The Code Charts can be found on the Unicode Server above and the other documents can be found on the main site for Unicode 7.0.0.
CodeCharts.pdf 97.7 MB
UnicodeStandard-7.0.pdf 12.8 MB
The Unicode Consortium also provides Locale data which could be used in a similar manner if needed in the future.
Unicode 10.0.0 has been added to the resources of the project. Applications
take an optional argument for the Unicode version. In order to run from sbt
with a command line argument see the following:
sbt> run 10.0.0
Then select the application you want to run by the number listed.
[warn] Multiple main classes detected. Run 'show discoveredMainClasses' to see the list
Multiple main classes detected, select one to run:
[1] org.ekrich.unicode.BinarySearchTest
[2] org.ekrich.unicode.CaseFolding
[3] org.ekrich.unicode.CaseFoldingTest
[4] org.ekrich.unicode.UnicodeData
Enter number: 4
The default without an argument uses Unicode 6.3.0. This version was used since it was a minor update from JDK8's 6.2.0 whereas 7.0.0 added many new codes.