summaryrefslogtreecommitdiff
path: root/util/unicode
AgeCommit message (Collapse)AuthorFilesLines
2010-03-05Fix the code after merge: DerivedNormalizationProps has two or more columnsThiago Macieira1-1/+1
2010-03-05add some usefull definitions to qunicodetables_p.hRitt Konstantin1-2/+3
* CURRENT_VERSION macro in qunicodetables.cpp was renamed to UNICODE_DATA_VERSION and it's definition was moved to qunicodetables_p.h * LAST_UNICODE_CHAR macro in qchar.cpp was renamed to UNICODE_LAST_CODEPOINT and it's definition was moved to qunicodetables_p.h Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
2010-03-05finish last commitRitt Konstantin1-3/+4
don't skip non-starters in composition exclusions code; warn & exit instead Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
2010-03-05prefer DerivedNormalizationProps.txt over CompositionExclusions.txtRitt Konstantin2-208/+28
1) http://www.unicode.org/reports/tr44/ :2.1 > Implementations should simply use the derived properties, > and should not try to rederive them from lists of simple > properties and collections of rules, because of the chances > for error and divergence when doing so. 2) DerivedNormalizationProps.txt file also provides additional info that can be used for Normalization Form Quick Check algorithm implementation some later Note: this commit *must not* change anything in the (re)generated data; any change in generated data will point to the data inconsistency between CompositionExclusions.txt, DerivedNormalizationProps.txt and UnicodeData.txt files Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
2010-03-05improve error reporting a bit moreRitt Konstantin1-1/+8
Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
2010-03-05improve error reportingRitt Konstantin1-0/+8
warn on upperCaseDiff/lowerCaseDiff/titleCaseDiff/caseFoldDiff 's value exceeds signed short bounds Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
2010-03-05fix incorect conditionRitt Konstantin1-1/+1
Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
2010-03-05check if string to int conversions were done w/o errorsRitt Konstantin1-3/+18
Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
2010-03-05improve error reporting for unassigned grapheme/word/sentence break classesRitt Konstantin1-8/+18
Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
2010-03-05avoid using of qunicodetables_p.h in generatorRitt Konstantin1-1/+3
we can do that after last changes Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
2010-03-05use QHash for line break mapRitt Konstantin1-45/+74
to be consistent with other maps this also improves perfomance a bit Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
2010-03-05use QHash for age mapRitt Konstantin1-26/+29
to be consistent with other maps Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
2010-03-05minor clean-upsRitt Konstantin1-42/+44
no changes in behavior in our case `c->cat != QChar::NoCategory` logically equals to `c->name` and the latter expression used in other maps Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
2010-03-05generate specialCaseMap as set of human-readable code-sequencesRitt Konstantin1-3/+3
Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
2010-03-05make sure that the sequences in specialCaseMap are uniqueRitt Konstantin1-1/+1
there is was a bug caused appending the same sequence again and again... this fix also reduces count of unique unicode properties (and blocks) Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
2010-03-05Unicode character property 'General_Category=Cn' was erroneously ignoredRitt Konstantin1-1/+1
causing two related bugs in QChar::category() and QChar::isPrint(). As described in tr44, 4.2.8 Default Values General_Category character property should be setted to Cn for all codepoints omitted in UCD. Instead they was mapped to QChar::NoCategory (=0) which have no equivalent in Unicode specs and as result was ignored in filtering by binary mask. Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
2010-03-05fix some 0x10000 codepoint -related issuesRitt Konstantin1-10/+8
Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
2010-03-05minor cleanups and styling fixes for generator and generated codeRitt Konstantin1-92/+98
Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
2010-03-05apply some (forgotten) changes to generator as they were applied to the dataRitt Konstantin1-3/+9
b6542eb2 - Thierry Bastian) fix to exported symbol 2e429e40 - Lars Knoll) N'Ko support Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
2010-03-05adjust unicode tables generator to work better under winRitt Konstantin2-0/+2
* protect data-files from crlf line-endings since generator asserts on windows because of crlf line endings * assume generator is a console app Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
2010-02-24Add the Unicode normalisation properties.Thiago Macieira1-0/+2650
Source: http://unicode.org/Public/5.0.0/ucd/DerivedNormalizationProps.txt Reviewed-by: Trust Me
2010-01-07Update copyright year to 2010Jason McDonald3-4/+4
Reviewed-by: Trust Me
2009-09-09Update license headers embedded in code.Jason McDonald1-0/+1
Reviewed-by: Trust Me
2009-09-09Update license headers again.Jason McDonald3-16/+15
Reviewed-by: Trust Me
2009-09-03Add missing license headersJason McDonald1-0/+41
Reviewed-by: Trust Me
2009-08-31Update tech preview license header.Jason McDonald2-39/+39
Reviewed-by: Trust Me
2009-08-11Update license headers.Jason McDonald2-25/+25
Reviewed-by: Trust Me
2009-07-01Fixed the build on Windows after regenerating the unicode tables.Denis Dzyubenko1-2/+2
Reviewed-by: trustme
2009-07-01Fixed the license header that the unicode table generated uses.Denis Dzyubenko1-8/+85
Also made sure that the generated code will not have trailing whitespaces. Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
2009-07-01operator==() for Unicode properties was omitting one property, which ↵Chusslove Illich (Часлав Илић)1-0/+1
resulted in wrong choice of unique properties for characters 451-45f. Reviewed-By: Thiago Macieira <thiago.macieira@nokia.com> Reviewed-By: Denis Dzyubenko <denis.dzyubenko@nokia.com>
2009-06-16Update license headers as requested by the marketing department.Jason McDonald2-4/+4
Reviewed-by: Trust Me
2009-03-23Long live Qt 4.5!Lars Knoll26-0/+61755
generated by cgit v1.2.3 (git 2.39.1) at 2024-11-23 10:48:36 +0000