aboutsummaryrefslogtreecommitdiff
path: root/share/ctypedef
Commit message (Collapse)AuthorAgeFilesLines
* locale: make install Unicode 17.0.0/CLDR 48Jose Luis Duran2025-12-081-6/+5765
| | | | | | | | | | | | Unicode 17.0 adds 4803 characters, for a total of 159,801 characters. The new additions include 4 new scripts: - Sidetic - Tolong Siki - Beria Erfe - Tai Yo https://www.unicode.org/versions/Unicode17.0.0/
* ctypedef: Remove `|| true` from localedef command to reveal error soonerLi-Wen Hsu2024-10-151-2/+2
| | | | | | | Reviewed by: bapt MFC after: 3 days Sponsored by: The FreeBSD Foundation Differential Revision: https://reviews.freebsd.org/D47111
* Unicode: revert to unicode 15.0.0Baptiste Daroussin2024-10-141-8/+0
| | | | | Unicode the generation of UTF-8 ctype is somehow broken for now for unicode 16, so for now revert to unicode 15
* locales: update unicode version 16 and CLDR to version 45Baptiste Daroussin2024-10-141-0/+8
|
* Remove residual blank line at start of MakefileWarner Losh2024-07-151-1/+0
| | | | | | | This is a residual of the $FreeBSD$ removal. MFC After: 3 days (though I'll just run the command on the branches) Sponsored by: Netflix
* Remove $FreeBSD$: one-line sh patternWarner Losh2023-08-162-2/+0
| | | | Remove /^\s*#[#!]?\s*\$FreeBSD\$.*$\n/
* locale: update to CLDR 43 and Unicode 15Yuri Pankov2023-08-031-2/+299
| | | | | Reviewed by: bapt Differential Revision: https://reviews.freebsd.org/D41151
* locales: Update to CLDR 41.0 and Unicode 14.0Baptiste Daroussin2022-04-211-3/+912
| | | | Relnotes: yes
* localedef: unbreak WITHOUT_LOCALESBjoern A. Zeeb2021-08-191-1/+1
| | | | | | | | | | | | | | | After 0fa5403d493b ("pkgbase: move locales into their own package") we need usr.bin/localedef as a bootstrap tool independent on where WITHOUT_LOCALE was specified as we ALWAYS process C.UTF-8. At the same time LOCALES= in the local Makefile is empty but C.UTF-8 with WITHOUT_LOCALES. C.UTF-8 is excluded from FILES, and thus after the replacement FILES= is set to only .LC_CTYPE which results in a build failure not knowing how to build that. Tweak the substitution to replace only non-empty words so that FILES remains harmlessly empty. Reviewed by: imp Differential Revision: https://reviews.freebsd.org/D31589
* pkgbase: locales: Also tag the files dirEmmanuel Vadot2021-08-061-0/+1
| | | | | | Otherwise bsd.dirs.mk will create the directory with the default package (utilities) and we end up with a bunch of empty dirs managed by this package while it shouldn't be the case.
* ctypedef: fix installation of C.UTF-8Kyle Evans2021-08-061-1/+2
| | | | | | | | | | | | | | | The appropriate directory and name were assigned to the FILESDIR grouping, but not the ALWAYS grouping where C.UTF-8 is actually assigned. Add the appropriate bits for ALWAYSDIR, and remove an obsolete *PACKAGE= assignment since C.UTF-8 is explicitly not included in FILES. Prior to this change, C.UTF-8 was being installed as /usr/share/C.UTF-8.LC_CTYPE. Reviewed by: manu Fixes: 0fa5403d493b ("pkgbase: move locales into their own package") Differential Revision: https://reviews.freebsd.org/D31429
* pkgbase: move locales into their own packageBaptiste Daroussin2021-08-031-1/+8
| | | | | | | | The only exception here being C.UTF-8 as this is the default locales so it needs to always be installed Reviewed by: pkgbase (emaste) Differential Revision: https://reviews.freebsd.org/D31397
* locales: fix abuse of bsd.dirs.mkBaptiste Daroussin2021-08-031-2/+2
| | | | | | | | the way SAMEDIRS was defined was an abuse of bsd.dirs.mk resulting in all the directory to be created in one single command, but DESTDIR is only prepend once on the first element of the list Switch to the properway to use bsd.dirs.mk
* locales: stop hardcoding the directories in the mtreeBaptiste Daroussin2021-08-031-0/+2
| | | | | | | | | The framework knows how to create directories and tag them properly for a the creation of a mtree, not need to hardcode all the locales entries in bsd.usr.mk This simplifies addition of new locales but also allow people building with WITHOUT_LOCALES to end up with a directory full of empty files
* locale: Add Farsi/Persian localesFaraz Vahedi2021-07-231-0/+2
| | | | | | MFC after: 3 weeks Reviewed by: farrokhi Differential Revision: https://reviews.freebsd.org/D24359
* locales: upgrade CLDR to 39.0 and Unicode to 13.0.0Baptiste Daroussin2021-07-231-10/+1532
| | | | | MFC after: 3 weeks Relnotes: yes
* locales: now that C.UTF-8 is the default locale, always install itBaptiste Daroussin2021-07-231-0/+3
| | | | MFC after: 3 weeks
* locales: separate unicode from other localesBaptiste Daroussin2021-07-231-4/+0
| | | | | | | | Unicode locales are maintained and to evolved in cldr. Generating the other locales from the unicode gets more and more painful over the time. Let's freeze the other locales to cldr 34.0.
* Fix CTYPE for ja_JP.eucJP and ja_JP.SJIS.Hiroki Sato2020-06-291-39305/+31726
| | | | | | | | PR: 163168 MFC after: 3 days Notes: svn path=/head/; revision=362770
* Mark "private use area" characters as printable.Yuri Pankov2019-10-051-5/+5
| | | | | | | | | | | | | | | | At least some of the characters in E000-F8FF range are used by Powerline fonts, and having no attributes for these ranges in UnicodeData.txt other than "Other, Private Use" it should be safe to mark all of them as printable. Some actually were before r340491, so this fixes the regression introduced there as well. PR: 240911 Reviewed by: bapt Tested by: Daniel Ponte <amigan@gmail.com> Differential Revision: https://reviews.freebsd.org/D21850 Notes: svn path=/head/; revision=353130
* Add ga_IE.UTF-8 locale.Yuri Pankov2018-11-261-0/+1
| | | | | | | | | | | | PR: 228587 Submitted by: Micil <micheal.maclochlainn@oegaillimh.ie> (LC_TIME) Reviewed by: bapt Approved by: kib (mentor, implicit) MFC after: 3 days Differential revision: https://reviews.freebsd.org/D17997 Notes: svn path=/head/; revision=340992
* Use UnicodeData.txt to create UTF-8 ctype map.Yuri Pankov2018-11-171-5168/+33860
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This should provide more complete coverage of currently defined Unicode characters as compared to manually assembled one we use currently. Comparison of original and new UTF-8 ctype maps by character class: TYPE ORIG NEW alnum 94229 126029 alpha 93557 125419 blank 4 2 cntrl 73 137685 digit 469 622 graph 109615 137203 lower 1478 2145 print 109641 137222 punct 3428 797 rune 110481 274907 space 33 24 upper 983 1781 xdigit 469 622 Large number of added cntrl definitions is due to the fact that private-use planes are currently defined as such, this can change in the future. Discussed with: bapt Approved by: kib (mentor, implicit) MFC after: 1 month Differential revision: https://reviews.freebsd.org/D17842 Notes: svn path=/head/; revision=340491
* Add hybrid C.UTF-8 locale being identical to default C locale exceptYuri Pankov2018-11-042-77/+78
| | | | | | | | | | | that it uses the same ctype maps and functions as other UTF-8 locales. Reviewed by: bapt, cem, eadler Approved by: kib (mentor, implicit) Differential Revision: https://reviews.freebsd.org/D17833 Notes: svn path=/head/; revision=340144
* Update to CLDR 34 and UNICODE 11.Yuri Pankov2018-11-037-8/+63
| | | | | | | | | Discussed with: bapt Approved by: kib (mentor) MFC after: 1 month Notes: svn path=/head/; revision=340104
* Add -b/-l options to localedef(1) to specify output endianness and useYuri Pankov2018-10-201-2/+4
| | | | | | | | | | | | | | | | it appropriately when building share/ctypedef and share/colldef. This makes the resulting locale data in EL->EB (amd64->powerpc64) cross build and in the native EB build match. Revert the changes done to libc in r308170 as they are no longer needed. PR: 231965 Reviewed by: bapt, emaste, sbruno, 0mp Approved by: kib (mentor) Differential Revision: https://reviews.freebsd.org/D17603 Notes: svn path=/head/; revision=339489
* Restore some of the ctype definitions reported in the PR from pre-CLDRYuri Pankov2018-10-111-0/+17
| | | | | | | | | | | | | | | | data, namely 0xE000-0xF8FF private use area, and 0xFF00-0xFFF half- and fullwidth punctuation. While here, update tools/tools/locale/README based on my experience rebuilding the locale data. PR: 225692 Reviewed by: bapt, cem (previous version) Approved by: re (gjb), kib (mentor) Differential Revision: https://reviews.freebsd.org/D17471 Notes: svn path=/head/; revision=339313
* Update to CLDR 32 and Unicode 10Baptiste Daroussin2017-11-033-100/+23
| | | | | | | | MFC after: 2 weeks Relnotes: yes Notes: svn path=/head/; revision=325361
* Readd Big5: some large databases setup are still requiring it.Baptiste Daroussin2017-04-202-1/+6954
| | | | | | | Reported by: "張君天(Chun-Tien Chang)" <tcs@kitty.2y.idv.tw> Notes: svn path=/head/; revision=317204
* Remove zh_TW.Big5 localeBaptiste Daroussin2017-03-192-6954/+1
| | | | | | | | After discussion with many Taiwanese, in IT or not. Big5 is not used anymore. It is not able to represent lots of the characters used in the language. Notes: svn path=/head/; revision=315568
* share: normalize paths using SRCTOP-relative paths or :H when possibleEnji Cooper2017-03-041-1/+1
| | | | | | | | | | This simplifies make logic/output MFC after: 1 month Sponsored by: Dell EMC Isilon Notes: svn path=/head/; revision=314652
* Update locales cldr to v30.0.3 and unicode to 9.0.0Baptiste Daroussin2016-12-1811-14708/+59842
| | | | | | | | MFC after: 1 month Relnotes: yes Notes: svn path=/head/; revision=310201
* Posixify the locales name for variantsBaptiste Daroussin2016-07-034-26/+26
| | | | | | | | | | | | | | | | | | | | | | | For all locales with variants: - if no ambiguity on the locale (only one variant) just use the regular name - if ambiguity, pick one as default and append @<variant> to the others respecting POSIX As a result: - All the 3 components locales added recently are renamed to the usual 2 components version for all but sr_RS.UTF-8 - Set sr_RS.UTF-8 to the cyrillic variant - Add sr_RS.UTF-8@latin - Remove the symlinks aliases they were created to represent the 2 components version as aliasas and are now useless - Update the OptionalObsoleteFiles.inc and ObsoleteFiles.inc to reflect those changes Discussed with: ache@ Approved by: re@ (gjb) Notes: svn path=/head/; revision=302329
* Regenerates locales Makefiles and localesBaptiste Daroussin2016-04-162-2/+2
| | | | Notes: svn path=/head/; revision=298121
* Use :E instead of regex in ctypedef MakefilesBaptiste Daroussin2015-12-191-1/+1
| | | | Notes: svn path=/head/; revision=292466
* Simplify the locale generated Makefiles by using bmake multi variables for loopsBaptiste Daroussin2015-12-181-185/+185
| | | | Notes: svn path=/head/; revision=292453
* META MODE: Fix 'make the-lot' with recent locale changesBryan Drewery2015-11-251-0/+12
| | | | | | | Sponsored by: EMC / Isilon Storage Division Notes: svn path=/head/; revision=291311
* Bring back a couple of ISO8859-15 locales:Baptiste Daroussin2015-11-162-28/+35
| | | | | | | | | | | | - af_ZA.ISO8859-15 - en_AU.ISO8859-15 - en_CA.ISO8859-15 - en_NZ.ISO8859-15 - en_US.ISO8859-15 - fr_CA.ISO8859-15 Notes: svn path=/head/; revision=290928
* Regenerate locales after readding ISO8859-1 for locales that have ISO8859-15Baptiste Daroussin2015-11-154-4/+32
| | | | | | | Requested by: arche Notes: svn path=/head/; revision=290866
* Use explicit filename when creating locale symlinks to avoid creating aBryan Drewery2015-11-111-1/+2
| | | | | | | | | | directory symlink when the target directory does not exist. This will cause an error instead of a broken setup. Sponsored by: EMC / Isilon Storage Division Notes: svn path=/head/; revision=290677
* Merge from headBaptiste Daroussin2015-11-011-1/+1
| | | | Notes: svn path=/projects/collation/; revision=290241
* Regenerate localesBaptiste Daroussin2015-10-1333-159856/+4557
| | | | Notes: svn path=/projects/collation/; revision=289261
* Add newly generated locales from CLDR 27.0.1Baptiste Daroussin2015-08-0843-0/+236456
only skip timedef until I figure out how to workaround svn painful mime-type handling Notes: svn path=/projects/collation/; revision=286438