Author Topic: Displaying Japanese Or Any Other Unicode Character  (Read 11949 times)

ZDevil

  • Hero Member
  • *****
  • Posts: 1998
    • View Profile
    • http://
Displaying Japanese Or Any Other Unicode Character
« Reply #15 on: November 28, 2005, 02:06:58 am »
Thank you so much again for your efforts on making the CJK solutions available, cs_jacky!  Please keep up the great work.
Sorry for bothering you again.  After trying your new UTF8 locales packages on pdaXrom, I would like to ask you a few things:  (Or someone who could enlighten me)
1) It seems the Z still cannot read big5 encoded files, such as in various terminal apps, lynx and Jpilot.  Does it mean an extra big5 locale package is a must?  If so how can I get it?
2) I've also read about a newer glibc 2.3.2 which is said to support Chinese encoding ( https://www.oesf.org/forums/index.php?showtopic=14089 ), but the link to the complete file is broken.  Is this also necessary for reading big5 stuff?
3) Also it seems to me using the locales will take up quite a chunk of the system memory.  Does this depend on which unicode ttf font I'm using?  
4) Can (some) unicode fonts also display big5 characters?
5) Is it also necessary to make changes in /etc/fonts/local.conf to fix the font choice and finetune the display?

Thanks!  
« Last Edit: November 28, 2005, 02:09:06 am by ZDevil »

Life is too precious for hacking *too much*
Visit my Z screencap gallery[/color]
My EeePC 701 Black = Debian (Lenny) on IceRocks + Transcend SDHC Class6 8GB + 2GB RAM
My Zaurus SL-C3200 = Debian EABI (kernel 2.6.24.3-yonggun) on a swapped internal Sandisk Extreme III CF 16gb
My Debian EABI feed: http://matrixmen.free.fr/zaurus/debian/
My OpenBSD/Zaurus feeds:  Link1, Link2
[/i][/font][/color][/size]

cs_jacky

  • Full Member
  • ***
  • Posts: 143
    • View Profile
    • http://
Displaying Japanese Or Any Other Unicode Character
« Reply #16 on: November 28, 2005, 05:57:18 am »
Quote
Thank you so much again for your efforts on making the CJK solutions available, cs_jacky!  Please keep up the great work.
Sorry for bothering you again.  After trying your new UTF8 locales packages on pdaXrom, I would like to ask you a few things:  (Or someone who could enlighten me)
1) It seems the Z still cannot read big5 encoded files, such as in various terminal apps, lynx and Jpilot.  Does it mean an extra big5 locale package is a must?  If so how can I get it?
2) I've also read about a newer glibc 2.3.2 which is said to support Chinese encoding ( https://www.oesf.org/forums/index.php?showtopic=14089 ), but the link to the complete file is broken.  Is this also necessary for reading big5 stuff?
3) Also it seems to me using the locales will take up quite a chunk of the system memory.  Does this depend on which unicode ttf font I'm using?   
4) Can (some) unicode fonts also display big5 characters?
5) Is it also necessary to make changes in /etc/fonts/local.conf to fix the font choice and finetune the display?

Thanks! 
[div align=\"right\"][{POST_SNAPBACK}][/a][/div]

I think your terminal based app failed to read big5 encoded files because the app don't support big5 encoding. I think you can read big5 files with vim (but you need to specify file encoding). Since I can display Chinese filenames and input Chinese with gnome-terminal, I think the current glibc works fine with big5.

I use a unicode TTF (ArialUni from Microsoft) to display CJK. You can also get a free unicode font from [a href=\"http://www.info.gov.hk/digital21/eng/hkscs/terms/terms34.html]Hong Kong Government Website[/url]. I don't notice any huge memory usage with these unicode TTF.

sashz

  • Sr. Member
  • ****
  • Posts: 388
    • View Profile
    • http://
Displaying Japanese Or Any Other Unicode Character
« Reply #17 on: November 28, 2005, 07:06:10 am »
i added in builder system creating next locale packages: en_US.UTF-8 ru_RU.UTF-8 zh_TW.UTF-8 ja_JP.UTF-8 ko_KR.UTF-8 ru_RU.KOI8-R ru_RU.CP1251

look if there need another
and it will in next pdaXrom release

badog

  • Full Member
  • ***
  • Posts: 248
    • View Profile
Displaying Japanese Or Any Other Unicode Character
« Reply #18 on: November 28, 2005, 08:25:27 am »
why not zh_CN.UTF-8?

sashz

  • Sr. Member
  • ****
  • Posts: 388
    • View Profile
    • http://
Displaying Japanese Or Any Other Unicode Character
« Reply #19 on: November 28, 2005, 09:20:56 am »
Quote
why not zh_CN.UTF-8?
[div align=\"right\"][a href=\"index.php?act=findpost&pid=105222\"][{POST_SNAPBACK}][/a][/div]

will add it now)

ZDevil

  • Hero Member
  • *****
  • Posts: 1998
    • View Profile
    • http://
Displaying Japanese Or Any Other Unicode Character
« Reply #20 on: November 28, 2005, 09:57:43 am »
Thanks, cs_jacky! I will try again later today and see how it goes.  
sashz, how about zh_HK.UTF-8 as well (which seems to support even more char than zh_TW)?   Many thanks!

Life is too precious for hacking *too much*
Visit my Z screencap gallery[/color]
My EeePC 701 Black = Debian (Lenny) on IceRocks + Transcend SDHC Class6 8GB + 2GB RAM
My Zaurus SL-C3200 = Debian EABI (kernel 2.6.24.3-yonggun) on a swapped internal Sandisk Extreme III CF 16gb
My Debian EABI feed: http://matrixmen.free.fr/zaurus/debian/
My OpenBSD/Zaurus feeds:  Link1, Link2
[/i][/font][/color][/size]

sashz

  • Sr. Member
  • ****
  • Posts: 388
    • View Profile
    • http://
Displaying Japanese Or Any Other Unicode Character
« Reply #21 on: November 28, 2005, 10:57:48 am »
Quote
Thanks, cs_jacky! I will try again later today and see how it goes. 
sashz, how about zh_HK.UTF-8 as well (which seems to support even more char than zh_TW)?   Many thanks!
[div align=\"right\"][a href=\"index.php?act=findpost&pid=105232\"][{POST_SNAPBACK}][/a][/div]

ok, its there:)

iamphet

  • Jr. Member
  • **
  • Posts: 51
    • View Profile
    • http://iamphet.nm.ru
Displaying Japanese Or Any Other Unicode Character
« Reply #22 on: November 30, 2005, 01:46:24 am »
gtkterm can show russian characters with en_US.UTF-8 locale! Although rxvt-unicode still can't. I'm afraid I need to debug it to solve this problem  

cs_jacky

  • Full Member
  • ***
  • Posts: 143
    • View Profile
    • http://
Displaying Japanese Or Any Other Unicode Character
« Reply #23 on: November 30, 2005, 02:57:46 am »
Quote
gtkterm can show russian characters with en_US.UTF-8 locale! Although rxvt-unicode still can't. I'm afraid I need to debug it to solve this problem 
[div align=\"right\"][a href=\"index.php?act=findpost&pid=105514\"][{POST_SNAPBACK}][/a][/div]

I think any UTF-8 locale can display any characters in any language.

iamphet

  • Jr. Member
  • **
  • Posts: 51
    • View Profile
    • http://iamphet.nm.ru
Displaying Japanese Or Any Other Unicode Character
« Reply #24 on: November 30, 2005, 03:48:52 am »
Quote
I think any UTF-8 locale can display any characters in any language.
Yeah, this is the reason why I complained about rxvt-unicode.

ShiroiKuma

  • Hero Member
  • *****
  • Posts: 900
    • View Profile
Displaying Japanese Or Any Other Unicode Character
« Reply #25 on: November 30, 2005, 04:00:57 am »
Quote
Quote
gtkterm can show russian characters with en_US.UTF-8 locale! Although rxvt-unicode still can't. I'm afraid I need to debug it to solve this problem 
[div align=\"right\"][a href=\"index.php?act=findpost&pid=105514\"][{POST_SNAPBACK}][/a][/div]

I think any UTF-8 locale can display any characters in any language.
[div align=\"right\"][a href=\"index.php?act=findpost&pid=105519\"][{POST_SNAPBACK}][/a][/div]
The problems with rxvt and other consoles though that I've identified are somehow associated with the fact that these are not GTK applications. They use xfonts, not ttf, and though for some you can specify that they use ttf fonts for display, somehow the coding process or something for processing UTF-8 characters must depend on something, because the coding is wrong.

Thus I can run rxvt-unicode and use a ttf font for it, but it still messes up Japanese characters and doesn't display them properly on the Z.

That's why the solution via using gtkterm2 or gnome-terminal is needed.
[span style=\'font-size:8pt;line-height:100%\']Das ganze tschechische Volk ist eine Simulantenbande.[/font][/span]
Militäroberarzt Bautze

ZDevil

  • Hero Member
  • *****
  • Posts: 1998
    • View Profile
    • http://
Displaying Japanese Or Any Other Unicode Character
« Reply #26 on: November 30, 2005, 05:07:58 am »
Oh I see. Thanks for educating me.  I've been trying mrxvt, rxvt-unicode and mlterm (got it from a Korean Zaurus group), but so far I haven't got unicodes TTF displayed properly in any of these.  Time to head on to the gtkterm2...
« Last Edit: November 30, 2005, 05:30:59 am by ZDevil »

Life is too precious for hacking *too much*
Visit my Z screencap gallery[/color]
My EeePC 701 Black = Debian (Lenny) on IceRocks + Transcend SDHC Class6 8GB + 2GB RAM
My Zaurus SL-C3200 = Debian EABI (kernel 2.6.24.3-yonggun) on a swapped internal Sandisk Extreme III CF 16gb
My Debian EABI feed: http://matrixmen.free.fr/zaurus/debian/
My OpenBSD/Zaurus feeds:  Link1, Link2
[/i][/font][/color][/size]

iamphet

  • Jr. Member
  • **
  • Posts: 51
    • View Profile
    • http://iamphet.nm.ru
Displaying Japanese Or Any Other Unicode Character
« Reply #27 on: November 30, 2005, 09:40:58 am »
I've straced rxvt-unicode and noticed it doesn't try to use glibc locale. It does something with X11 locale though. AFAIK gtk apps don't use X11 locale and I think it might be the reason why they work

ZDevil

  • Hero Member
  • *****
  • Posts: 1998
    • View Profile
    • http://
Displaying Japanese Or Any Other Unicode Character
« Reply #28 on: November 30, 2005, 05:08:38 pm »
Oops.  I was trying gtkterm2 but it got this when trying to initiate
Code: [Select]
gtkterm2: error while loading shared libraries: libvte.so.4: cannot open shared object file: No such file or directory
I went through the filelist in the feed but didn't find this libvte.  Is it an individual issue of my Z or something needs to be installed on top of gtkterm2?  Thanks!  
« Last Edit: November 30, 2005, 05:10:23 pm by ZDevil »

Life is too precious for hacking *too much*
Visit my Z screencap gallery[/color]
My EeePC 701 Black = Debian (Lenny) on IceRocks + Transcend SDHC Class6 8GB + 2GB RAM
My Zaurus SL-C3200 = Debian EABI (kernel 2.6.24.3-yonggun) on a swapped internal Sandisk Extreme III CF 16gb
My Debian EABI feed: http://matrixmen.free.fr/zaurus/debian/
My OpenBSD/Zaurus feeds:  Link1, Link2
[/i][/font][/color][/size]

ShiroiKuma

  • Hero Member
  • *****
  • Posts: 900
    • View Profile
Displaying Japanese Or Any Other Unicode Character
« Reply #29 on: November 30, 2005, 05:17:15 pm »
Quote
Oops.  I was trying gtkterm2 but it got this when trying to initiate
Code: [Select]
gtkterm2: error while loading shared libraries: libvte.so.4: cannot open shared object file: No such file or directory
I went through the filelist in the feed but didn't find this libvte.  Is it an individual issue of my Z or something needs to be installed on top of gtkterm2?  Thanks! 
[div align=\"right\"][a href=\"index.php?act=findpost&pid=105610\"][{POST_SNAPBACK}][/a][/div]
That's what the second package is for - vte_0.11.10_armv5tel.ipk

Look above...  
[span style=\'font-size:8pt;line-height:100%\']Das ganze tschechische Volk ist eine Simulantenbande.[/font][/span]
Militäroberarzt Bautze