Help - Search - Members - Calendar
Full Version: Zaurus And Unicode Characters.
OESF Forums > Distros, Development, and Model Specific Forums > Model Specific Forums > C1000/3x00 General discussions
xamindar
I am having a problem with displaying unicode characters on my zaurus with the japanese rom(and cacko as well). I have a lot of Japanese music that just shows up as garbage on the zaurus. In fact, it seems not limited to Japanese music. It seems that any music that I have modified tags of will show like this on my zaurus:




Even in the music player it shows like that. It reads the ID tags the same, garbage.


But they still show up just fine on my desktop while the zaurus is connected:




Anyone have any ideas? The following is the locale I am using on my desktop pc:
CODE
lain Music_Files # locale
LANG=en_US.UTF-8
LC_CTYPE="en_US.UTF-8"
LC_NUMERIC="en_US.UTF-8"
LC_TIME="en_US.UTF-8"
LC_COLLATE="en_US.UTF-8"
LC_MONETARY="en_US.UTF-8"
LC_MESSAGES="en_US.UTF-8"
LC_PAPER="en_US.UTF-8"
LC_NAME="en_US.UTF-8"
LC_ADDRESS="en_US.UTF-8"
LC_TELEPHONE="en_US.UTF-8"
LC_MEASUREMENT="en_US.UTF-8"
LC_IDENTIFICATION="en_US.UTF-8"
LC_ALL=


I'm not sure how to check what the zaurus uses as it has no "locale" command, but I thought I saw something that had "utf8" in it on boot up.
xamindar
hmm, I created a folder on the zaurus with a japanese file name. Then I connected it to my PC and the folder shows up as all "????" marks. So I guess obviously the locale used betreen the two computers is different. But what does the Zaurus use?
xamindar
Now, the stuff that shows as garbage on the zaurus also shows as garbage when it is connected in windows. And that folder I created on the zaurus also shows just fine in windows. So I guess I need to know what locale windows (and the zaurus) uses and set my Linux to match. Any ideas? The reason I used utf8 in Linux was because I understood it to be the most supported.

Or maybe I don't understand how it works.
ShiroiKuma
QUOTE(xamindar @ Jun 1 2006, 11:55 PM)
Now, the stuff that shows as garbage on the zaurus also shows as garbage when it is connected in windows.  And that folder I created on the zaurus also shows just fine in windows.  So I guess I need to know what locale windows (and the zaurus) uses and set my Linux to match.  Any ideas?  The reason I used utf8 in Linux was because I understood it to be the most supported.

Or maybe I don't understand how it works.
*

Well, this is the punishment for listening to Morning Musume, 'nuff said smile.gif

Seriously though:

I'd bet that the disk is not mounted as UTF-8, locale has no effect on this.

Check /etc/fstab and make sure that the option to mount the disk where you have the files is UTF-8. It works, you'll then see the proper Japanese names.
xamindar
are you talking about the /etc/fstab on the zaurus? Wouldn't it allready be set up sense it is from Japan?

I tried remounting it on my linux box but I don't see any change. I typed this:
# mount -o remount utf8 /media/disk-2
and get no errors or anything. Mount just reports:
/dev/sda on /media/disk-2 type vfat (rw)

Should it say utf-8 as well? Funny thing is, if I create a japanese filename with the zaurus that file will show up as "?????" when viewed on my linux machine. It will show just fine in windows. So basicly:

CODE
File created with:          shows correct on:        mojibake(garbage):
zaurus                      zaurus, windows          linux
linux                       linux                    windows, zaurus
windows                     windows, zaurus          linux


So it must be something wrong with linux. Gah!
Linux is using the nls_cp932 which I thought was the standard. There is also nls_euc_jp but I don't know what they really mean. I'm so confused. unsure.gif

I'm also trying to get help here: http://forums.gentoo.org/viewtopic-p-3354140.html#3354140
But it isn't looking so good.
ShiroiKuma
QUOTE(xamindar @ Jun 2 2006, 09:42 AM)
are you talking about the /etc/fstab on the zaurus?  Wouldn't it allready be set up sense it is from Japan?

Yeah. And it's not setup correctly. In Japan, they mostly use euc-JP for Linux Japanese, which is a problem, Windows can't work with it.

Unless, you specify UTF-8 everywhere it won't be mounted correctly. I've gone that route too. Once you do and reboot, then you'll be able to connect to a Win machine and copy back Japanese files and dirs no prob.
xamindar
QUOTE(ShiroiKuma @ Jun 2 2006, 12:52 AM)
I've gone that route too. Once you do and reboot, then you'll be able to connect to a Win machine and copy back Japanese files and dirs no prob.
*

But it works fine between windows already. If I copy japanese files from windows to the zaurus everything is fine. The problem is with my Linux machine. It seems only the files made on my linux machine show as garbage in windows and on the zaurus.

I might as well give it a shot though. Is it just "utf8" that I add into fstab?

EDIT: The zaurus hard drive isn't even listed in fstab. It is probably being mounted by a script somewhere.
Stubear
When you "connect to" your PC, how are you doing so?

Are you using the "USB storage" setting or one of the PC link settings?

If you are using USB - TCP/IP (possibly USB - IO too but have never tried) then the zaurus is sharing it's drives via SAMBA. You will need to check the settings for "Character Set" and "Client Code Page" (in Cacko 1.23 they are set 866 - Cyrillic) in /home/etc/samba/smb.conf

With regards to Japanese showing as mojibake in the console, try changing the fonts (There is a Font menu in QKonsole) by default it was choosing VGA when I first installed it, I find that Unifont or LCFont are better for viewing Japanese.

Edit: You may find this document helpful. I haven't tried it yet but will later and report back

Click to view attachment


Hope this helps some

stu
Meanie
QUOTE(ShiroiKuma @ Jun 2 2006, 05:56 PM)
Well, this is the punishment for listening to Morning Musume, 'nuff said  smile.gif


how dare you !!! i listen to Morning Musume all the time smile.gif

anyway, as stu mentions above, yu prolly need to install a samba codepage before you can do the mod to the samba conf file mentioned.
xamindar
It's not connected as samba, it is connected as a usb storage device. I'll try changing the font in qconsole though.
xamindar
QUOTE(ShiroiKuma @ Jun 2 2006, 12:52 AM)
QUOTE(xamindar @ Jun 2 2006, 09:42 AM)
are you talking about the /etc/fstab on the zaurus?  Wouldn't it allready be set up sense it is from Japan?

Yeah. And it's not setup correctly. In Japan, they mostly use euc-JP for Linux Japanese, which is a problem, Windows can't work with it.

Unless, you specify UTF-8 everywhere it won't be mounted correctly. I've gone that route too. Once you do and reboot, then you'll be able to connect to a Win machine and copy back Japanese files and dirs no prob.
*




OK, you were right. I finally got it to mount in Linux with utf-8. It wasn't listed in the man page for mount but all I needed was "utf8=true" and it worked. Now I can copy files over to the zaurus and they will show correctly in the *FILES TAB*. But they still show all goofy in Music Player. One or two files will show correctly, and I found that those files are ones that I had not modified ID tags for through Amarok (on my linux machine). I tested it, I took one that showed correctly on the zaurus and opened it up in amarok, changed a character in it's tag, then saved it. Sure enough, when I copied it over to the zaurus it saw all messed up in the music player.

Man, talk about neverending problems. Do I need to mount the drive on the zaurus using utf or something? But would that affect the ID tags of my mp3s?

Also, the qconsole font is already set to lcfont. Every font setting shows the same garbage in the console.
Meanie
QUOTE(xamindar @ Jun 4 2006, 07:50 AM)
QUOTE(ShiroiKuma @ Jun 2 2006, 12:52 AM)
QUOTE(xamindar @ Jun 2 2006, 09:42 AM)
are you talking about the /etc/fstab on the zaurus?  Wouldn't it allready be set up sense it is from Japan?

Yeah. And it's not setup correctly. In Japan, they mostly use euc-JP for Linux Japanese, which is a problem, Windows can't work with it.

Unless, you specify UTF-8 everywhere it won't be mounted correctly. I've gone that route too. Once you do and reboot, then you'll be able to connect to a Win machine and copy back Japanese files and dirs no prob.
*




OK, you were right. I finally got it to mount in Linux with utf-8. It wasn't listed in the man page for mount but all I needed was "utf8=true" and it worked. Now I can copy files over to the zaurus and they will show correctly in the *FILES TAB*. But they still show all goofy in Music Player. One or two files will show correctly, and I found that those files are ones that I had not modified ID tags for through Amarok (on my linux machine). I tested it, I took one that showed correctly on the zaurus and opened it up in amarok, changed a character in it's tag, then saved it. Sure enough, when I copied it over to the zaurus it saw all messed up in the music player.

Man, talk about neverending problems. Do I need to mount the drive on the zaurus using utf or something? But would that affect the ID tags of my mp3s?

Also, the qconsole font is already set to lcfont. Every font setting shows the same garbage in the console.
*



this is now another problem.
probably your id tag editor is using another format to the musicplayer which is very likely to be eucjp and it was using shiftjis..
Snappy
I just tried out Samba for accessing my akita from WindowsXP and it works once I got it setup!

I am however, noticing the garbled characters when I look at the directory list of files (CF) from the Akita on my notebook.

Important point is that the same files on the CF appears right (Chinese characters) when I connect via usb using storage(CF) option instead of USB-TCPIP (advanced) option. I checked etc/hotplug/usbdstorage.agent and found it mounting the CF as UTF8 for iocharset.

Changing fstab to mount CF as UTF8 and smb.conf to specify UTF8 do not seem to change anything. What could be wrong?
This is a "lo-fi" version of our main content. To view the full version with more information, formatting and images, please click here.
Invision Power Board © 2001-2015 Invision Power Services, Inc.