Zaurus And Unicode Characters.

[xamindar]

I am having a problem with displaying unicode characters on my zaurus with the japanese rom(and cacko as well).  I have a lot of Japanese music that just shows up as garbage on the zaurus.  In fact, it seems not limited to Japanese music.  It seems that any music that I have modified tags of will show like this on my zaurus:

[img]http://radnimax.com/misc/scrn003.jpg\" border=\"0\" class=\"linked-image\" /]
[img]http://radnimax.com/misc/scrn004.jpg\" border=\"0\" class=\"linked-image\" /]

Even in the music player it shows like that.  It reads the ID tags the same, garbage.


But they still show up just fine on my desktop while the zaurus is connected:

[img]http://radnimax.com/misc/music.jpg\" border=\"0\" class=\"linked-image\" /]
[img]http://radnimax.com/misc/music2.jpg\" border=\"0\" class=\"linked-image\" /]

Anyone have any ideas?  The following is the locale I am using on my desktop pc:

Code: [Select]

lain Music_Files # locale
LANG=en_US.UTF-8
LC_CTYPE="en_US.UTF-8"
LC_NUMERIC="en_US.UTF-8"
LC_TIME="en_US.UTF-8"
LC_COLLATE="en_US.UTF-8"
LC_MONETARY="en_US.UTF-8"
LC_MESSAGES="en_US.UTF-8"
LC_PAPER="en_US.UTF-8"
LC_NAME="en_US.UTF-8"
LC_ADDRESS="en_US.UTF-8"
LC_TELEPHONE="en_US.UTF-8"
LC_MEASUREMENT="en_US.UTF-8"
LC_IDENTIFICATION="en_US.UTF-8"
LC_ALL=
I'm not sure how to check what the zaurus uses as it has no "locale" command, but I thought I saw something that had "utf8" in it on boot up.

[xamindar]

hmm, I created a folder on the zaurus with a japanese file name.  Then I connected it to my PC and the folder shows up as all "?" marks.  So I guess obviously the locale used betreen the two computers is different.  But what does the Zaurus use?

[xamindar]

Now, the stuff that shows as garbage on the zaurus also shows as garbage when it is connected in windows.  And that folder I created on the zaurus also shows just fine in windows.  So I guess I need to know what locale windows (and the zaurus) uses and set my Linux to match.  Any ideas?  The reason I used utf8 in Linux was because I understood it to be the most supported.

Or maybe I don't understand how it works.

[ShiroiKuma]

Now, the stuff that shows as garbage on the zaurus also shows as garbage when it is connected in windows.  And that folder I created on the zaurus also shows just fine in windows.  So I guess I need to know what locale windows (and the zaurus) uses and set my Linux to match.  Any ideas?  The reason I used utf8 in Linux was because I understood it to be the most supported.

Or maybe I don't understand how it works.
[div align=\"right\"][a href=\"index.php?act=findpost&pid=129373\"][{POST_SNAPBACK}][/a][/div]

Well, this is the punishment for listening to Morning Musume, 'nuff said  

Seriously though:

I'd bet that the disk is not mounted as UTF-8, locale has no effect on this.

Check /etc/fstab and make sure that the option to mount the disk where you have the files is UTF-8. It works, you'll then see the proper Japanese names.

[xamindar]

are you talking about the /etc/fstab on the zaurus?  Wouldn't it allready be set up sense it is from Japan?

I tried remounting it on my linux box but I don't see any change.  I typed this:
# mount -o remount utf8 /media/disk-2
and get no errors or anything.  Mount just reports:
/dev/sda on /media/disk-2 type vfat (rw)

Should it say utf-8 as well?  Funny thing is, if I create a japanese filename with the zaurus that file will show up as "??" when viewed on my linux machine.  It will show just fine in windows.  So basicly:

Code: [Select]

File created with:          shows correct on:        mojibake(garbage):
zaurus                      zaurus, windows          linux
linux                       linux                    windows, zaurus
windows                     windows, zaurus          linux
So it must be something wrong with linux.  Gah!
Linux is using the nls_cp932 which I thought was the standard.  There is also nls_euc_jp but I don't know what they really mean.  I'm so confused.

I'm also trying to get help here:  http://forums.gentoo.org/viewtopic-p-3354140.html#3354140
But it isn't looking so good.

[ShiroiKuma]

are you talking about the /etc/fstab on the zaurus?  Wouldn't it allready be set up sense it is from Japan?

Yeah. And it's not setup correctly. In Japan, they mostly use euc-JP for Linux Japanese, which is a problem, Windows can't work with it.

Unless, you specify UTF-8 everywhere it won't be mounted correctly. I've gone that route too. Once you do and reboot, then you'll be able to connect to a Win machine and copy back Japanese files and dirs no prob.

[xamindar]

I've gone that route too. Once you do and reboot, then you'll be able to connect to a Win machine and copy back Japanese files and dirs no prob.
[div align=\"right\"][a href=\"index.php?act=findpost&pid=129422\"][{POST_SNAPBACK}][/a][/div]

But it works fine between windows already.  If I copy japanese files from windows to the zaurus everything is fine.  The problem is with my Linux machine.  It seems only the files made on my linux machine show as garbage in windows and on the zaurus.

I might as well give it a shot though.  Is it just "utf8" that I add into fstab?

EDIT:  The zaurus hard drive isn't even listed in fstab.  It is probably being mounted by a script somewhere.

[Stubear]

When you "connect to" your PC, how are you doing so?

Are you using the "USB storage" setting or one of the PC link settings?

If you are using USB - TCP/IP (possibly USB - IO too but have never tried) then the zaurus is sharing it's drives via SAMBA. You will need to check the settings for "Character Set" and "Client Code Page" (in Cacko 1.23 they are set 866 - Cyrillic) in /home/etc/samba/smb.conf

With regards to Japanese showing as mojibake in the console, try changing the fonts (There is a Font menu in QKonsole) by default it was choosing VGA when I first installed it, I find that Unifont or LCFont are better for viewing Japanese.

Edit: You may find this document helpful. I haven't tried it yet but will later and report back

 [ Invalid Attachment ]


Hope this helps some

stu

[Meanie]

Well, this is the punishment for listening to Morning Musume, 'nuff said 

how dare you !!! i listen to Morning Musume all the time

anyway, as stu mentions above, yu prolly need to install a samba codepage before you can do the mod to the samba conf file mentioned.

[xamindar]

It's not connected as samba, it is connected as a usb storage device.  I'll try changing the font in qconsole though.

[xamindar]

are you talking about the /etc/fstab on the zaurus?  Wouldn't it allready be set up sense it is from Japan?

Yeah. And it's not setup correctly. In Japan, they mostly use euc-JP for Linux Japanese, which is a problem, Windows can't work with it.

Unless, you specify UTF-8 everywhere it won't be mounted correctly. I've gone that route too. Once you do and reboot, then you'll be able to connect to a Win machine and copy back Japanese files and dirs no prob.
[div align=\"right\"][a href=\"index.php?act=findpost&pid=129422\"][{POST_SNAPBACK}][/a][/div]

OK, you were right.  I finally got it to mount in Linux with utf-8.  It wasn't listed in the man page for mount but all I needed was "utf8=true" and it worked.  Now I can copy files over to the zaurus and they will show correctly in the *FILES TAB*.  But they still show all goofy in Music Player.  One or two files will show correctly, and I found that those files are ones that I had not modified ID tags for through Amarok (on my linux machine).  I tested it, I took one that showed correctly on the zaurus and opened it up in amarok, changed a character in it's tag, then saved it.  Sure enough, when I copied it over to the zaurus it saw all messed up in the music player.

Man, talk about neverending problems.  Do I need to mount the drive on the zaurus using utf or something?  But would that affect the ID tags of my mp3s?

Also, the qconsole font is already set to lcfont.  Every font setting shows the same garbage in the console.

[Meanie]

are you talking about the /etc/fstab on the zaurus?  Wouldn't it allready be set up sense it is from Japan?

Yeah. And it's not setup correctly. In Japan, they mostly use euc-JP for Linux Japanese, which is a problem, Windows can't work with it.

Unless, you specify UTF-8 everywhere it won't be mounted correctly. I've gone that route too. Once you do and reboot, then you'll be able to connect to a Win machine and copy back Japanese files and dirs no prob.
[div align=\"right\"][a href=\"index.php?act=findpost&pid=129422\"][{POST_SNAPBACK}][/a][/div]

OK, you were right.  I finally got it to mount in Linux with utf-8.  It wasn't listed in the man page for mount but all I needed was "utf8=true" and it worked.  Now I can copy files over to the zaurus and they will show correctly in the *FILES TAB*.  But they still show all goofy in Music Player.  One or two files will show correctly, and I found that those files are ones that I had not modified ID tags for through Amarok (on my linux machine).  I tested it, I took one that showed correctly on the zaurus and opened it up in amarok, changed a character in it's tag, then saved it.  Sure enough, when I copied it over to the zaurus it saw all messed up in the music player.

Man, talk about neverending problems.  Do I need to mount the drive on the zaurus using utf or something?  But would that affect the ID tags of my mp3s?

Also, the qconsole font is already set to lcfont.  Every font setting shows the same garbage in the console.
[div align=\"right\"][a href=\"index.php?act=findpost&pid=129652\"][{POST_SNAPBACK}][/a][/div]

this is now another problem.
probably your id tag editor is using another format to the musicplayer which is very likely to be eucjp and it was using shiftjis..

[Snappy]

I just tried out Samba for accessing my akita from WindowsXP and it works once I got it setup!

I am however, noticing the garbled characters when I look at the directory list of files (CF) from the Akita on my notebook.

Important point is that the same files on the CF appears right (Chinese characters) when I connect via usb using storage(CF) option instead of USB-TCPIP (advanced) option. I checked etc/hotplug/usbdstorage.agent and found it mounting the CF as UTF8 for iocharset.

Changing fstab to mount CF as UTF8 and smb.conf to specify UTF8 do not seem to change anything. What could be wrong?