D-Link Forums

The Graveyard - Products No Longer Supported => D-Link Storage => DNS-323 => Topic started by: gkatzi on December 22, 2010, 01:28:42 PM

Title: character encoding - problem with Ubuntu and WinXP - german "Umlaut"
Post by: gkatzi on December 22, 2010, 01:28:42 PM
Hey folks!

I have a network of several Ubuntu (10.04 and 10.10) and Windows XP computers. I use my DNS-323 (firmware 1.08) as a central storage for all data.
I had a little problem with character-encoding and other issues. So i reset the NAS to factory defaults, installed the new 1.08 firmware (it was 1.07 before), reformatted the two Seagate 1TB-Drives and set up a Raid0. So I thought everything was good and started copying my data back from my backup to the NAS.

The problem now/still is the following:
If I create file-/foldernames with special characters (german "Umlaut" like ö ü ä) in Ubuntu everything works fine. But if I view these files/folders in WinXP the special characters are shown as weird signs, like squares and $, ...   It is the same the other way around. So special characters created in WinXP show as "invalid encoding" in Ubuntu.

Can anyone help me please!?
Title: Re: character encoding - problem with Ubuntu and WinXP - german "Umlaut"
Post by: lookingforinfo on December 23, 2010, 02:04:49 PM
It may be that the Character Map on the XP system is not set correctly.  Long ago I encountered something similar but I do not remember the commands needed for comparison.  The XP Character Map Utility is reached by selecting Programs > Accessories > System Tools > Character Map.
Title: Re: character encoding - problem with Ubuntu and WinXP - german "Umlaut"
Post by: gkatzi on December 26, 2010, 11:44:44 AM
Thanks for the reply.

I tried what you suggested but it doesn't seem to be the solution. In the Character Map I only found options to view and copy special characters. Nothing that would effect or change any system-setup.

Any other ideas?
Title: Re: character encoding - problem with Ubuntu and WinXP - german "Umlaut"
Post by: gkatzi on December 27, 2010, 08:13:33 AM
If the problem was the character encoding in Windows, it wouldn't work on a USB-Key either, would it?
I tried it and it worked! I created a folder on the USB-Key and named it only with special german characters and it showed correctly in XP. Doesn't that mean the problem is on the NAS?
Title: Re: character encoding - problem with Ubuntu and WinXP - german "Umlaut"
Post by: lookingforinfo on December 27, 2010, 10:59:35 AM
As many on this list will probably tell you, I am probably the the last person to be giving advice.

To my way of thinking, all data is binary and it is the OS or a program running under the OS that determines what character should be displayed.  If the test file on the USB drive was created using Ubuntu and displays correctly using WinXP, then the same thing should happen if the file is stored on a DNS-323.

Sorry I can not be more helpful.
Title: Re: character encoding - problem with Ubuntu and WinXP - german "Umlaut"
Post by: gkatzi on December 30, 2010, 04:07:42 AM
I executed a hexdump-command via telnet on the NAS now.
The situation:
I created a test-folder on the NAS.
Then I created a "ubuntu-ö.txt" in Ubuntu and a "winXP-ö.txt" in WinXP.
Content of both files is "ö" (in case it doesn't show correctly - it's the Umlaut of "o")

This is the output:

guenther@Guenther:~$ telnet 10.0.0.6
Trying 10.0.0.6...
Connected to 10.0.0.6.
Escape character is '^]'.
/ # cd mnt/HD_a2/test
/mnt/HD_a2/test # ls
ubuntu-├╢  winXP-ö.txt
/mnt/HD_a2/test # ls * | hexdump -bc
0000000 165 142 165 156 164 165 055 342 224 234 342 225 242 012 167 151
0000000   u   b   u   n   t   u   - 342 224 234 342 225 242  \n   w   i
0000010 156 130 120 055 303 266 056 164 170 164 012                   
0000010   n   X   P   - 303 266   .   t   x   t  \n                   
000001b
/mnt/HD_a2/test #

I added a screenshot (taken in Ubuntu), in case the special characters don't show correctly.

I don't understand all that well enough. So does that give any hint to what's happening?

http://forum.dsmg600.info/attachment.php?item=668 (http://forum.dsmg600.info/attachment.php?item=668)
Title: Re: character encoding - problem with Ubuntu and WinXP - german "Umlaut"
Post by: lookingforinfo on December 30, 2010, 08:23:16 PM
I am sorry but I can only point out the obvious and tell you what I have seen on my OS X system.

From the Ubuntu screen copy, the "ubuntu-" file name does not display correctly when the ls command is used.  The octal codes displayed by the hexdump command are different for the letter o with a umlaut.  In the "winXP-" file name, the octal codes are 303 266.  These codes are different in the "ubuntu-" file name.

In OS X I learned how to create a file that contained a o with a umlaut and a hexdump of that file also used octal codes 303 266 to represent the problem character.  OS X would let me create a file name that contained the o umlaut but when I piped the filename to the hexdump command it showed different octal codes.

I still think Ubuntu and XP are using different codes for these special characters.  Maybe https://help.ubuntu.com/community/CharacterMap might help.
Title: Re: character encoding - problem with Ubuntu and WinXP - german "Umlaut"
Post by: gkatzi on January 02, 2011, 01:42:06 AM
I gave up on it now. It's not worth the effort anymore.
I'll post it here if I ever find a solution.

Thanks for your efforts anyway!
Title: Re: character encoding - problem with Ubuntu and WinXP - german "Umlaut"
Post by: rori on January 17, 2011, 12:39:07 PM
Hi, try to enter this in your /etc/fstab on your ubuntu-client:

Code: [Select]
//192.168.0.[x]/Volume_1 /media/[mountpoint] cifs defaults,rw,iocharset=utf8,file_mode=0777,dir_mode=0777 0 0

please replace

it will force ubuntu to mount the DNS-323 into your client with utf8-encoded charset.

If you have telnet access to the DNS-323 using funplug, try to go to /etc/samba and have a look into your smb-configuration.