4.0.9.2 and scandinavian letters ä & ö

[Sebbo78]

After update i got problems with letters ä and ö, like this one: tähdännyt. Any ideas how to fix this?

 

http://www.juoksufoorumi.fi/

[jcdesign]

Did you do a upgrade from 3.4 to IPS4?

Before upgrade run UTF8 converter. Instruction here:

[Sebbo78]

Nope, from 4.0.8.1.

[Kjell Iver Johansen]

Did you try to change Locale in ACP? Might try another scandinavian Locale - like Nynorsk (Noreg). It is different on my testsite when I use that one, but tht is with Thousand separator

[Rhett]

Nope, from 4.0.8.1.

If it was fine on 4.0.8.1 and only broke upgrading to 4.0.9.2, please file a ticket, and also retain your backup you took prior to upgrading to 4.0.9.2 to be safe.

 

[Sebbo78]

I filed a ticket. It seems that upgrade changed my locale to en_us. Could i just solve this by using Find and replace sql query? 

Like Ã¤ -> ä.

[DReffects2]

I filed a ticket. It seems that upgrade changed my locale to en_us. Could i just solve this by using Find and replace sql query? 

Like Ã¤ -> ä.

I would most defineately NOT recommend this. This introduces another set of problems.

It very mnuch depens on what your mode your database thinks its in. I had a very similar problem when upgrading from 2.x to 3.x. My database thought it was a utf8 database, yet the data itself was still in latin1.

If you have shell access try this:

mysqldump --add-drop-table database_to_correct | replace CHARSET=latin1 CHARSET=utf8 | iconv -f latin1 -t utf8 | mysql database_to_correct

This force-converts all stuff to real utf8, no matter what the db actually contains. Please note that if you use mysqldump the cmd line tool might have a different charset enforced by your /etc/my.cnf file.

If your database allows export it with phpmyadmin as plain text and do a conversion of charsets within windows. A nifty tool for that is Charco: http://www.marblesoftware.com/Marble_Software/Charco.html

[Sebbo78]

‌@Sebbo78: All right, ä/ö/ü,... are also "german ones", you may try to run this script: http://www.adminarena.de/files/file/8-charconvzip/
I still don't know why this happens sometimes, mostly it happens to older forums converted from other Software. Most databases were correctly setup and working well with IPB3 but Show the wrong chars in IPS4 (ä, ...)

Feel free to contact me, if you need further assistance with this... We have some experience with this problem lately 
 

Back to this case. That Charconv script solved this problem. However there are still some extra Â letters where have been extra space (or enter). Here is one example (first line). Those are a bit annoying. Do you know @TheSonic would it be possible to modify that script to fix those extra Â letters?

[TSP]

I replied to someone else in a similar situation after upgrading from an earlier IPS 4-version to 4.0.9, which could explain the issue you're facing: https://community.invisionpower.com/topic/417701-upgrading-and-coding-dbphp/?do=findComment&comment=2565380

Have they gotten back to you in your ticket yet?

[Sebbo78]

I closed my ticket because i tought that i´m fine now. Now i opened new one. Just wan´t to make sure that this is solved in the right way. 

[TheSonic]

Back to this case. That Charconv script solved this problem. However there are still some extra Â letters where have been extra space (or enter). Here is one example (first line). Those are a bit annoying. Do you know @TheSonic would it be possible to modify that script to fix those extra Â letters?

Off course, it's easy to edit the script to replace chars what ever you like.

For reference: @Sebbo78 is talking about thi script: http://www.adminarena.de/files/file/8-charconvzip/

[Owdy]

I filed a ticket. It seems that upgrade changed my locale to en_us. Could i just solve this by using Find and replace sql query? 

Like Ã¤ -> ä.

You can change locale from language settings. ACP