Change UTF8 to UTF8MB4

[sobrenome]

On 24 de junho de 2015 at 9:35 PM, AutoItScript said:

It won't work. You'll still come across the index too long issue as I keep saying...  Well you're not going to be happy until you get a step by step so try this. At your own large risk!

• Backup your board.
• Take the board offline
• Backup your board!!!!
• Add/Change conf_global.php to include 'sql_utf8mb4' = true
• In the ACP goto Support -> Something is not working
• It will spit out hundreds of MySql commands, copy them to a text file (there's no chance of them working from Fix Automatically unless your board is small)
• Run the commands in phpmyadmin one by one or in small batches. Make a note of the tables that give errors about indexes being too long

For the tables with index-too-long error:

• Goto the table / Structure tab.
• Scroll down and click on "+indexes"
• Delete all but the primary indexes
• Rerun the Support tool in the ACP, it should give you the correct command to recreate the index with the correct length

Is it possible to IPS make a script to change that database collation from utf8 to utf8mb4 for those that did not chose this collation on the 3.4 to 4.0 upgrade?

[Owdy]

30 minutes ago, sobrenome said:

Is it possible to IPS make a script to change that database collation from utf8 to utf8mb4 for those that did not chose this collation on the 3.4 to 4.0 upgrade?

Please do this

[Batnik]

yes please make a script ...

[sobrenome]

Would be great! Please @Jim M, could you consider a script for later upgrade?

[opentype]

On 24 June 2015 at 9:35 AM, AutoItScript said:

• Add/Change conf_global.php to include 'sql_utf8mb4' = true
• In the ACP goto Support -> Something is not working
• It will spit out hundreds of MySql commands

I just tried this on a test installation, but changing the conf_global did not seem to do anything at all. Is that really all we would have to do to start this process?

[Batnik]

its not working for me too...... why there is still no script from invision :/

[sobrenome]

The script already made for 3.4 to 4.0 could be adapted to change the collation in 4.0. I guess it could be done without hard work.

Edited February 19, 2016 by sobrenome

[Batnik]

5 hours ago, sobrenome said:

The script already made for 3.4 to 4.0 could be adapted to change the collation in 4.0. I guess it could be done without hard work.

would be really cool if anyone from invision could spend 5 minutes for that.

[Owdy]

Please?

[sobrenome]

Waiting anxiously...

[sobrenome]

Any news about this?

[sobrenome]

Does anyone know if this script work on IPS 4?

 

[Nathan Explosion]

Doubt it - that is intended to update a database that is not UTF8/UTF8MB4 to one of either UTF8 or UTFMB4 - if the database is already UTF8 then I doubt it would do any conversion.

Easy way to figure it out for yourself - that database checker is included in the IPS4 package.....go to http://www.yourdomain.com/admin/convertutf8/ and see what it says to you.

Edited March 8, 2016 by Nathan Explosion

[Ausy]

1 hour ago, Nathan Explosion said:

Doubt it - that is intended to update a database that is not UTF8/UTF8MB4 to one of either UTF8 or UTFMB4 - if the database is already UTF8 then I doubt it would do any conversion.

This is correct. I tried it on a test site and it says nothing to convert.

[sobrenome]

So @Lindy, please, upgrade the script to work on IPS 4! Thanks!

[mesteele101]

5 hours ago, Ausy said:

This is correct. I tried it on a test site and it says nothing to convert.

Yes, it is working as designed by IPS.

Certain criteria that must be matched in order to move to the newer character set (UTF8MB4). Not everyone will be migrated and it's based MySQL version.

The current IPB converter will not convert to UTF8MB4 if you are already on IPB4. If you are moving from IPB3 to IPB4 it will migrate, but I believe you must set the config to UTF8MB4 prior to the upgrade (?).

[W4L]

Just now, mesteele101 said:

but I believe you must set the config to UTF8MB4 prior to the upgrade (?).

no it does it during the upgrade for u i just upgraded from 3.4.9 to 4.1 and had a table crash , had to repair it but all went smooth with the upgrade .

[mesteele101]

10 hours ago, W4L said:

no it does it during the upgrade for u i just upgraded from 3.4.9 to 4.1 and had a table crash , had to repair it but all went smooth with the upgrade .

In the config don't you have to set:

$INFO['sql_charset']   = '****';

to:

$INFO['sql_charset']   = 'utf8mb4';

Did your 3.x automatically migrate the tables to character set UTF8MB4

[dyelton]

@Lindy Just throwing my $0.02 in there in wanting a 4.1.x UTF8 -> UTF8MB4 converter. I want to use Emojis but can't. My database is quite large as well with 1.3 million posts...several gigs in size. Looking for an official converter from Invision on this one. Help us Obi Wan Lindy!

[Owdy]

Can someone do payd mod from this? Seems Invision isnt interested 

[The Old Man]

I think it would be a great idea to have an official convertor. I too chose UTF-8 at the time, because I wasn't too sure about the choice and erred on the side of caution in the heat of the moment. The installer made it sound like it was more about being able to post music symbols and things which didn't bother me. Unless I dreamed that. I have slept since then. 

This is the sort of tool we need, I really miss the old AdminCP, the dumbed down version is a hinderence too with things like advanced options and caching, recounting etc hidden away or disguised behind an all seeing, all knowing mysterious support tool. But that's another story!

[Batnik]

yep i just checked the box for UTF-8 tooo, didnt really realize that it can not be undone .................

the converter is a script that can be done in max. 5 hours but i wait until invision does it ...

 

Edited March 29, 2016 by Batnik

[mesteele101]

There is absolutely no upside for IPS to invest one second into this project. IPS's only concern is with the new 4.x installs, which, by default automatically sets the character set to UTF8MB4.

When you upgraded from 3.x you had one shot at the conversion. This was not something IPS made a point of telling anyone., especially early adopters of 4.x.

Could they do this, sure, but again, there is no upside for IPS...

[Batnik]

my install was a new install and there was an option to set utf8 or utf-8-mb4 !

i chosen the wrong one, now i can not go back wtf ?!

this option was not really described well!

[chilihead]

I'm not sure why it's not recommended on install. They way it's described is as if it's somthing you don't need. They don't even mention emojis.

Edited March 29, 2016 by chilihead