Jump to content

suggestion: ssh converter/importer


Recommended Posts

there is a feature that i've seen in woltlab burning board and would like to see in IPB
it can be very useful for big boards
in the admin panel converter section: after entering the source database information you have 2 choices: either run it on the web like most converters or generate a ssh script that does it
if you choose the latter a command will appear and all you have to do is run it in ssh
i have tested it and i'm confident its made my import at least 10 times faster

Link to comment
Share on other sites

  • 2 weeks later...

May i ask when?

I ask that, because we are a big-board with our new invision's licence in hand (ready to install), and one of our (two) biggest concerns it is in fact the database size (10GB now).
Being able to use some sort of ssh script to import from vBulletin to Invision will be definitely a plus for us.


Link to comment
Share on other sites

  • 4 weeks later...

Mark, sure, you can bump the amount of data per cycle, it's not hard if you have server access. We did it, and instead of 1000 or 2000 per cycle, we did cycles of 10000 and 15000.
But if, for example, every 2000 cycle takes 30 seconds to complete, bumping it to 4000 per cycle does not mean 30 seconds for that too. It increase, maybe to 45 or 50 seconds per cycle, but increace the time too. And with 16M posts... that extra seconds become minutes, and then hours... and days. A lot of days.

Until now, i'm really happy with Invision. Our servers (load balanced) are running much more lighter than we was using vB.

The only big problem it's that the importer/converter it's not really thinked and prepared to run on big-boards with a lot of data. Really (and that was not the only problem we faced with the converter).
It's not a problem only affect you, guys. vB does not have a ssh converter/impex also, just the web based.

Having 1M posts or more can make the conversion process a really tricky and not pleasant thing.
If the idea it's to bring here new not-happy-people-with-vB-InternetBrands-thing, like me, it's definitely worth thinking how to improve the conversion process for big-boards.

Greetings ;)

Link to comment
Share on other sites

Just as a quick note, we also offer a conversion service. Anyone with a really big board (16M posts definitely counts ;) ) may be interested in just paying us to do the conversion for you. Then you don't have to worry about any of it. :)

I'm just putting that out there in case anyone wasn't aware we offer this service.

Link to comment
Share on other sites

  • 1 month later...

I'd also love to see an updated convertor available from the command line. I am struggling importing a forum with just 250,000 posts, the server canny take no more and load just skyrockets!
Is there any way of delaying the refresh of the cycle page in the current convertor? I actually need to slow down the convertor to give the server chance do do other things as well as the conversion.

Link to comment
Share on other sites

Nope, not given any SSH options.. Maybe I did something different. I've got it going now, had to change the cycle page refresh from 2 seconds to 10 seconds.. Taking its time but at least its not overloading the server! I don;t know what I'm going to do with my bigger forums though...

Link to comment
Share on other sites


Re-download whatever version your using and look in the "Tools" folder.

Upload the needed files (rebuildPMs.php or rebuildPosts.php) to the root folder path (area that contains conf_global)

Then visit it on ssh like

php path to file

Link to comment
Share on other sites


This topic is now archived and is closed to further replies.

  • Recently Browsing   0 members

    • No registered users viewing this page.
  • Create New...