Invision Community 4: SEO, prepare for v5 and dormant account notifications Matt November 11, 2024Nov 11
Posted July 31, 2024Jul 31 Are there any scaling limits to imports on invision cloud? I have about 200k users I'd to move from my old platform. Eric
July 31, 2024Jul 31 Author Jim -- Thanks for the fast response. Good to know that I can have as many registered users as I want. My question was actually a bit more specific with regard to the import functionality in the member section. Can I import all 200k at once or do I need to split them up?
July 31, 2024Jul 31 7 minutes ago, Eric Mattson1 said: Can I import all 200k at once or do I need to split them up? The system processes these in real time so I would recommend splitting them up. Depending on how much data you're importing with the user will define how much you need to split this up by. I'm afraid, there is no set amount but I wouldn't recommend importing 200k members with 20 fields each in one go. Definitely will reach a timeout in our Cloud for doing that.
August 1, 2024Aug 1 Author Jim/Invision -- Do you have a recommendation for a safe size for a chunk of the import list that I could use where it won't freeze? 10k? 20k?
August 2, 2024Aug 2 Solution That would depend on a lot of circumstances. When using a web interface, the problem is how long it takes in time, not how many records you have. (It will execute for XX seconds before giving up.) So one batch may work at 10k, but another might fail at 5k because there was something that took longer to process in that smaller batch. Personally if you're using something that big, it might be worth using the API to create the accounts. https://invisioncommunity.com/developers/rest-api?endpoint=core/members/POSTindex If you don't want to do that, start small... 1k and see if it works. If it does, increase it and try a bigger batch. Rinse and repeat until you find what works for you. Edited August 2, 2024Aug 2 by Randy Calvert
August 2, 2024Aug 2 The above is indeed accurate. Start at a smaller size and work your way up to a size that is suitable.