Has anyone here successfully had Claude or ChatGPT make a module or app for IPS5? It seems to spit out plenty of stuff that looks good, but I can't ever get any of it to install.

A few things I've been trying to make:

Duplicate Account Detector (my forum has a huge problem with trolls and dupe accounts, people signing up multiple accounts with no way to stop them)

Subscription Comparison Tool - This one is to automatically generate a comparison chart showing the privileges and permissions in IPS5 that each Group has,

In my experience working on professional and personal applications and code (Python, Java, etc), these AI assistant models via ChatGPT/CoPilot/etc are great starting points and can help get you down the right track but are very prone to mistakes and gaps in functionality. You can keep iterating and refining but you often get into cycles of inconsistency and hallucinations, spending more time trying to contextually prompt it through the issues than you would in manually reviewing/coding a bit more to get it further along.

They'll get better and better over time, but models will only output as good as your prompts and context guide it to. And even then, they have boundaries/limits to their context capacity and can lose or ignore important aspects (without telling you so and despite you continually instructing it otherwise). Again, they are great at getting you started and helping you understand/troubleshoot/fix specific issues, but they aren't at a level yet where you can create deeply complex or heavily integrated applications in their entirety faster (or at all) through prompts alone. There is no doubt they'll help you fast track though, so I highly recommend adopting them with your coding!

Just my .02, they are great learning tools, I use them every single day whether it's in my professional projects, personal projects, or in my personal life.

Edited April 17Apr 17 by Clover13

Yes, one thing that I've noticed is it will spit out a bunch of PHP and XML files, and then provide a directory structure, but then when I ask it to change something it will revise all of the files, change the names of the files and then spit out a different directory structure with folders that weren't there previously. So yes it seems to be able to produce some kind of uncanny product that is able to fool me into thinking it could work. But I'm not a developer or a programmer at all I'm just some guy who has used a computer for 30 years, and if anything I'm doing is working it's because I'm failing upward or getting lucky.

I appreciate your thoughts on the matter in any case!

On 4/18/2025 at 7:10 AM, Kyle_H said:

Yes, one thing that I've noticed is it will spit out a bunch of PHP and XML files, and then provide a directory structure, but then when I ask it to change something it will revise all of the files, change the names of the files and then spit out a different directory structure with folders that weren't there previously. So yes it seems to be able to produce some kind of uncanny product that is able to fool me into thinking it could work. But I'm not a developer or a programmer at all I'm just some guy who has used a computer for 30 years, and if anything I'm doing is working it's because I'm failing upward or getting lucky.

I appreciate your thoughts on the matter in any case!

Just curious, what program are using for the LLM? And program for coding?