Generally speaking, local language models aren't much worse for coding than the biggest cloud models--at least the local ones that barely fit in 16 GB of VRAM. They still can't produce correct programs by themselves for cases that don't have working examples on Stack Overflow, still properly produce boilerplate, test cases, and sample code that resembles Stack Overflow answers vaguely finetuned to your use case, still are pretty good at rapid prototyping, and still can't substitute for an actual programmer.
Relying on a cloud service instead of one running on your own computer, as a programmer who surely has the level of skill needed to set up an off-the-shelf local language model, just seems dumb.
I will need to go back to the first few posts here to learn how to set up my own model locally just in case.
Even with your own iAI, if you arent continuously returning to coding on your own, you likely will lose the skill over time.
I saw it happen to everyone who went into management. Once hands are off the keyboard things start getting fuzzy and they lost their edge.
I look forward to consumer hardware that can run these giant LLM directly and bypass Big Tech and their gargantuan server farms.
Having AI apps running on your machines is much safer.
The new excuse for programmers to leave early from the office is that they used up their allotment on AI and can't do any more inquiries.
"Everyone will just have to learn how to do it like we did in the old days, and blindly copy and paste from Stack Overflow,"
Can confirm.
Generally speaking, local language models aren't much worse for coding than the biggest cloud models--at least the local ones that barely fit in 16 GB of VRAM. They still can't produce correct programs by themselves for cases that don't have working examples on Stack Overflow, still properly produce boilerplate, test cases, and sample code that resembles Stack Overflow answers vaguely finetuned to your use case, still are pretty good at rapid prototyping, and still can't substitute for an actual programmer.
Relying on a cloud service instead of one running on your own computer, as a programmer who surely has the level of skill needed to set up an off-the-shelf local language model, just seems dumb.