What IDE to use for local models
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
Hi people,
I am looking for a lightweight IDE or plugin that won't inject large context at initiation.
I tried Cline and native VS Code but they inject such heavy initial context that it fills up my gpu and either goes oom or spend most of my time compacting. The only one I found modestly successful was continue.dev plugin but it needs constant approvals. My use case is to demo/try "autopilot" agent coding.
Thank you!
Some context: I have a 12gb rtx cuda and trying to run any model that would fit. I have a small context available due to the size of the vram.
[link] [comments]
More from r/LocalLLaMA
-
The AI race: China's open-weight models trail US closed models by just 7 months
Oct 14
-
Anthropic Executive Says Open-Source AI Models Are Higher Risk
Oct 14
-
ComfyUI v0.40.0 released
Oct 14
-
So this is how they do it --> RTX 5090, once a consumer gaming card, is now on smugglers’ menu alongside cigarettes
Oct 14
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.