Ask HN: How do you feel when your coding assistant loses context?
3 points
9 hours ago
| 8 comments
| HN
Background: My dad, my mom's dad, and my uncle all suffered from dementia; having a deep, multi-threaded conversation which you were invested in, where you suddenly need to remind the other person of what you were talking about, or who they are, has emotional consequences that range from deep frustration to helpless anger.

Can you feel when your agent has just compressed or lost context? Can you tell by how it bullshits you that it knows where it is, while it's trying to grasp what was going on? What's your emotional response to that?

jacquesm
8 hours ago
[-]
If you have an emotional response to anything an agent or LLM does then you should lay off the sauce for a while and take a walk or something. This stuff is just dumb tech, no matter what the appearances and it does not warrant you getting emotionally invested in your interaction with it. It's a tool. Just like there is no point in getting upset at a hammer or a chainsaw. You are in control, you are the user.
reply
mattmanser
22 minutes ago
[-]
Can you see the flip side of this?

The way the LLMs are configured by default is to be chatty and pretend to be human.

They're not talking like Data from Star Trek, nor HAL.

They're trying to be Samantha from Her.

Go watch that movie and see the visceral human response that evokes.

To tell people to treat it as a tool, while it's deliberately trying to pass off as human is like telling us to piss in the wind.

It's bad advice and not how humans work.

I think better advice might be 'set it to a different conversational tone' might be better advice.

reply
jacquesm
2 minutes ago
[-]
Yes, I see the flipside just fine, but we should all keep that flipside in mind all the time and not to let these tools get under our skin. That's why I keep any AI interaction off my main computer: no risk of contaminating my professional output and no way to let it become a habit.

Setting it to a different conversational tone is a patch, not a solution, it will just postpone the same outcome because the interaction model is purposefully created to resemble the interaction with a human. They could easily fix that but somehow none of the AI peddlers want to do this.

This is part of the whole alignment problem and one of the reasons I have a hard time seeing this whole development as a net positive even if it allows me to do some stuff in an easier way than before. The companies behind this stuff lack in the ethics department and they all are eyeing your wallet. The more involved you are the easier it will be to empty your wallet. So don't let that happen.

reply
gibbitz
8 hours ago
[-]
This is indicative of too much context. Remember these systems don't "think" they predict. If you think of the context as an insanely large map with shifting and duplicate keys and queries, the hallucinating and seeming loss of context makes sense. Find ways to reduce the context for better results. Reduce sample sizes, exclude unrelated repositories and code. Remember that more context results in more cost and when the AI investment money dries up, this will be untenable for developers.

If you can't reduce context it suggests the scope of your prompt is too large. The system doesn't "think" about the best solution to a prompt, it uses logic to determine what outputs you'll accept. So if you prompt do an online casino website with user accounts and logins, games, bank card processing, analytics, advertising networks etc., the Agent will require more context than just prompting for the login page.

So to answer the question, if my agent loses context, I feel like I've messed up.

reply
Someone1234
8 hours ago
[-]
Context management is a core skill of using an LLM. So if it loses key context (e.g. tasks, instructions, or constraints), I screwed up, and I need to up my game.

Just throwing stuff into an LLM and expecting it to remember what you want it to without any involvement from yourself isn't how the technology works (or could ever work).

An LLM is a tool, not a person, so I don't have an emotional response to hitting its innate limitations. If you get "deeply frustrated" or feel "helpless anger", instead of just working the problem, that feels like it would be an unconstructive reaction to say the least.

LLMs are a limited tool, just learn what they can and cannot do, and how you can get the best out of them and leave emotions at the door. Getting upset a tool won't do anything.

reply
setnone
7 hours ago
[-]
I can totally feel the shift, the rot or whatever when it happens, with opus 1M it seems to happen more often in my recent experience, while my approach didn't change a bit.

So i teach myself to not have an emotional response while working with LLMs. The actual response would be starting a new session, or dive into code myself.

reply
preordained
1 hour ago
[-]
Terrible, honestly. Betrayed, gaslit. Don't tell me it's just a tool and it's my problem...hell no, fix your stupid tool. The whole point is to immerse yourself so you don't feel any different than having an energetic and resourceful junior or some perhaps limited but useful companion at your beck and call. If that illusion drops, it's on the tool.
reply
journal
3 hours ago
[-]
Agents and assistants is like buying insurance. You need to pay per token.
reply
cdbattags
9 hours ago
[-]
I just posted this on HN this morning and was looking through "new" but I'm trying to solve this exact problem:

https://annealit.ai

reply
noduerme
9 hours ago
[-]
That's interesting. I mean, I've got an openclaw setup with Claude that is merging and storing chats from whatsapp and the web client once a day, has a ton of context accessible... but there's something about being right in the middle of solving a hard technical problem where you're deep in the weeds about which columns should represent which data, and suddenly it's like, what were we talking about? Oh I should trying to read the database structure again from scratch. I don't think that's a problem that any clever arrangement of memory or personality files can actually solve.
reply
cdbattags
8 hours ago
[-]
But I think when you actually structure memory in the right form based on "workload" (i.e. Google Spreadsheet, Microsoft Word XML, coding lang AST/DAGs), then this is truly possible to have additive "unforgetting".

Edit:

I truly believe this is solvable just like we're doing for natural language but with code/schema/etc! Relational, document, graph, vector!

reply
kojeovo
6 hours ago
[-]
now your coding assistant is suffering from dementia too. how sad. i ask it to save important stuff to a file
reply