FilterHN

Ask HK: How are you building AI apps today?

4 points

1 hour ago

| 2 comments

Generally curious how folks are using LLM APIs today.

Are folks doing anything bespoke, unique or different?

I think we've seen a lot of usage with harnesses, CLIs, Cursor/Windsurf etc which uses the APIs underneath.

If you are using the API itself, what does your architecture look like with said API?

1 hour ago

[-]

I try to batch requests and reuse responses wherever possible.LLM API calls are awesome,but if you don't watch your usage,cost sneaks up fast.

1 hour ago

[-]

Agreed, are you doing anything to take advantage of cacheing?

Anything else you can share about project?

1 hour ago

[-]

Mostly multi-model routing and structured outputs