Some technical details about Panza:
- Panza is an automated email assistant customized to your writing style and past email history.
- Panza produces a fine-tuned LLM that matches your writing style, pairing it with a Retrieval-Augmented Generation (RAG) component which helps it produce relevant emails.
- Panza *can be trained and run entirely locally*. Currently, it requires a single GPU with 16-24 GiB of memory, but we also plan to release a CPU-only version.
- Training and execution are also quick - for a dataset on the order of 1000 emails, training Panza takes well under an hour, and generating a new email takes a few seconds at most.
Edit: oof spoke to soon. Need to spend some time with this to adapt it for the M2. Only linux+nvidia out of the box