> We’ll be able to do things like run fast models on the edge, run model pipelines on instantly-booting Workers, stream model inputs and outputs with WebRTC, etc.

Benefit to 3rd party developers is reducing latency and improving robustness of AI pipeline. Instead of going back and forth with https request at each stage to do inference you could make all in one request, e.g. doing realtime, pipelined STT, text translation, some backend logic, TTS and back to user mobile device.

I think this is being intentionally kept under wraps, so nobody who can say anything knows.

I have used their products and have more favor toward them than I do for the corporations you're referring to, but ultimately my question is the same.