Go-Native Durable Execution
56 points
1 month ago
| 6 comments
| dbos.dev
| HN
erdaniels
1 month ago
[-]
Also check out https://www.restate.dev/. We chose this internally after evaluating it against temporal, hatchet, and dbos. The docs are pretty good and development locally and deployment to k8s was simple.
reply
eatonphil
1 month ago
[-]
A thing to note is that Restate is not open-source (BSL) while dbos (core, anyway) and temporal are. (Haven't heard of hatchet before.)

On the other hand, durable execution in dbos is implemented in libraries so you have different features for different languages (the Go one doesn't support SQLite as a backend for example while the Python one does), whereas Temporal and Restate are not embedded like this.

reply
sklarsa
1 month ago
[-]
Very timely for me! I've been looking into a go-based workflow engine. How does DagGo compare to go-workflows? https://cschleiden.github.io/go-workflows/
reply
atmonostorm
1 month ago
[-]
I landed up creating https://github.com/atmonostorm/derecho to answer the question of "in-process temporal.io". Works pretty well, with some unique features (error-controlled retry behavior) that temporal can't do.

I've used it pretty heavily in production, ~30m workflows of various types from various projects through it at this point. No capacity to support it as OSS though, and my internal persistence backend isn't easily extricable from monorepo, but it's just an interface with conformance tests.

reply
colek42
1 month ago
[-]
reply
yaronsc
1 month ago
[-]
Thank you! :) (Dapr maintainer here)
reply
dangoodmanUT
1 month ago
[-]
Been eager for something that wasn’t temporal (egregious overhead and annoying multiple services), but they do write this like Temporal… doesn’t exist. They use a lot of the same pioneered techniques (like “our own context type”) that they do.

go-workflows has always been the good alternative, but I’m sure dbos is a bit better supported. Dbos always had some weird gaps (I don’t remember why exactly, I just remember saying “oh well I can’t use this then” more than once), but maybe they’ll close them with the go sdk

reply
hmaxdml
1 month ago
[-]
Thanks for the comment (author here). I wanted this post to focus on the Golang specific implementation, not dwell on the durable execution ecosystem at large.

With respect to context, I don't know that anyone invented "having their own context". Go interface are extendable and pretty much every major framework I know of implement their own context.

Would love to learn more about the gaps that offset you. We're constantly improving here ;)

reply
dangoodmanUT
1 month ago
[-]
Thanks, I didn't mean it as criticism, I guess my 5am brain thought the way it was worded almost came off as like "look at our unique idea" which was a pretty common pattern.
reply
dangoodmanUT
1 month ago
[-]
In review, I think it might have been the workflow versioning being strange, and the lack of any heartbeating/crash detection for longer running activities
reply
hmaxdml
1 month ago
[-]
Automatic crash detection for your process is built-in our Conductor offering. The library has a default recovery mode when used standalone.

What do you find strange with workflow versioning? Would love to consider improving the semantics. In fact, we started doing it: https://github.com/dbos-inc/dbos-transact-py/pull/598

reply
pphysch
1 month ago
[-]
We bounced off dbos when we found they charge $$$ for their CRUD web GUI ("DBOS conductor"), which they also "strongly recommend" for production use, for good reason.
reply
hmaxdml
1 month ago
[-]
Conductor is about enterprise features like automatic workflow recovery, alerting, or RBAC. The GUI is a nice to have -- but all your workflow data are in Postgres. You can access it very easily.
reply
pphysch
1 month ago
[-]
The offering would be enticing if some Web GUI features were behind a paywall. Separate "production" from "enterprise".

Right now the messaging is "you shouldn't use DBOS for production unless you are a paying customer", which is odd considering durable execution itself is a production-level concept. So we rolled our own in a few hundred lines of Python.

reply
akahn
1 month ago
[-]
> but they do write this like Temporal… doesn’t exist

See "DBOS vs. other systems" on the github repository page[1]

1: https://github.com/dbos-inc/dbos-transact-golang?tab=readme-...

reply
dangoodmanUT
1 month ago
[-]
I was referring to this post
reply
barelysapient
1 month ago
[-]
After spending way too much time debugging runtime problems with python based workflow tools, I’ve been implementing something very similar: DagGo.

DagGo is a type based workflow tool with observably written in Go. Jobs are compile time safe. I’m planning to bring it to feature parity with tools like Dagster over the next few months.

https://github.com/swetjen/daggo

reply
thealish
1 month ago
[-]
It looks like its just a copy and paste from temporal workflow go-sdk
reply
hmaxdml
1 month ago
[-]
I notice you didn't provide any specific comparison alongside that comment, which makes me feel frustrated because I think the Temporal workflow SDK is very different. Architecturally, Temporal and DBOS are at two opposites of the durable execution spectrum. I'd love to understand what makes you think this work is a mere copy and paste. Would you be willing to share some more with me?
reply