Looks like it is "go-style" because the API/syntax is modelled after the go API. In particular the "choose" macro from the example looks to be designed to mimic "select" even though otherwise macros might be dispreferred.
There's another library linked that has similar functionality with a less go-like API.
I think Concurrent ML (1991) had select before Go. Go itself took it from Newsqueak (1994) and Limbo (1995) I think. The name itself probably comes from the UNIX select(2) syscall, which first appeared in 4.2BSD (1983).
As someone who worked with a decent variety of languages that all claim their fame to CSP (Erlang, Clojure and Go), suffice to say that these all look very similar. It’s the tooling _around_ the CSP where the real differences are.
Well it's specifically CSP using cooperative multitasking (sadly no multithreading support unlike go) and a go-like API. CSP is a lot less specific than that.
> ...communicating sequential processes (CSP) is a formal language for describing patterns of interaction in concurrent systems.
> ... based on message passing via channels.
That seems like a mathematical language that could describe goroutines and channels but also seems like it could describe python's multiprocessing and queue constructs. I think of those as very different things given the (vastly different) applications. When I think of "go-style" I think of lightweight threads (I can have 1000s), where as python processes are heavy (100 is pushing it?). So maybe the specifics of the implementation have as much to do with the go-style as the abstract concept?
My understanding here is fuzzy for sure and I welcome corrections and more detail.
There are no queues in CSP, although you can make one by making a queue process.
In CSP, the sending side of a message is always logically simultaneous with the receiving side. So it's like Go's default channels where the sender and receiver both block until ready to transfer, and different from Python's multiprocessing and queue constructs, where the sender doesn't block.
CSP was used in Occam¹ on Transputers² in the 1980s. In Occam, it was normal to have a large number of tiny processes, some of them maybe only a few instructions (such as an implementation of a queue), and the thread switching and communication primitives were actual CPU instructions. The CPUs were joined with dedicated message communication links into large meshes, providing hardware parallelism with a very different model than today's SMP multi-core. A similar architecture exists today, XMOS³.
Go implements a model similar to CSP on today's SMP multi-core systems and OSes, emphasising many efficient, small threads running loops that communicate synchronously. Channels are unbuffered by default, making them like CSP. They can be made buffered, which adds a queue, as if a CSP queue process was added. Go is much less rigid than Occam, because you can also make new channels and spawn new threads efficiently, which are essential features in modern sofware.
Python multiprocessing doesn't provide efficient, small threads. You need larger thread units to get good performance out of it. It also emphasises queuing. So it's quite different from CSP.
Erlang implements a model like Occam and Go of many, efficient, small threads, but the messaging is always asynchronous. The communication is similar to Go with buffered channels.
Interesting, I didn't realize CSP was so specific.
I heard someone say that Erlang's model was CSP too. They aren't called "channels" but they're very similar in that you have two different process/threads that are reading/writing to/from an ordered stream that feels the same as reading/writing to/from a Go channel.
What would Erlang's model be called? Does "the Actor Model" cover it?
CSP is synchronous, so sending to a channel will block if the receiver isn't ready. Erlang and actors are asynchronous in this matter. They will send regardless of whether the receiver is in a state where it can receive the message. Practically, Go (and libmill) allow buffered channels so that you only block if the channel's buffer is full.
CSP is based on anonymous processes. Actors have identity, and this would be the process IDs in Erlang. Erlang and the actor model don't use channels (though you can use processes to mimic them).
> Practically, Go (and libmill) allow buffered channels so that you only block if the channel's buffer is full.
Go also allows rendezvous channel (channels with an empty buffer, so either side can only proceed when the other arrives: the actual message exchange is synchronous).
"Technically, these are the differences: Libdill is idiomatic C. Whereas libmill takes Go's concurrency API and implements it in an almost identical manner in C, libdill tries to provide the same functionality via a more C-like and POSIX-like API."
It isn't pure C. It uses x86-64 assembly language to save register context.
It falls back to setjmp()/longjmp() when its not x86-64, but (contrary to popular belief) those don't actually save all the registers, and longjmp() will on some platforms terminate the program if it detects it being abused in this way.
every other languages are too rigid when it comes to DSLs, so you either fall back to a scripting language / bloated XML file, or you use the language itself and write a bloaty and unreadable mess
only C allows that kind of level of customization, so powerful
i love D, i use it more than C, but damn i miss being able to shape the language this way
> every other languages are too rigid when it comes to DSLs, so you either fall back to a scripting language / bloated XML file, or you use the language itself and write a bloaty and unreadable mess
C macros fuckery aren't a good thing, at all. The problem aren't macro per say, Rust has them, the problem is the way they are implemented, with basic text substitution. There is absolutely nothing to praise here.
> every other languages are too rigid when it comes to DSLs, so you either fall back to a scripting language
This is objectively a false statement, Crystal, Rust, Haxe... actually implement Macros the right way. C macros are brittle and a horror to debug.
Every Lisp ever, as well. Textual macros like C's are useful if they're all you have, but definitely one of the worst options if you have a choice of macro systems.
Without go's nested functions and variable capture it's really not the same. The best use for channels in go (IMO) is to use variable scope checking to keep people new to the codebase from messing with resources outside of the right threads. You put all the critical code in a nested function and pass it over the channel, viola the compiler helps make sure your program is correct.
Whatever happened to the Mill CPU architecture / Mill Computing? I've just realised I haven't heard anything about it for a while, and just looking on The Mill forum the last post was nearly two months ago.
RISC-V is a pretty evolutionary architecture when compared to the Mill architecture, so I would think they're attempting pretty different things. I don't know a lot about Mill other than what I've read recently, but it seems like it's just had extremely slow progress towards an implementation, which leaves the claims about it's architectural innovations not proven until there's a chip to prove them on.
Do you have a pointer to Mashey's comments on Mill?
They just don't seem to be in a rush to get anything to market; I know they are talking to VCs but don't get the impression that they are motivated to take money that would speed their time-to-market.
57 comments
[ 3.0 ms ] story [ 117 ms ] threadI understand using "Go-style" as an adjective to describe this makes it easier for the uninitiated but it's doing everyone a disservice IMHO.
There's another library linked that has similar functionality with a less go-like API.
Just a guess.
Edit: this has been better discussed elsethread.
> ...communicating sequential processes (CSP) is a formal language for describing patterns of interaction in concurrent systems. > ... based on message passing via channels.
That seems like a mathematical language that could describe goroutines and channels but also seems like it could describe python's multiprocessing and queue constructs. I think of those as very different things given the (vastly different) applications. When I think of "go-style" I think of lightweight threads (I can have 1000s), where as python processes are heavy (100 is pushing it?). So maybe the specifics of the implementation have as much to do with the go-style as the abstract concept?
My understanding here is fuzzy for sure and I welcome corrections and more detail.
In CSP, the sending side of a message is always logically simultaneous with the receiving side. So it's like Go's default channels where the sender and receiver both block until ready to transfer, and different from Python's multiprocessing and queue constructs, where the sender doesn't block.
CSP was used in Occam¹ on Transputers² in the 1980s. In Occam, it was normal to have a large number of tiny processes, some of them maybe only a few instructions (such as an implementation of a queue), and the thread switching and communication primitives were actual CPU instructions. The CPUs were joined with dedicated message communication links into large meshes, providing hardware parallelism with a very different model than today's SMP multi-core. A similar architecture exists today, XMOS³.
Go implements a model similar to CSP on today's SMP multi-core systems and OSes, emphasising many efficient, small threads running loops that communicate synchronously. Channels are unbuffered by default, making them like CSP. They can be made buffered, which adds a queue, as if a CSP queue process was added. Go is much less rigid than Occam, because you can also make new channels and spawn new threads efficiently, which are essential features in modern sofware.
Python multiprocessing doesn't provide efficient, small threads. You need larger thread units to get good performance out of it. It also emphasises queuing. So it's quite different from CSP.
Erlang implements a model like Occam and Go of many, efficient, small threads, but the messaging is always asynchronous. The communication is similar to Go with buffered channels.
¹ https://en.wikipedia.org/wiki/Occam_(programming_language) ² https://en.wikipedia.org/wiki/Transputer ³ https://en.wikipedia.org/wiki/XMOS
I heard someone say that Erlang's model was CSP too. They aren't called "channels" but they're very similar in that you have two different process/threads that are reading/writing to/from an ordered stream that feels the same as reading/writing to/from a Go channel.
What would Erlang's model be called? Does "the Actor Model" cover it?
CSP is synchronous, so sending to a channel will block if the receiver isn't ready. Erlang and actors are asynchronous in this matter. They will send regardless of whether the receiver is in a state where it can receive the message. Practically, Go (and libmill) allow buffered channels so that you only block if the channel's buffer is full.
CSP is based on anonymous processes. Actors have identity, and this would be the process IDs in Erlang. Erlang and the actor model don't use channels (though you can use processes to mimic them).
Go also allows rendezvous channel (channels with an empty buffer, so either side can only proceed when the other arrives: the actual message exchange is synchronous).
Go can somewhat emulate Actor model using concurrency control structures and buffered channels with non-blocking send to emulate mailboxes.
1: http://libdill.org/
http://man.postnix.pw/plan_9/2/thread (Plan 9's thread(2). Personal note: I absolutely LOVE working with this library)
https://swtch.com/libtask/ (Rus Cox's portable library (Someone on the 9fans mailing list ported it to a micro-controller))
See Also:
https://seh.dev/go-legacy/ (A nice code tour of the historical CSP lineage of Go)
https://swtch.com/~rsc/thread/ (Bell Labs and CSP Threads)
libthread was written as a replacement when Alef was abandoned in Plan 9 3rd edition
Do you have a link to this?
It falls back to setjmp()/longjmp() when its not x86-64, but (contrary to popular belief) those don't actually save all the registers, and longjmp() will on some platforms terminate the program if it detects it being abused in this way.
only C allows that kind of level of customization, so powerful
i love D, i use it more than C, but damn i miss being able to shape the language this way
C macros fuckery aren't a good thing, at all. The problem aren't macro per say, Rust has them, the problem is the way they are implemented, with basic text substitution. There is absolutely nothing to praise here.
> every other languages are too rigid when it comes to DSLs, so you either fall back to a scripting language
This is objectively a false statement, Crystal, Rust, Haxe... actually implement Macros the right way. C macros are brittle and a horror to debug.
May 10, 2019 - https://news.ycombinator.com/item?id=19879679 (76 comments)
Nov 18, 2015 - https://news.ycombinator.com/item?id=10585505 (83 comments)
(and 2 more with 1 comment)
libdill:
9 months ago - https://news.ycombinator.com/item?id=27357295 (19 comments)
Feb 17, 2018 - https://news.ycombinator.com/item?id=16401234 (22 comments)
Dec 21, 2017 - https://news.ycombinator.com/item?id=15977983 (50 comments)
June 4, 2016 - https://news.ycombinator.com/item?id=11835091 (32 comments)
https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...
https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...
Whatever happened to the Mill CPU architecture / Mill Computing? I've just realised I haven't heard anything about it for a while, and just looking on The Mill forum the last post was nearly two months ago.
Do you have a pointer to Mashey's comments on Mill?
https://news.ycombinator.com/item?id=30522481
They wrote a macro (or in this case a set of macros) to transform that into valid C code.