San Francisco, CA - FULL-TIME, INTERN, VISA Stuph (https://angel.co/stuph, https://stuph.co) is building its founding team! We are a stealth startup creating a consumer web product fueled by data mining and information…
Stuph (https://angel.co/stuph, https://stuph.co) is building its founding team! We are a stealth startup creating a consumer product fueled by data mining and information extraction. We are well funded and backed by top…
San Francisco, CA [will relocate/sponsor visa] Stuph (https://angel.co/stuph) is building its founding team. We're a stealth startup with a very ambitious vision. Our technology stack is Clojure/ClojureScript, but it's…
Stuph is building its founding team (https://angel.co/stuph-inc) Location: San Francisco, Positions: Senior Software Engineer, Frontend Software Engineer (Web + Mobile), UX designer We're an early stage, well funded…
This is not a cyclic dependency graph!!! This is a syntax for copying vertices, nothing else. It creates a DAG of three vertices and two edges, but uses only one step definition to do so. It automatically replicates the…
Yes, startup times are a pain. As of this morning, Drake now works with Drip, which is a nifty tool to bring down start up times. It spins "backup" JVMs, so next time you run the command, JVM is ready. It works great…
Actually, it was in the doc. If you followed the instructions below precisely, just send us your terminal log so that we can see what you're missing. A nicer way to run Drake We recommend you "install" Drake in your…
Drip now works with Drake! Yes, it's still less than ideal if you're calling Drake hundreds of times from an automated script which you need to run quickly, but for interactive development, it should work just fine:…
You don't have to have Drake.jar in the same folder as the workflow you're trying to execute. You create the script as described in the documentation, and you put it somewhere on your PATH along with the JAR file. The…
Read the "Installation" section, there's "A nicer way to run Drake" subsection. But I would advise to read the whole "Installation" section carefully.
> I'm sorry I don't have time to answer in full. We're not getting anywhere. Just give me goddamn examples! :) Please! Examples! > I can see this is really really hard to grok if you're basing everything on the…
I think, that would be a stretch to say so - in my opinion, it's not a good thing for the sole reason that it doesn't let you opt out of it. And it's not one of those cases when you would want to enforce discipline…
...continued from part1. read part1 first!... > It doesn't solve everything, but I guess the idea is, make it work right for the majority of cases ("sensible defaults") and then offer ways to deal with harder cases…
part1 >> The problem with this approach is because figuring out where the files are requires knowledge of the tool inner workings, that can only be acquired from reading the code or documentation > I suppose…
The project's README file (https://github.com/Factual/drake - scroll down) contains building and running instructions, as well as how to create a simple script to run Drake which you can put on your PATH.
Another problem with BPipe's approach is if you change method's name, you invalidate the existing files. This can be a problem during development, when re-running steps are expensive.
Thank you. Why not? We would love to see it, but we're also not actively using Amazon S3 at the moment. But we would be more than happy to review code contributions. First of all, you can file a feature request:…
Thank you very much for your response. Actually, I don't think there are any philosophical differences, and I'll try to make my case. > Bpipe absolutely says you don't want to manage the file names. I think this is…
To be honest with you, no, we didn't seriously consider it. Maybe we should have. I do not know if ClojureScript would be able to work with all the dependencies we have (for example, Hadoop client library to talk to…
It's a good point, and I agree it might not be the top priority, but I also understand the frustration. I, too, find 5s start up file rather irritating especially when I make errors in the workflow file, or didn't…
Got ya. Please voice your opinion about the priority in which features should be implemented by submitting a feature request at https://github.com/Factual/drake/issues, or +1'ing an existing one. There are so many…
Thank you very much for your kind words and support, and we certainly are looking forward to your feedback, feature requests and bug reports, as well as your code contributions, should you so desire. We built this based…
Thanks. I think you're missing the point. Imagine a big, complicated data workflow, like the one the diagram for which I showed at my video (real-life workflow):…
I see. Thank you very much. I think this is very cool. I can see several problems with this approach, and I would greatly appreciate it if you could comment on that. After all, I don't know Bpipe. The fundamental issue…
I can certainly see your point about using Drake in an automated environment where this delay would still matter, but running a daemon is not practical. I think you have a lot of good arguments against JVM. There were…
San Francisco, CA - FULL-TIME, INTERN, VISA Stuph (https://angel.co/stuph, https://stuph.co) is building its founding team! We are a stealth startup creating a consumer web product fueled by data mining and information…
Stuph (https://angel.co/stuph, https://stuph.co) is building its founding team! We are a stealth startup creating a consumer product fueled by data mining and information extraction. We are well funded and backed by top…
San Francisco, CA [will relocate/sponsor visa] Stuph (https://angel.co/stuph) is building its founding team. We're a stealth startup with a very ambitious vision. Our technology stack is Clojure/ClojureScript, but it's…
Stuph is building its founding team (https://angel.co/stuph-inc) Location: San Francisco, Positions: Senior Software Engineer, Frontend Software Engineer (Web + Mobile), UX designer We're an early stage, well funded…
This is not a cyclic dependency graph!!! This is a syntax for copying vertices, nothing else. It creates a DAG of three vertices and two edges, but uses only one step definition to do so. It automatically replicates the…
Yes, startup times are a pain. As of this morning, Drake now works with Drip, which is a nifty tool to bring down start up times. It spins "backup" JVMs, so next time you run the command, JVM is ready. It works great…
Actually, it was in the doc. If you followed the instructions below precisely, just send us your terminal log so that we can see what you're missing. A nicer way to run Drake We recommend you "install" Drake in your…
Drip now works with Drake! Yes, it's still less than ideal if you're calling Drake hundreds of times from an automated script which you need to run quickly, but for interactive development, it should work just fine:…
You don't have to have Drake.jar in the same folder as the workflow you're trying to execute. You create the script as described in the documentation, and you put it somewhere on your PATH along with the JAR file. The…
Read the "Installation" section, there's "A nicer way to run Drake" subsection. But I would advise to read the whole "Installation" section carefully.
> I'm sorry I don't have time to answer in full. We're not getting anywhere. Just give me goddamn examples! :) Please! Examples! > I can see this is really really hard to grok if you're basing everything on the…
I think, that would be a stretch to say so - in my opinion, it's not a good thing for the sole reason that it doesn't let you opt out of it. And it's not one of those cases when you would want to enforce discipline…
...continued from part1. read part1 first!... > It doesn't solve everything, but I guess the idea is, make it work right for the majority of cases ("sensible defaults") and then offer ways to deal with harder cases…
part1 >> The problem with this approach is because figuring out where the files are requires knowledge of the tool inner workings, that can only be acquired from reading the code or documentation > I suppose…
The project's README file (https://github.com/Factual/drake - scroll down) contains building and running instructions, as well as how to create a simple script to run Drake which you can put on your PATH.
Another problem with BPipe's approach is if you change method's name, you invalidate the existing files. This can be a problem during development, when re-running steps are expensive.
Thank you. Why not? We would love to see it, but we're also not actively using Amazon S3 at the moment. But we would be more than happy to review code contributions. First of all, you can file a feature request:…
Thank you very much for your response. Actually, I don't think there are any philosophical differences, and I'll try to make my case. > Bpipe absolutely says you don't want to manage the file names. I think this is…
To be honest with you, no, we didn't seriously consider it. Maybe we should have. I do not know if ClojureScript would be able to work with all the dependencies we have (for example, Hadoop client library to talk to…
It's a good point, and I agree it might not be the top priority, but I also understand the frustration. I, too, find 5s start up file rather irritating especially when I make errors in the workflow file, or didn't…
Got ya. Please voice your opinion about the priority in which features should be implemented by submitting a feature request at https://github.com/Factual/drake/issues, or +1'ing an existing one. There are so many…
Thank you very much for your kind words and support, and we certainly are looking forward to your feedback, feature requests and bug reports, as well as your code contributions, should you so desire. We built this based…
Thanks. I think you're missing the point. Imagine a big, complicated data workflow, like the one the diagram for which I showed at my video (real-life workflow):…
I see. Thank you very much. I think this is very cool. I can see several problems with this approach, and I would greatly appreciate it if you could comment on that. After all, I don't know Bpipe. The fundamental issue…
I can certainly see your point about using Drake in an automated environment where this delay would still matter, but running a daemon is not practical. I think you have a lot of good arguments against JVM. There were…