13 comments

[ 2.6 ms ] story [ 37.3 ms ] thread
I’m working on a tool somewhat similar to OpenRefine called Data Dojo. The emphasis is more on learning and experimentation, but I’m now looking into adding apache spark integration for more serious use cases. Would love any feedback from HN folk!

https://datadojo.app

Interesting. Very nice to see live-updating of results like Excel.

Python fails on this transform function:

  def f(a):
      v = a if a >= 4 else 2
      return v
Message in red: "Error: (Brython compile error)"

Update: I recommend you try https://pypyjs.org/ for python in the browser.

Thanks! I’ll look into it. The reason I chose Brython was because it transpiles in the browser, so no server side compilation needed.
I looked into this more. The issue is, at least in a default input, a is an array type, so you need to either access a[0] or map over it. e.g. this works:

  def f(a):
    v = a[0] if a[0] >= 4 else 2
    return v
It looks like the main issue here is getting the correct compile error from Brython. Funnily enough this seems easier to do for the PySpark version :)
What is this exciting dana analysis you speak of!!??
I don't know anything about Dana analysis and I'm 45. My career is done! Technology moves so fast!
Plotly for visualization, Shiny for creating interactive reports in R, Dash for creating interactive reports in Python
Is there a relationship between Open Refine and Google clouds Data Prep?
Low quality listicle SEO spam for their 'courses'. Submitter is abusing HN to spam nothing but links to their site.

Please avoid giving this kind of noise any attention or links.

I agree that this is very low quality. It is basically 5 of the names of 5 random tools with a generic description.

What is a good way to deal with low quality submissions on HN? We can't downvote and even posting on the link is a positive signal.