HN Explorer

89 comments

[ 5.9 ms ] story [ 158 ms ] thread
ique
This works surprisingly well! It even made my crappy writing into the correct markup. Great for when you have a big equation to "translate" to LaTeX quickly or to just look up a character you don't know the name of.

I wish there was a function to upload an image or to capture an image via webcam or something like that. Then I could write it on paper and show it to the webcam and get the markup, or upload scans of notes to have them translated.

kmfrk
Yeah, they could easily create a separate pastebin-like business for equations. It would do miracles for homework assistance and teletutoring. Especially if they let people embed the code.

EDIT: You could even add a business model that made the posts auto-delete after a month where premium users could keep their pastes up forever and embed them. Infinite possibilities.

jessriedel
> or to just look up a character you don't know the name of.

There's Detexify for that:

detexify.kirelabs.org/

randomdata
On my first attempt, I couldn't even make out what I had drawn, but this service inferred my intent anyway. Amazing.
lignuist
Awesome! I really hope, someone comes up with a pdf2tex tool, that handles formulas well.

Edit: is even more fun on a tablet.

acharekar
+1

This works amazingly well. Brilliant !

ajuc
It just works. I've thought it will sometimes work. And it just works.

Brilliant.

sachdevaprash
http://detexify.kirelabs.org/classify.html Found this ages back. It suggests options and not just one result. Works better.
lignuist
Works only for single symbols, but not for complex formulas.
sachdevaprash
Oh. Good point. Yeah Web Equation does better in that regard. But I think its good to give some alternatives as well. Just in case it gets it wrong sometimes.
chalst
They are different. Detexify is really useful, since it matches against a vry large symbol set, and is trained against a pretty large sample set. For symbol recognition, this app is pretty crude.

It's still cool, but I struggle to think of a use case for it. It's too unreliable to be of use for scanning maths notes.

rubidium
!FINALLY! I'm very happy with this. The recognition is much better than the other similar things I've tried. By my limited testing, it seems to be accounting for the image as a whole and not the order of strokes, so should work for uploads.

A couple desired improvements:

-Allow uploading of images

-add an eraser/undo

-some Greek/Hebrew letters (aleph, beth, xi... ) aren't being recognized despite my tries... they've very similar to X's, equivilant, and ='s. Beth really should work, but isn't.

linuxlizard
Amazing. So much fun, so useful. Will be using this in future homework assignments!
muyuu
Very nice. Always thought the stylus interface had a lot of upsides and this is yet another one.

Looking forward to more devices supporting both fingers and stylus, like the Flyer or the Galaxy Note.

deisner
I had an idea for a mobile app where you'd take a photo of a legal pad full of handwritten text and equations, and the app would generate a latex document or a PDF. Maybe this is possible now?
gus_massa
This is incredible good.

But some formulas doesn't work (for example: $\sqrt[3]{2}$) and I can't find a feedback / suggests a better translation button.

jen_h
So. Awesome. And it works on my phone -- very sweet. My only quibble is that I couldn't get it to hack me up a per mille (this was the #1 question I used to get working as LaTeX support for a journal publisher years back).
pooriaazimi
I didn't know 'per mil' had a sign! 'Per mil' is one tenth of a percent(%), so 1% = 10‰.

http://en.wikipedia.org/wiki/Per_mil

jen_h
There's a package, wasysym, which gives you \permil, but I always just cheated with \%_o. Doesn't look very pretty, though. :)
bdg
This was interesting. I've recently been using latex to write math equations down but this might save me a lot of time (one I dig my drawing tablet out of the closet).

I'd be more interested in a write-up of how you made it more successful than previous attempts however, technologies used, etc.

fdej
It did -\int _{-\infty }^{\infty }\dfrac {\cos \left( \pi t+\beta \right) ^{2}} {e^{t^{2}}}dt=F\left( \beta \right)

I'm impressed.

gjulianm
Great! But it does not recognise matrixes. Matrixes are the hardest thing to write in LaTeX, it would be wonderful to write them by hand and then having the LaTeX code without problems.
gpakosz
Indeed, we don't support matrices yet but this is a feature we're currently adding, no eta though.
dfan
That's pretty brilliant. I do wish I could edit the generated LaTeX in place to give it hints when it's gotten something slightly wrong.

I wonder if it has any contextual smarts (e.g., sees a partial derivative sign in a numerator, knows it should "vote up" interpretations of the denominator that start with another partial derivative sign).

jrockway
I always dreamed of having a tablet that could do this when I was taking math in college.

Where's the code?

johno215
Very impressive! The only issue I've run into is it having trouble discerning lower-case and upper-case letters. Training with my own writing style should be able to correct this however.

Is there a plan to offer this as a non-web-browser service? I would love to be able to write math out on paper, or a resistive screen tablet, and then import it into a LaTeX document.

I am faster writing equations by hand than typing LaTeX (and definitely faster compared to using a WYSIWYG equation program).

Edit: By the way, this is the perfect example of a problem I've always wished a start-up would come along and solve for me.

keithpeter
Just used this on an interactive whiteboard in front of a class for basic algebra. Very nice indeed, well done sir.

How about image save for the rendered formula? I could copy/paste straight into Word for a nice homework exercise.

Basically education lower down the system could use this, not just University level.

euccastro
Funny glitch: draw an alpha, get \alpha. Then draw a beta and gamma to the right, without touching or overlapping the alpha, and I get \propto \beta \gamma. I've found it shuns greek letters in general. I get an `x' from by best attepmts at \lambda.

Really impressive and useful, nonetheless.

rafeed
This is fantastic! It's actually more robust than I thought it was going to be.
cottonseed
This is pretty cool, although it doesn't seem very efficient if you goal is to write TeX. It would be interesting see how well it works to OCR hand-written notes or old-timey typewritten (that is, typed on a typewriter) math manuscripts where the mathematical symbols written in afterwards by hand...
gpakosz
Hi folks,

A small note on what we don't support yet:

no cube roots, no nth roots either

square root's top line must be a single line (make it wide enough up front)

no matrices

no system of equations

no corrections, no scratch out (use top left undo/redo arrows)

leave enough space between integral/summation symbols and main expression for better accuracy

LaTeX output pleases MathJax as much as possible (thank you guys for your lovely rendering library)

Hope that helps, Thank you for trying it out.

PS: MathML seems to get little attention, why is it so?

--- LIST OF SUPPORTED SYMBOLS (encoded in UTF-8) ---

Letters

  a b c d e f g h i j k l m n o p q r s t u v w x y z
  A B C D E F G H I J K L M N O P Q R S T U V W X Y Z
Digits

  0 1 2 3 4 5 6 7 8 9
Maths symbols

  € $ £ ¥ ₩ ¢ ( ) < > [ ] { }  ! # % & ? @ / \ | ∥ © ∂∅ ∇ ∞ 
  ℂ ℕ ℚ ℝ ℤ
  + - ± × ÷ * ∘ · = ' , .  : ; _
  ← ↑ → ↓ ↔ ↕ ↖ ↗ ↘ ↙
  ⇐ ⇑ ⇒ ⇓ ⇔ ⇕
  ∀ ∃ ∄ ∈ ∉ ∋ ∌ ∩ ∪ ⊂ ⊃ ⊄ ⊅
  ∼ ≃ ≠ ≡ ≢ ≤ ≥ ≪ ≫ ∝ ∠
  ∏ ∑ ∫∮∧ √
Greek symbols

  Γ Δ Ω α β γ δ ε η θ λ ν π ρ σ τ φ χ ψ ω ϕ µ
International convention units (with cursive support)

  km hm dam dm cm mm µm
  ha
  hl dal dl cl ml µl
  kg hg dag dg cg mg µg
  ms µs
  GHz MHz kHz Hz
Other mathematical terms (with cursive support)

  sin cos tan sinh cosh tanh arcsin arccos arctan cot coth
  min max arg argmin argmax
  inf sup lim liminf limsup
  ln log
  dx dy dz dt
robertskmiles
It doesn't support '⊂'. It supports 'c' and 'C', but not '⊂'.

Edit: It's amazing work by the way, but distinguishing those definitely needs more training.

gpakosz
Writing '⊂' alone would likely be recognized as 'c' or 'C' because the decision is based on the context.

'A ⊂ B' is unkikely going to be recognized as 'A c B' or 'A C B'

rsaarelm
Looks like it knows it's supposed to print "sin" and "cos" in non-italic text, but not the 'd' in \int x d x.

Extremely neat in any case.

fdej
I've almost never seen an upright 'd' in mathematical literature, though it seems to be somewhat more common in engineering texts. Ditto for the imaginary unit 'i' and the constant 'e'. Matter of taste.
wnoise
All three are set upright in _The Princeton Companion to Mathematics_ (Gowers).
rsaarelm
Hm. Now I wonder where I got the idea that of course it's supposed to be upright. Though I have been reading the Princeton Companion book mentioned in sibling.

I guess the problem is that the system drops the space between the expression and the dx, outputting the "xdx". Math text does have space before dx even if the letter is italic.

dwc
> PS: MathML seems to get little attention, why is it so?

MathML is hard to write and harder to read. The only time I pay any attention to MathML is when sites do not have TeX as an option. Others may feel differently, but this is my reason.

radicalbyte
> MathML is hard to write and harder to read.

That's what tooling is for.

It looks like a great solution for including Math in html, only the browser support seems to suck. No Chrome or IE support without the use of a plugin.

dwc
> That's what tooling is for.

I disagree. Essentially requiring tools for a supposedly human-readable markup nullifies the whole human-readable aspect. Tools such as equation editors can be a great boon, but those can be had without giving up being able to read and write the markup directly.

I do think it's a shame that browser support for MathML is limited or missing. I'd much rather have direct, native MathML support than nothing. MathJax is a pretty nice way to address this for now, I think. Much better than requiring random site visitors to install a plugin.

gpakosz
I somewhat expected people would use it as an input to other math software
alexchamberlain
I think enough people are used to using LaTeX that MathML was never going to catch on, as its too verbose.
Lambdanaut
Cube roots and nth roots worked just fine for me.
hjalle
You must be a real handwriting-wizard because I've tried for 10 minutes now without getting it to work! :(
xxqs
is it a raster image recognition, or a vector/gesture recognition?
mathieuruellan
vector and gesture. This demo is a use case of our SDK. The SDK needs in input strokes (array of x/y) in the order. It returns a tree of symbols. We provides tools to transform into LaTex and MathML.
gpakosz
it's online recognition

we interpret the strokes (1 stroke == 1 sequence of 2D points)

in other words, it doesn't work on images; but we need input from a mouse, stylus, touchscreen, inkling, anoto pen, anything that outputs sequences of x,y coordinates

xxqs
then it's rather a gesture recognition :)

it would be interesting to see it on a wearable computer, taking input from some gesture input devices: accelerometers or video input with markers

[deleted]
(comment deleted)
dgreensp
For some reason, the first thing I tried was circle-plus, which it thought was a theta followed by a bar or a one. D'oh.
eykanal
I was very impressed that it was able to interpret "min" with "x-2" underneath it, but if I wrote anything next to it the interpreter failed. I tried writing the "min" bit on one side and putting a very large parenthesis on the other side of the sheet, but it still didn't work.

Also, it handles \overline wonderfully -- impressively differentiating between an overline and fraction -- but it has trouble with the \underline. \Underbrace isn't working so well, either.

Yet another difficulty - "1 / 2" is turned into "y_2". The horizontal fraction delimiter doesn't seem to be recognized.

Very impressive!

arandomJohn
Do you have an iOS SDK? What are the licensing terms? I'd love to integrate this into some of my math games.
adimitrov
It works splendidly with any algebra I throw at it, but it's not very much intended to handle expressions in logical calculus, is it?

Case in point: http://i.imgur.com/tnuxs.png

JoshTriplett
For a bug report like this, you might want to explain exactly what LaTeX you expect that to turn into.
adimitrov
$p,q \vdash p$ — sorry, I was pretty sure it was obvious to anyone, but I guess my handwriting wasn't that good.