On macOS (High Sierra) the Gothic and next font after that (sorry I forgot what the icon was) don't work for capital letters (get a rectangle with some small digits in). The "Courier" font and handwriting style ones work fine.
Screen readers don’t do very well with this, so please only use it for novelty purposes. Otherwise you will unnecessarily be locking people out from what you write.
It’s really not a screenreader’s job to guess what a character might be being pressed into service to represent in a given scenario, and to try to work out when that’s inappropriate and it should be using the original specified meaning.
Then again different healthy humans read texts differently. There's no such thing as a canonical reading and any reading bring in prior semantics.
There was a sign posted in the break room of a lab I used to work at. It read, "<long complex equation> is easy for you to read, but not for everyone. Volunteer to read for the blind." It was a good double whammy.
The whole point of having Mathematical Alphanumeric Symbols as separate unicode code points, rather than just using normal latin characters with style markup, is so they can be used when the different letters have semantically different meanings -- in particular in maths when 𝘹 and 𝘅 can be in the same formula, representing different concepts. They're not a replacement for style markup.
In other words, they're different characters specifically so that screen readers can know to read them out loud differently!
Trying to 'fix' screenreaders by having them read anything that them as if they were normal latin characters, to accommodate people who like using the Mathematical Symbols block for fun in places which only allow plain text, would completely defeat the actual purpose of them.
How do screen readers handle other aspects of mathematical equations? For example, if I have an equation like "A equals B to the C", how do I represent this such that a screen reader will say it correctly? As far as I can tell, I can't.
I see the FAQ you linked states that I'm supposed to use markup for this. Unfortunately, that means the screen reader needs to understand math markup to work correctly. If that's the case, it seems like we could just include other concerns like Bold X vs X in the math markup as well.
> How do screen readers handle other aspects of mathematical equations? For example, if I have an equation like "A equals B to the C", how do I represent this such that a screen reader will say it correctly?
Am I confused as to what unicode.style is doing? Oh, yes I am. It's using U+1D400 MATHEMATICAL BOLD CAPITAL A and such. I see. Ok, thanks for setting me straight!
If you accept unicode for strings that should be "unique" (eg username), there are various normalization schemes that basically convert equivalent-ish looking characters into a consistent hash.
Followed by spam filters keying in on use of such alternative/modifier characters and marking them as spam. Better check your spam folder if you get a lot of e-mails with mathematical formulas.
Badly-implemented screen readers don't do very well with this. The Unicode Standard provides a Normalization Form for Compatibility Decomposition (NFKD / NFKC) that screen readers definitely should adopt in their Unicode implementation [1].
$ python
Python 3.7.0 (default, Jul 22 2018, 21:11:34)
[Clang 9.1.0 (clang-902.0.39.2)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import unicodedata as ud
>>> ud.normalize('NFKD', '''It's a kinda ascii-art thing that 𝔩𝔢𝔱𝔰 𝔶𝔬𝔲 𝔞𝔫𝔰𝔴𝔢𝔯 𝔥𝔫 𝔠𝔬𝔪𝔪𝔢𝔫𝔱𝔰 𝔞𝔩𝔩 𝔣𝔞𝔫𝔠𝔶 𝔩𝔦𝔨𝔢 𝔱𝔥𝔦𝔰. 𝕆𝕣 𝕝𝕚𝕜𝕖 𝕥𝕙𝕚𝕤 𝕚𝕗 𝕪𝕠𝕦 𝕨𝕒𝕟𝕥 𝕝𝕖𝕤𝕤 𝕘𝕠𝕥𝕙𝕚𝕔 𝕞𝕠𝕣𝕖 𝕠𝕦𝕥𝕝𝕚𝕟𝕖.
...
... 𝙸𝚜𝚗'𝚝 𝚞𝚗𝚒𝚌𝚘𝚍𝚎 𝚐𝚛𝚎𝚊𝚝?''')
"It's a kinda ascii-art thing that lets you answer hn comments all fancy like this. Or like this if you want less gothic more outline.\n\nIsn't unicode great?"
>>>
You'd hope a screen reader would have more effort put into it than a 3 second read of a HN thread?
I often wonder how many of the people who bring up the capabilities of screen readers are actually familiar with screen readers. (I'm admittedly not at all familiar with screen readers or their capabilities).
I'm having trouble understanding what this does. Apparently there's a popover when you select the text you typed. I had to go to https://github.com/ekmartin/unicode-style to figure this out.
Yup, appears relatively hard to use via Chrome mobile with Gboard. You just about can, but most words get swallowed and the site popover is in the same place as the Android text assistance popover
Underlines a̲r̲̲̲e̲̲̲̲̲̲̲ ̲̲̲̲̲̲̲a̲̲̲̲̲̲̲̲̲̲̲̲̲̲̲ ̲̲̲̲̲̲̲̲̲̲̲̲̲̲̲l̲̲̲̲̲̲̲̲̲̲̲̲̲̲̲̲̲̲̲̲̲̲̲̲̲̲̲̲̲̲̲ittle nesty when re-selecting already underlined characters from the left
Doesn't work with accented latin alphabet characters ("ü𝕓𝕖𝕣") - is it a fundamental restriction of the styled unicode charset or a mapping issue? Seems like it should be supported but would need a transition from precomposed characters to the equivalent combination of letter + diacritic.
Android Firefox is just showing me black boxes for those Unicode ranges, so this definitely can't be very effectively used everywhere (I haven't tried yet, but I'm guessing some native messaging apps may have similar issues).
This reveals all kinds of bugs in current software.
For example, if I use the tool to make a url italic, then pasting that url into Chrome's url bar gives me back a bunch of unicode rectangles.
But that's not what I wanted. I wanted Chrome's url bar to interpret those unicode code points as an italic version of the actual unicode code points I want. Chrome should add a check for edge cases like these and add branches to map the string to the corresponding non-styled code points automatically.
Someone needs to send lots of bug reports to all the relevant pieces of software that currently have this bug. Firefox, Chromium, probably Edge, Webkit. Those are just the browsers, but I'm sure there are more. I'm not actually sure about Firefox tbh, but maybe just send the bug report first and see if it gets accepted to find out.
Ooh, here's another one-- if you paste some unicode.style'd text into LibreOffice does it convert it to the "normal" code points and add the relevant styling? If not, it should, otherwise it's broken.
Actually, I just realized another issue. If I type something in the url bar that is styled with unicode.style, then there is no way for Chrome to know whether I want it displayed styled or not.
For example, maybe I'm pasting it there temporarily so that I can copy/paste it later in a Tweet. In that case I probably want to keep the current styling for the tweet.
So Chrome should map to the normalized unicode code points (just in case I'm typing a url or want to instantiate a search), but still display the styled version. Then when I copy it again, it should put the unicode.style version into the buffer. And the app which receives the pasted buffer should receive the unicode.style code points. And of course that app should also normalize it underneath while retaining the styled display for the same reasons.
To deal with this complexity, there should probably be a standardized way for all apps to deal with styled text.
Please help by testing every app and filing relevant bug reports.
> Did Unicode ever have any business assigning separate code points for italic versions of latin glyphs?
Here's the official answer to this question from the Unicode spec [1]:
"Mathematical notation requires a number of Latin and Greek alphabets that initially appear to be mere font variations of one another. For example, the letter H can appear as plain or upright (H), bold (𝐇), italic (𝐻), and script (ℋ). However, in any given document, these characters have distinct, and usually unrelated, mathematical semantics.
For example, a normal H represents a different variable from a bold H, etc. If these attributes are dropped in plain text, the distinctions are lost and the meaning of the text is altered."
> I can't tell if you're being serious or tongue-in-cheek, but I like this comment nonetheless.
Thanks! I started by interpreting the tool as a serious and important feature of putting styling where UIs don't allow it. Then I did a quick stream-of-consciousness advocacy for fitting the feature in all the places where it isn't allowed.
The results are obviously bad, which is reassuring.
Ugh. This just further poisons me against unicode being a good thing. ASCII or bust.
"ABCD" and "𝓐𝓑𝓒𝓓" are the same thing, but they also aren't. Am I supposed to normalize everything on username creation to prevent people from making duplicates?
You either have to do that, or restrict usernames to ASCII subset only (and face the wrath of non-Latin alphabet users), or restrict to a whitelist of ranges that only represent alpha characters across all languages (i.e. not math symbols, nor box-drawing, nor emoji, etc.)
i8n is complicated because the diversity of language is itself complicated. I feel your pain, though, don't get me wrong.
Not normalise, just set the rules you want to apply. Internationalised domain names suffer this issue, so cribbing their fix probably would work for you - pick a script, restrict allowable characters to it.
You probably never want to allow unrestricted use of any character set for a username, even ASCII - otherwise I could take the username 'bjt2n3904 '.
> But that's not what I wanted. I wanted Chrome's url bar to interpret those unicode code points as an italic version of the actual unicode code points I want. Chrome should add a check for edge cases like these and add branches to map the string to the corresponding non-styled code points automatically.
No, it shouldn't. They are semantically different code points. The _whole point_ is that they are semantically different code points (they're from the Mathematical Alphanumeric Symbols block, the purpose of which is for e.g. when you have a formula containing 𝘹 and 𝘅 as semantically different characters, where that difference needs to be preserved in copying & pasing, conveyed to screen readers, etc.
> Ooh, here's another one-- if you paste some unicode.style'd text into LibreOffice does it convert it to the "normal" code points and add the relevant styling? If not, it should, otherwise it's broken.
It really, really, really shouldn't, for the same reason as above.
Mathematical symbols are not a replacement for text styles and markup. Trying to make them that will destroy the thing they're actually useful for, the thing they can do that text styling can't do: preserve their semantics when transmitted in plain text (including for accessibility purposes).
This is not styling. It cannot be normalized away. They are semantically different characters.
Neat idea but completely unusable on Firefox mobile due to the context menu that pops up whenever text is selected and obscures the site's menu that does the same.
There is something about rendering these unicode code points that seems to make Firefox jank more than usual (when scrolling this page up and down). Are rendering these code points especially costly for some reason?
69 comments
[ 3.4 ms ] story [ 126 ms ] threadVery neat utility, though!
There was a sign posted in the break room of a lab I used to work at. It read, "<long complex equation> is easy for you to read, but not for everyone. Volunteer to read for the blind." It was a good double whammy.
The whole point of having Mathematical Alphanumeric Symbols as separate unicode code points, rather than just using normal latin characters with style markup, is so they can be used when the different letters have semantically different meanings -- in particular in maths when 𝘹 and 𝘅 can be in the same formula, representing different concepts. They're not a replacement for style markup.
In other words, they're different characters specifically so that screen readers can know to read them out loud differently!
Trying to 'fix' screenreaders by having them read anything that them as if they were normal latin characters, to accommodate people who like using the Mathematical Symbols block for fun in places which only allow plain text, would completely defeat the actual purpose of them.
https://www.unicode.org/faq/ligature_digraph.html#Pf6
I see the FAQ you linked states that I'm supposed to use markup for this. Unfortunately, that means the screen reader needs to understand math markup to work correctly. If that's the case, it seems like we could just include other concerns like Bold X vs X in the math markup as well.
This was one of the problems that MathML was built to solve, see https://accessibility.princeton.edu/blogs/mathml-accessible-...
This is called a Homoglyph attack.
If you accept unicode for strings that should be "unique" (eg username), there are various normalization schemes that basically convert equivalent-ish looking characters into a consistent hash.
I have no doubt spam filters use this.
Badly-implemented screen readers don't do very well with this. The Unicode Standard provides a Normalization Form for Compatibility Decomposition (NFKD / NFKC) that screen readers definitely should adopt in their Unicode implementation [1].
[1] http://www.unicode.org/reports/tr15/
VoiceOver on iOS doesn’t speak it, either.
https://beta.observablehq.com/@mbostock/text-styles
type some text, then select it. that'll give you a format editor.
𝙸𝚜𝚗'𝚝 𝚞𝚗𝚒𝚌𝚘𝚍𝚎 𝚐𝚛𝚎𝚊𝚝?
I learned something new today, thanks!
http://qaz.wtf/u/convert.cgi?text=Hacker_News
For example, if I use the tool to make a url italic, then pasting that url into Chrome's url bar gives me back a bunch of unicode rectangles.
But that's not what I wanted. I wanted Chrome's url bar to interpret those unicode code points as an italic version of the actual unicode code points I want. Chrome should add a check for edge cases like these and add branches to map the string to the corresponding non-styled code points automatically.
Someone needs to send lots of bug reports to all the relevant pieces of software that currently have this bug. Firefox, Chromium, probably Edge, Webkit. Those are just the browsers, but I'm sure there are more. I'm not actually sure about Firefox tbh, but maybe just send the bug report first and see if it gets accepted to find out.
Ooh, here's another one-- if you paste some unicode.style'd text into LibreOffice does it convert it to the "normal" code points and add the relevant styling? If not, it should, otherwise it's broken.
Actually, I just realized another issue. If I type something in the url bar that is styled with unicode.style, then there is no way for Chrome to know whether I want it displayed styled or not.
For example, maybe I'm pasting it there temporarily so that I can copy/paste it later in a Tweet. In that case I probably want to keep the current styling for the tweet.
So Chrome should map to the normalized unicode code points (just in case I'm typing a url or want to instantiate a search), but still display the styled version. Then when I copy it again, it should put the unicode.style version into the buffer. And the app which receives the pasted buffer should receive the unicode.style code points. And of course that app should also normalize it underneath while retaining the styled display for the same reasons.
To deal with this complexity, there should probably be a standardized way for all apps to deal with styled text.
Please help by testing every app and filing relevant bug reports.
Did Unicode ever have any business assigning separate code points for italic versions of latin glyphs? Am I ignorant as to their true purpose?
EDIT: SEMI just answered my second question. Math. Makes sense.
Here's the official answer to this question from the Unicode spec [1]:
"Mathematical notation requires a number of Latin and Greek alphabets that initially appear to be mere font variations of one another. For example, the letter H can appear as plain or upright (H), bold (𝐇), italic (𝐻), and script (ℋ). However, in any given document, these characters have distinct, and usually unrelated, mathematical semantics. For example, a normal H represents a different variable from a bold H, etc. If these attributes are dropped in plain text, the distinctions are lost and the meaning of the text is altered."
[1] https://www.unicode.org/versions/Unicode11.0.0/UnicodeStanda...
Thanks! I started by interpreting the tool as a serious and important feature of putting styling where UIs don't allow it. Then I did a quick stream-of-consciousness advocacy for fitting the feature in all the places where it isn't allowed.
The results are obviously bad, which is reassuring.
"ABCD" and "𝓐𝓑𝓒𝓓" are the same thing, but they also aren't. Am I supposed to normalize everything on username creation to prevent people from making duplicates?
i8n is complicated because the diversity of language is itself complicated. I feel your pain, though, don't get me wrong.
You probably never want to allow unrestricted use of any character set for a username, even ASCII - otherwise I could take the username 'bjt2n3904 '.
No, it shouldn't. They are semantically different code points. The _whole point_ is that they are semantically different code points (they're from the Mathematical Alphanumeric Symbols block, the purpose of which is for e.g. when you have a formula containing 𝘹 and 𝘅 as semantically different characters, where that difference needs to be preserved in copying & pasing, conveyed to screen readers, etc.
> Ooh, here's another one-- if you paste some unicode.style'd text into LibreOffice does it convert it to the "normal" code points and add the relevant styling? If not, it should, otherwise it's broken.
It really, really, really shouldn't, for the same reason as above.
Mathematical symbols are not a replacement for text styles and markup. Trying to make them that will destroy the thing they're actually useful for, the thing they can do that text styling can't do: preserve their semantics when transmitted in plain text (including for accessibility purposes).
This is not styling. It cannot be normalized away. They are semantically different characters.
https://www.unicode.org/faq/ligature_digraph.html#Pf6
I discovered that by accident.
𝔸 𝔹 𝔻 𝔼 𝔽 𝔾 𝕀 𝕁 𝕂 𝕃 𝕄 𝕆 𝕊 𝕋 𝕌 𝕍 𝕎 𝕏 𝕐
P.S.: It's look like you reinvent YayText[3] website ;-)
[0] http://adamvarga.com/strike/
[1] https://yaytext.com/strike/
[2] https://yaytext.com/slash/
[3] https://yaytext.com/
𝔉𝔬𝔯𝔪𝔞𝔱 𝔱𝔢𝔵𝔱 𝔲𝔰𝔦𝔫𝔤 𝔲𝔫𝔦𝔠𝔬𝔡𝔢 𝔠𝔥𝔞𝔯𝔞𝔠𝔱𝔢𝔯𝔰. 𝔓𝔞𝔰𝔱𝔢 𝔞𝔫𝔶𝔴𝔥𝔢𝔯𝔢 𝔱𝔥𝔞𝔱 𝔞𝔠𝔠𝔢𝔭𝔱𝔰 𝔭𝔩𝔞𝔦𝔫 𝔱𝔢𝔵𝔱.