I’m parsing a file format by recursing on a charlist. One of the challenges I have in parsing this format is determining whether the current Unicode codepoint is a letter or digit. So far I’ve written this: # HELP: This is not Unicode-savvy. Is there such a thing? defp letter_or_digit?(c) when c >=…

You absolutely can run regexes on charlists as in Erlang charlists are the strings. If you want to check if code point is digit, then here you have full list, you need to check all these groups. For rest of the character groups check here . BTW you do not need to change binary (as assume that you g…

I think you’re mistaken. Strings and charlists are not the same thing. Just to confirm: iex(1)> x = '1234' # note: single-quote to make it a charlist, not a binary / string '1234' iex(2)> Regex.match?(~r/23/, x) ** (FunctionClauseError) no function clause matching in Regex.match?/2 Th…

To have it be Unicode aware, you have to consider all the foreign characters. Is "й" going to return the right value for your function? Since listing them out is difficult, the easiest way is to check for numbers first and then check if the up case is different than down case.

Try Erlang regular expressions for charlists instead, I think this is what hauleth meant: re — OTP 29.0.2 (stdlib 8.0.1) You probably want to use regex to match for character property Number.

The regex examples below may help (correctly using the u flag as reminded by @NobbZ ). iex> char = "È" "È" iex> Regex.match? ~r/\p{Lu}/u, char true iex> Regex.match? ~r/\p{Ll}/u, char false iex> char = "é" "é" iex> Regex.match? ~r/\p{Ll}/u, char true iex> Regex.match? ~r/\p{Lu}/u, char false iex(16)>…

You forgot to enable unicode. Use the u flag on the regex.

Sigh. Thanks for the reminder. I hate that its not the default, but I understand why

I’ve just published the first version of ex_cldr_unicode that might be helpful to you. It builds functions at compile time using data from the Unicode database . Theres a bunch of fun stuff you can do, but to your use case it includes some guards that you may find useful. For example: defmodule M…

Updated to version 0.2.0 . Main changes are: Moves the public API to the Cldr.Unicode module. Updates and adds documentation to all public functions. Removes the text annotations from the compiled functions which materially reduces the size of the beam files. Feedback welcome as are featu…

Elixir Programming Language Forum

Unicode-savvy `letter_or_digit?` function?

Questions & Help Questions

scouten February 24, 2019, 3:05am 10

Thanks, Kip, that looks like it will fit my need very well.