Support persian characters

[hmmftg]

No description provided.

[ravarage]

I will test this against Kurdish chars, they are mostly either Arabic or persian thank you

[ravarage]

I don't know what you did, I tried this and a lot of thing even in Arabic got broken, so I made my own solution, I want to compare accuracy with original library, not this fork, guess what?, the original beside missing chars, it is working great, now my solution does support Persian too, not sure if I should release it or add it to this library, I will do some benchmark and compare success rate between them, then I decide
it support Arabic, Urdu,Persian and Kurdish
it support remove harakat , shift harakat, remove tatweel , zero width chars and use unshaped instead of isolate

[hmmftg]

I don't know what you did, I tried this and a lot of thing even in Arabic got broken, so I made my own solution, I want to compare accuracy with original library, not this fork, guess what?, the original beside missing chars, it is working great, now my solution does support Persian too, not sure if I should release it or add it to this library, I will do some benchmark and compare success rate between them, then I decide it support Arabic, Urdu,Persian and Kurdish it support remove harakat , shift harakat, remove tatweel , zero width chars and use unshaped instead of isolate

can you commit your changes to let us now your solution?

[ravarage]

https://github.com/ravarage/go-arabic-reshaper
its very slow compare to this solution, just by making it one loop it improve the performance by %50, I Will try to make it feature reach by adding linguist chars but for right now I am too busy , and this got the job done for me

[DearRude]

Any updates on this?