Changes between Version 4 and Version 5 of normalize_arabic_translit

Timestamp:

May 8, 2015, 2:24:05 PM (9 years ago)

Author:

casties

Comment:

--

normalize_arabic_translit

@@ -5 +5 @@
 Algorithm for normalizing the existing transliterated arabic (_translit fields) in the database.
 
-Currently: source:OpenMind/src/main/java/org/mpi/openmind/repository/utils/NormalizerUtils.java
+=== New ===
 
-=== 1. replace letter combinations ===
+==== 1. replace letter combinations ====
+
+Replace the following letter combinations with a single letter.
+
+|| dj, ch || j ||
+|| th || t ||
+|| kh || h ||
+|| dh || d ||
+|| sh || s ||
+|| gh || g ||
+
+Replace at the end of a word:
+
+|| aẗ\b, at\b, ah\b || a ||
+
+Replace letters:
+
+|| ỳ || a ||
+
+==== 2. replace letters with diacritics ====
+
+Replace all(?) letters with diacritics with the letter without diacritics.
+
+Remove all apostrophes.
+
+
+
+=== Currently ===
+
+source:OpenMind/src/main/java/org/mpi/openmind/repository/utils/NormalizerUtils.java
+
+==== 1. replace letter combinations ====
 
 Replace the following letter combinations with a single letter.
@@ -19 +50 @@
 || ỳ || a ||
 
-=== 2. replace letters with diacritics ===
+==== 2. replace letters with diacritics ====
 
-Replace all letters with diacritics with the letter without diacritics.
+Replace all(?) letters with diacritics with the letter without diacritics.
 
 Remove all apostrophes.