<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:dc="http://purl.org/dc/elements/1.1/">
    <channel>
        <title>SOLVED Case insensitive search using non English charsets</title>
        <description> Hello guys, 

I'm testing sphider. 
As you know when you have a keyword &amp;quot;Book&amp;quot; in your web site and when you search &amp;quot;book&amp;quot; or &amp;quot;BOOK&amp;quot; or &amp;quot;Book&amp;quot; they all match the same page and highlight &amp;quot;Book&amp;quot;. My problem is: 

I use windows-1254 charset and I made my mysql table charset as latin5_turkish_ci and my html pages have windows-1254 charset. For example I have &amp;quot;AĞRI&amp;quot; in one of my page title. When I search &amp;quot;ağrı&amp;quot;, It does not it only search for &amp;quot;ağrı&amp;quot; not &amp;quot;AĞRI&amp;quot; and as a result highlights &amp;quot;ağrı&amp;quot; only. Another example: 
I have &amp;quot;ÇANAKKALE&amp;quot; in one of my pages. When I search &amp;quot;çanakkale&amp;quot; it says &amp;quot;did you mean Çanakkal&amp;quot; not &amp;quot;did you mean Çanakkale&amp;quot; and as a results returns no hit. 

1- How can we define the script that both &amp;quot;ğ&amp;quot; and &amp;quot;Ğ&amp;quot; or , &amp;quot;ç&amp;quot; and &amp;quot;Ç&amp;quot;, &amp;quot;ş&amp;quot; and &amp;quot;ş&amp;quot;, &amp;quot;ı&amp;quot; and &amp;quot;I&amp;quot; are the same characters with just different cases and it should search without case sensitive as in case of other non special characters? 

(Maybe by editing &amp;quot;commonfuncs.php&amp;quot; in line sttarting form 78 : 

$entities = array 
( 
&amp;quot;&amp;amp;amp&amp;quot; =&amp;gt; &amp;quot;&amp;amp;&amp;quot;, 
&amp;quot;&amp;amp;apos&amp;quot; =&amp;gt; &amp;quot;'&amp;quot;, 
&amp;quot;&amp;amp;THORN;&amp;quot; =&amp;gt; &amp;quot;Ş&amp;quot;, 
&amp;quot;&amp;amp;szlig;&amp;quot; =&amp;gt; &amp;quot;ß&amp;quot;, 
&amp;quot;&amp;amp;agrave;&amp;quot; =&amp;gt; &amp;quot;à&amp;quot;, 
&amp;quot;&amp;amp;aacute;&amp;quot; =&amp;gt; &amp;quot;á&amp;quot;,............ 
) 


Thanks in advance...</description>
        <link>http://www.sphider.eu/forum/read.php?3,8994,8994#msg-8994</link>
        <lastBuildDate>Fri, 24 May 2013 10:14:04 +0300</lastBuildDate>
        <generator>Phorum 5.2.10</generator>
        <item>
            <guid>http://www.sphider.eu/forum/read.php?3,8994,9074#msg-9074</guid>
            <title>Re: SOLVED Case insensitive search using non English charsets</title>
            <link>http://www.sphider.eu/forum/read.php?3,8994,9074#msg-9074</link>
            <description><![CDATA[ Hi guys,<br />
<br />
Finally I solved my issue, and I am sure most of people had the same issue. Long story short, here is my I did for Turkish characters:<br />
<br />
In commonfuncs.php, I removed Turkish accented words in remove accent words part. Then here comes the trick. In line 78 starts with &quot;$entities&quot;, I added the followings chars:<br />
<br />
<br />
<br />
$entities = array<br />
		(<br />
		&quot;Ç&quot; =&gt; &quot;c&quot;,<br />
		&quot;ç&quot; =&gt; &quot;c&quot;,<br />
		&quot;Ğ&quot;  =&gt; &quot;g&quot;,<br />
		&quot;ğ&quot;  =&gt; &quot;g&quot;,<br />
		&quot;İ&quot; =&gt; &quot;i&quot;,<br />
		&quot;ı&quot; =&gt; &quot;i&quot;,<br />
		&quot;Ö&quot;  =&gt; &quot;o&quot;,<br />
		&quot;ö&quot; =&gt; &quot;o&quot;,<br />
		&quot;Ş&quot;   =&gt; &quot;s&quot;,<br />
		&quot;ş&quot;  =&gt; &quot;s&quot;,<br />
		&quot;Ü&quot;  =&gt; &quot;u&quot;,<br />
        &quot;ü&quot;  =&gt; &quot;u&quot;,<br />
<br />
<br />
<br />
Then delete your database and do a clean index (Hint: you don't need to delete query log). <br />
<br />
Worked for me..<br />
<br />
One issue that remains is, it does not highlight the accented words even it finds them.<br />
Hope one of you can solve this..]]></description>
            <dc:creator>test-sphider</dc:creator>
            <category>Sphider Mods</category>
            <pubDate>Thu, 22 Dec 2011 20:07:03 +0200</pubDate>
        </item>
        <item>
            <guid>http://www.sphider.eu/forum/read.php?3,8994,8994#msg-8994</guid>
            <title>SOLVED Case insensitive search using non English charsets</title>
            <link>http://www.sphider.eu/forum/read.php?3,8994,8994#msg-8994</link>
            <description><![CDATA[ Hello guys, <br />
<br />
I'm testing sphider. <br />
As you know when you have a keyword &quot;Book&quot; in your web site and when you search &quot;book&quot; or &quot;BOOK&quot; or &quot;Book&quot; they all match the same page and highlight &quot;Book&quot;. My problem is: <br />
<br />
I use windows-1254 charset and I made my mysql table charset as latin5_turkish_ci and my html pages have windows-1254 charset. For example I have &quot;AĞRI&quot; in one of my page title. When I search &quot;ağrı&quot;, It does not it only search for &quot;ağrı&quot; not &quot;AĞRI&quot; and as a result highlights &quot;ağrı&quot; only. Another example: <br />
I have &quot;ÇANAKKALE&quot; in one of my pages. When I search &quot;çanakkale&quot; it says &quot;did you mean Çanakkal&quot; not &quot;did you mean Çanakkale&quot; and as a results returns no hit. <br />
<br />
1- How can we define the script that both &quot;ğ&quot; and &quot;Ğ&quot; or , &quot;ç&quot; and &quot;Ç&quot;, &quot;ş&quot; and &quot;ş&quot;, &quot;ı&quot; and &quot;I&quot; are the same characters with just different cases and it should search without case sensitive as in case of other non special characters? <br />
<br />
(Maybe by editing &quot;commonfuncs.php&quot; in line sttarting form 78 : <br />
<br />
$entities = array <br />
( <br />
&quot;&amp;amp&quot; =&gt; &quot;&amp;&quot;, <br />
&quot;&amp;apos&quot; =&gt; &quot;'&quot;, <br />
&quot;&amp;THORN;&quot; =&gt; &quot;Ş&quot;, <br />
&quot;&amp;szlig;&quot; =&gt; &quot;ß&quot;, <br />
&quot;&amp;agrave;&quot; =&gt; &quot;à&quot;, <br />
&quot;&amp;aacute;&quot; =&gt; &quot;á&quot;,............ <br />
) <br />
<br />
<br />
Thanks in advance...]]></description>
            <dc:creator>test-sphider</dc:creator>
            <category>Sphider Mods</category>
            <pubDate>Tue, 22 Nov 2011 17:55:55 +0200</pubDate>
        </item>
    </channel>
</rss>
