FR: case insensitive search for high-ascii characters
Posted: 11 May 2006 04:11 AM   [ Ignore ]  
Moderator
Avatar
RankRankRankRankRankRankRank
Total Posts:  15344
Joined  05-15-2004

As has been noted before, EE’s search becomes case sensitive when it includes high-ascii characters. According to Rick:

MySQL knows how to map high-ascii values so that searches can be case-insensitive.  This isn’t really a limitation of EE, but rather of MySQL’s character support.

... it’s all MySQLs fault. OK, so this is why I am making it a feature request.

Feature Request: find a way to overcome this flaw, and provide truly case insensitive searches for foreign characters also. Perhaps a function could check whether a search string contains high-ascii characters, and either convert them to lowercase, or perhaps perform the search with all variations (ie lower and upper case umlauts), or whatever. I know too little of the internal workings of the search, but this has been bugging me for some time.

 Signature 

Everything will be good in the end. If it’s not good, it’s not the end.

Profile
MSG
 
 
Posted: 11 May 2006 04:23 AM   [ Ignore ]   [ # 1 ]  
Research Assistant
RankRankRank
Total Posts:  414
Joined  09-09-2004

I second that

 Signature 

Web Hosting - CMS - Izrada web stranica - SEO - Marketing Hrvatska

Profile
 
 
Posted: 11 May 2006 06:01 AM   [ Ignore ]   [ # 2 ]  
Research Assistant
RankRankRank
Total Posts:  372
Joined  11-04-2005

Yes, I too very much hope this will be solved some how in EE.

 Signature 

Eskobar | Smidigt | Digga

Profile
 
 
Posted: 09 August 2006 04:39 PM   [ Ignore ]   [ # 3 ]  
Research Scientist
Avatar
RankRankRankRankRankRank
Total Posts:  7534
Joined  08-05-2002

Been doing a bit of research and the solution is far cleaner if this is done on the MySQL server and instead of PHP.  Here is a nice thread asking about it with a nice response.

Still going to look into a PHP/EE solution but I think this is your best bet.

 Signature 
Profile
 
 
Posted: 09 August 2006 04:52 PM   [ Ignore ]   [ # 4 ]  
Research Scientist
Avatar
RankRankRankRankRankRank
Total Posts:  7534
Joined  08-05-2002

Another possibility is that if you are using MySQL 4.1 or above that you can go into your database tables and change your fields to have a collation that is for your particular language.  By default, MySQL uses the collation latin1_swedish_ci.  I switched that collation to latin1_german_ci, and the upper and lower case umlauts were matched at the same time, so success there.

 Signature 
Profile
 
 
Posted: 09 August 2006 11:06 PM   [ Ignore ]   [ # 5 ]  
Moderator
Avatar
RankRankRankRankRankRankRank
Total Posts:  15344
Joined  05-15-2004

Unfortunately not everybody has the possibility to recompile MySQL with custom swiches. But the second suggestion sounds helpful. I have noticed latin1_swedish_ci before, any idea why? I mean, why Swedish?

 Signature 

Everything will be good in the end. If it’s not good, it’s not the end.

Profile
MSG
 
 
Posted: 09 August 2006 11:56 PM   [ Ignore ]   [ # 6 ]  
Research Scientist
Avatar
RankRankRankRankRankRank
Total Posts:  7534
Joined  08-05-2002

Quite a pity, I admit.  Man, if I knew half of the reasons why the MySQL blokes do what they do in new versions I would consider myself an Oracle of MySQL.

 Signature 
Profile
 
 
Posted: 21 October 2008 09:45 AM   [ Ignore ]   [ # 7 ]  
Grad Student
Avatar
Rank
Total Posts:  55
Joined  10-18-2007

two years later, do we have some response from developers?

or we need to change collation? I’m puting that for last of last option.

d

Profile
 
 
   
 
 
Post Marker Legend
New Topic New posts Hot Topic Hot Topic with new posts New Poll New Poll Moved Topic Moved Topic Sticky Topic Sticky topic
Old Topic No new posts Hot Old Topic Hot Topic with no new posts Old Poll Old Poll Closed Topic Closed Topic Announcement Announcements
Theme
Change Theme
Visitor Statistics
The most visitors ever was 1149, on July 16, 2007 09:33 AM
Total Registered Members: 64878 Total Logged-in Users: 70
Total Topics: 81804 Total Anonymous Users: 44
Total Replies: 439751 Total Guests: 308
Total Posts: 521555    
Members ( View Memberlist )
Newest Members:  pticketdxrsmdanbilly8hrkiliwysso50kexpressoKlaasdarrenstylestravelerjcaton