Word filter: not distinguishing "c" from "ç"

[Gabriel Torres]

Hi,

We have the word "configuracoes" configured in our word filter to replace it with its correct form: "configurações".

Now we are trying to add the word "configuraçoes", however, the system doesn't allow it, saying "there is an existing filter for this word".

So, the system doesn't differentiate "c" from "ç", which are different letters.

Please advise.

Gabe.

[Jim M]

Please be advised I have marked this to a developer to comment on what is happening here.

[Andy Millne]

Are these different letters or the same letter with a different case? It sounds like this may be a MySQL case sensitivity issue. If you keep just the single entry do both variants match when you try to add a post with the word? 

[Gabriel Torres]

On 9/6/2022 at 7:56 AM, Andy Millne said:

Are these different letters or the same letter with a different case?

Technically different letters, but I don't know how they are treated in PHP/MySQL, is as different letters or the same letter with a different accent, similarly to what happens with a/ã/á/à, for example.

On 9/6/2022 at 7:56 AM, Andy Millne said:

It sounds like this may be a MySQL case sensitivity issue.

I wouldn't know.

On 9/6/2022 at 7:56 AM, Andy Millne said:

If you keep just the single entry do both variants match when you try to add a post with the word? 

No, they don't match. Hence the issue and the need to add a new entry in the word filters for that variant.

Cheers.

[Matt]

It looks like MySQL is treating it as the same word which is interesting.

Run the following query, and check to see if the Collation is 'utf8mb4_unicode_ci'

show table status where Name='core_profanity_filters'

You may need to add your table prefix in the name of the table inside the quotes.

 

[Gabriel Torres]

23 hours ago, Matt said:

Run the following query, and check to see if the Collation is 'utf8mb4_unicode_ci'

Yes, it is:

+------------------------+--------+---------+------------+------+----------------+-------------+-----------------+--------------+-----------+----------------+---------------------+-------------+------------+--------------------+----------+--------------------+---------+
| Name                   | Engine | Version | Row_format | Rows | Avg_row_length | Data_length | Max_data_length | Index_length | Data_free | Auto_increment | Create_time         | Update_time | Check_time | Collation          | Checksum | Create_options     | Comment |
+------------------------+--------+---------+------------+------+----------------+-------------+-----------------+--------------+-----------+----------------+---------------------+-------------+------------+--------------------+----------+--------------------+---------+
| core_profanity_filters | InnoDB |      10 | Dynamic    | 2095 |             62 |      131072 |               0 |        49152 |         0 |           9604 | 2022-08-19 13:21:53 | NULL        | NULL       | utf8mb4_unicode_ci |     NULL | row_format=DYNAMIC |         |
+------------------------+--------+---------+------------+------+----------------+-------------+-----------------+--------------+-----------+----------------+---------------------+-------------+------------+--------------------+----------+--------------------+---------+