problem with accents

[gdfhghjdfghgfhf]

i installed a shoutbox on my website... now i am trying to make an "archive" page for the shoutbox

 

my code is really simple:

<?php

include("db.php");

mysql_query("SET CHARACTER SET utf8");

mysql_query("SET NAMES utf8");

 

$query = "SELECT * FROM tbl_qshout ORDER BY chat_id DESC LIMIT 1,100";

 

$res = mysql_query($query) or die(mysql_error()); 

while($row = mysql_fetch_array($res)) {

 

$user=$row["user"];

$message=$row["message"];

$date_post=$row["date_post"];

$url=$row["url"];

echo "<b><a href=\"$url$user\">$user:</a></b> $message ($date_post)<br><br>";

}

?>

 

the problem is that all accents will be messed up (characters like é è â à ç  etc...) in $row["message"]

 

i tryed a lot of things : utf8_decode, utf8_encode, htmlentities, html_entity_decode, etc.... i even tryed to remove the accents with str_replace or preg_replace...

 

usually i can solve my accents problem with one of those function or simply with the utf-8 mysql query

 

but this time i can't find a way to solve my problem 

 

someone please help me !!!

[shadiadiph]

yes you probably need to use a text editor that is 100% utf8 compatible I had the same problem before with asian languages.

 

try using pspad and set the format on the menu to utf 8 before starting to use it.

[gdfhghjdfghgfhf]

i use wordpad, i always used it and never had any problem.

 

I also tryed to include my script directly in my vbulletin forum, so it should be automatically converted to utf-8...

[gdfhghjdfghgfhf]

I just tryed with PSPad and setting the parameters to UTF-8

 

Same problem.

[shadiadiph]

mm sorry not sure then but wordpad does not work with php and utf 8 for some reason upload the file to your server and then open the file in your cpanel and see if the accents are in your code if they are then check to see if the problem is in your database you may have to change the fields to longblob to get it to work

[gdfhghjdfghgfhf]

there is no accents in my script, accents come from the result of the query to database...

 

and i already saved the file to utf-8 with the editor you told me to use

 

it isn't a problem with the table of the database since the shoutbox script can correctly display the content of the message WITH the accents.... i don't understand why it doesn't work with my own script

[shadiadiph]

yes but can your database save the accents in the field correctly if it is set to varchar maybe it will save the accents as $#-! (gibberish) try changing it to blob or longblob from varchar also is the sql insert on the same page as the utf8 page if not the sql insert page needs to be utf8 too

[Mchl]

Is your HTML displayed in utf8 as well (i.e. does browser recognise it automatically as utf8)?

[gdfhghjdfghgfhf]

Is your HTML displayed in utf8 as well (i.e. does browser recognise it automatically as utf8)?

i'm not sure what you mean... how can i know if my html is displayed in utf8 ?

[Mchl]

Do you have a meta tag describing your document as utf8 encoded?

<meta http-equiv="Content-Type" content="text/html; charset=UTF-8"/>

 

?

[gdfhghjdfghgfhf]

Do you have a meta tag describing your document as utf8 encoded?

<meta http-equiv="Content-Type" content="text/html; charset=UTF-8"/>

 

?

yes..

[shadiadiph]

is your database field it is saved to a longblob?

[gdfhghjdfghgfhf]

just tryed to change it to longblob, still the same errors

 

anyway like i said it isnt a problem with the database structure since the shoutbox script using the same messages in the same table of the same database is displaying the accents without any problem

 

in fact, the messages in the database are already filtered with htmlentities and looks like this:

 

ouè man

 

 

[shadiadiph]

what does it actually show when you try to redisplay the accent letters?

[gdfhghjdfghgfhf]

same thing

 

é

 

instead of "é"

[gdfhghjdfghgfhf]

bump

[gdfhghjdfghgfhf]

[shadiadiph]

is it saving to your database in the correct format?

 

You need to fugure out if it is a problem saving it or recalling it

[gdfhghjdfghgfhf]

it is a problem recalling it i'm 100% sure

 

my database is set to utf8 and it is saving correctly, when i check in phpmyadmin the accents are correct

 

and like i said, i am calling the data from the database/table of my shoutbox.... i just want to display the messages sent in the shoutbox on a different page... The shoutbox is already displaying the text from the database with the correct accents.... So if it was a problem with saving the data there would be display errors on the shoutbox too

[gdfhghjdfghgfhf]

bump

 

see here, the accents works:

http://www.pirate-punk.net/shoutbox/

 

but here it doesn't work:

http://www.pirate-punk.net/chat_archive.php

 

and it is the same text...

[gdfhghjdfghgfhf]

bump..

[Mchl]

but here it doesn't work:

http://www.pirate-punk.net/chat_archive.php

 

This page has invalid HTML structure and no character encoding information either in meta tag or in HTTP response.

Here are the HTTP headers for this page:

Date: Sat, 05 Jun 2010 12:35:04 GMT
Server: Apache
X-Powered-By: PHP/5.2.6-1+lenny8
Vary: Accept-Encoding
Content-Encoding: gzip
Content-Length: 4022
Keep-Alive: timeout=5, max=150
Connection: Keep-Alive
Content-Type: text/html

200 OK

 

On the other hand, when your shoutbox retrieves messages from server it gets these headers:

 

Date	Sat, 05 Jun 2010 12:37:55 GMT
Server	Apache
X-Powered-By	PHP/5.2.6-1+lenny8
Expires	Mon, 26 Jul 1997 05:00:00 GMT
Last-Modified	Sat, 05 Jun 2010 12:37:55GMT
Cache-Control	no-cache, must-revalidate
Pragma	no-cache
Vary	Accept-Encoding
Content-Encoding	gzip
Content-Length	2714
Keep-Alive	timeout=5, max=148
Connection	Keep-Alive
Content-Type	text/plain; charset=utf-8

See the very last here?

[gdfhghjdfghgfhf]

oops for some reasons i had removed the meta tags

 

i put it back but i still have the same problem

 

http://www.pirate-punk.net/chat_archive.php

[Mchl]

looking through the source of this page:

hey je prend l pack de bière

 

Something is replacing these characters with html entities. There's no way a browser can display it correctly.

[shadiadiph]

could try using striptags before saving to the database