Character encoding - html

While Iam copying text phrase from notepad++ (phrase include spaces, copyright symbol (©), registered symbol (®) etc) to the html, after saving the html page, it is showing weird characters like  instead of space and other also.
On my html page, Iam having charset under meta tag like charset=UTF-8.
Issue is occurring while copying text from notepad++ only.
Please assist me to resolve this problem.

In HTML (as far as I know), you should always use HTML entities for representing characters like © (which is provided as ©). Here is a complete list of HTML Entities

Related

Unicode characters within text document display on browser

I've created a very simple functional web page. I have the file index.html which
has a link. A local link which points to a txt file inside the File manager of my
website.
I understand what the problem is. I just don't know how to fix it.
My text document has Unicode characters such as ± and √ and ² and ³.
These characters display well in the notepad file they were created in.
When the user clicks on the link it opens up this text file, which is not formatted in HTML, therefore, the Unicode characters don't appear on the
browser.
I can either re-type this text document with HTML tags and use the special symbol
numeric codes within it and it will most likely work. And, that is something
I don't want to go through.
Is there any other way to go around this problem. I need the browser to display
these characters within the text document.
Is there a way to tell the browser to convert the text document to HTML on the fly.
thanks
You can use non-ASCII characters just fine. If you save the file as UTF-8, every browser that’s been updated this century will be able to display it. It’s been decades since browsers choked on a byte-order mark, but most people recommend leaving it out.
You can also use non-ASCII characters in HTML saved as UTF-8, literally and without any escape codes. While browsers should be able to detect the character set, best practice is to add either the tag <meta charset="UTF-8"> or <meta http-equiv="Content-Type" content="text/html;charset=UTF-8"> immediately after the <html> tag. This removes all ambiguity.

Can't find the source of the gap at the top of my website. Double Checked all my tags

My html and body have margins and padding of 0. all my top level elements have the same.
I don't want to hack it with positon.. any tips? (ps I hacked the position up 33px. just in the meantime until i could find a solution that's less hacky.)
http://dextressband.com/landingpage.php
Right after your <title> tag, and in a few other places, you have this little problem:
This entity encodes U+FEFF, which is Unicode BOM. The entity is treated as text, and while it's completely invisible, it still reserves vertical space for itself before your div with main site content.
This usually means something is using a wrong encoding (UTF-8 with BOM where UTF-8 without BOM is expected) - since it's PHP, I'd start with locating the place where those sections of the site is rendered. If it's rendering the site from a file, check that the file is saved as UTF-8 without BOM in your favorite text editor.
Your html is invalid. Be sure the html is not producing this kind of "view source" in Firefox or other browsers that color code errors like this.
UPDATE
Okay, this will sound crazy, but you have a non-printable character in your head that is causing output to start. Follow these directions carefully:
Put your cursor to the right of the "link" in your first stylesheet declaration (where i've put the asterisk...like this:)
Now use your backspace (or delete if you are on a Mac) and delete until you remove the HEAD tag so that the following tag is gone too
Now type and hit enter and type
try loading your page again, because the demononic, non-printing character will be gone now and your html again valid.
btw, for fun
here is a picture of your non-printable character in my ViM session
Your html is missing an html element but you have an html 4.01 strict doctype
You have iframes but an html 4.01 strict doctype.

Is there any WYSIWYG html editor that automatically replace special characters with HTML Entities?

I am looking for a WYSIWYG html editor that can automatically replace special characters with HTML Entities such as "&#number" in the source code. The feature has a good demonstration in these two site
https://mothereff.in/html-entities
http://www.htmlescape.net/htmlescape_tool.html
I tried several HTML editors such as "seamonkey composer","wizHTMLeditor"... They are all failed my requiement.
Try http://www.tinymce.com/. It replaces & with &, so I think the other special character to. All you need to get started:
<script src="//tinymce.cachefly.net/4.2/tinymce.min.js"></script>
<script>tinymce.init({selector:'textarea'});</script>
Thats all you need

Why do symbols like apostrophes and hyphens get replaced with black diamonds on my website?

A website I've made has a few problems... On one of the pages, wherever there's an apostrophe (') or a dash (-), the symbol gets replaced with a weird black diamond with a question mark in the center of it
Here's what I mean
It seems this is happening all over the site wherever these symbols appear. I've never seen this before, can anyone explain it to me?
Suggestions on how to fix it would also be greatly appreciated.
See http://test.rfinvestments.co.za/index.php?c=team for a clear look at the problem.
It's an encoding problem. You have to set the correct encoding in the HTML head via meta tag:
<meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1">
Replace "ISO-8859-1" with whatever your encoding is (e.g. 'UTF-8'). You must find out what encoding your HTML files are. If you're on an Unix system, just type file file.html and it should show you the encoding. If this is not possible, you should be able to find out somewhere what encoding your editor produces.
You need to change your text to 'Plain text' before pasting into the HTML document. This looks like an error I've had before by pasting straight from MS word.
MS word and other rich text editors often place hidden or invalid chars into your code. Try using — for your dashes, or ’ for apostrophes (etc), to eliminate the need for relying on your char encoding.
I have the same issue in my asp.net web application. I solved by this link
I just replace ' with ’ text like below and my site in browser show apostrophe without rectangle around as in question ask.
Original text in html page
Click the Edit button to change a field's label, width and type-ahead options
Replace text in html page
Click the Edit button to change a field’s label, width and type-ahead options
Look at your actual html code and check that the weird symbols are not originating there. This issue came up when I started coding in Notepad++ halfway after coding in Notepad. It seems to me that the older version of Notepad I was using may have used different encoding to Notepad's++ UTF-8 encoding. After I transferred my code from Notepad to Notepad++, the apostrophes got replaced with weird symbols, so I simply had to remove the symbols from my Notepad++ code.
If you are editing HTML in Notepad you should use "Save As" and alter the default "Encoding:" selection at the botom of the dialog to UTF-8.
you should also include-
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
This un-ambiguously sets the correct character set and informs the browser.
I experienced the same problem when I copied a text that has an apostrophe from a Word document to my HTML code.
To resolve the issue, all I did was deleted the particular word in my HTML and typed it directly, including the apostrophe. This action nullified the original copy and paste acton and displayed the newly typed apostrophe correctly
What I really don't understand with this kind of problem is that the html page I ran as a local file displayed perfectly in Chromium browser, but as soon as I uploaded it to my website, it produced this error.
Even stranger, it displayed perfectly in the Vivaldi browser whether displayed from the local or remote file.
Is this something to do with the way Chromium reads the character set? But why only with a remote file?
I fixed the problem by retyping the text in a simple text editor and making sure the single quote mark was the one I used.

HTML encoding issues - "Â" character showing up instead of " "

I've got a legacy app just starting to misbehave, for whatever reason I'm not sure. It generates a bunch of HTML that gets turned into PDF reports by ActivePDF.
The process works like this:
Pull an HTML template from a DB with tokens in it to be replaced (e.g. "~CompanyName~", "~CustomerName~", etc.)
Replace the tokens with real data
Tidy the HTML with a simple regex function that property formats HTML tag attribute values (ensures quotation marks, etc, since ActivePDF's rendering engine hates anything but single quotes around attribute values)
Send off the HTML to a web service that creates the PDF.
Somewhere in that mess, the non-breaking spaces from the HTML template (the s) are encoding as ISO-8859-1 so that they show up incorrectly as an "Â" character when viewing the document in a browser (FireFox). ActivePDF pukes on these non-UTF8 characters.
My question: since I don't know where the problem stems from and don't have time to investigate it, is there an easy way to re-encode or find-and-replace the bad characters? I've tried sending it through this little function I threw together, but it turns it all into gobbledegook doesn't change anything.
Private Shared Function ConvertToUTF8(ByVal html As String) As String
Dim isoEncoding As Encoding = Encoding.GetEncoding("iso-8859-1")
Dim source As Byte() = isoEncoding.GetBytes(html)
Return Encoding.UTF8.GetString(Encoding.Convert(isoEncoding, Encoding.UTF8, source))
End Function
Any ideas?
EDIT:
I'm getting by with this for now, though it hardly seems like a good solution:
Private Shared Function ReplaceNonASCIIChars(ByVal html As String) As String
Return Regex.Replace(html, "[^\u0000-\u007F]", " ")
End Function
Somewhere in that mess, the non-breaking spaces from the HTML template (the s) are encoding as ISO-8859-1 so that they show up incorrectly as an "Â" character
That'd be encoding to UTF-8 then, not ISO-8859-1. The non-breaking space character is byte 0xA0 in ISO-8859-1; when encoded to UTF-8 it'd be 0xC2,0xA0, which, if you (incorrectly) view it as ISO-8859-1 comes out as " ". That includes a trailing nbsp which you might not be noticing; if that byte isn't there, then something else has mauled your document and we need to see further up to find out what.
What's the regexp, how does the templating work? There would seem to be a proper HTML parser involved somewhere if your strings are (correctly) being turned into U+00A0 NON-BREAKING SPACE characters. If so, you could just process your template natively in the DOM, and ask it to serialise using the ASCII encoding to keep non-ASCII characters as character references. That would also stop you having to do regex post-processing on the HTML itself, which is always a highly dodgy business.
Well anyway, for now you can add one of the following to your document's <head> and see if that makes it look right in the browser:
for HTML4: <meta http-equiv="Content-Type" content="text/html;charset=utf-8" />
for HTML5: <meta charset="utf-8">
If you've done that, then any remaining problem is ActivePDF's fault.
If any one had the same problem as me and the charset was already correct, simply do this:
Copy all the code inside the .html file.
Open notepad (or any basic text editor) and paste the code.
Go "File -> Save As"
Enter you file name "example.html" (Select "Save as type: All Files (.)")
Select Encoding as UTF-8
Hit Save and you can now delete your old .html file and the encoding should be fixed
Problem:
Even I was facing the problem where we were sending '£' with some string in POST request to CRM System, but when we were doing the GET call from CRM , it was returning '£' with some string content. So what we have analysed is that '£' was getting converted to '£'.
Analysis:
The glitch which we have found after doing research is that in POST call we have set HttpWebRequest ContentType as "text/xml" while in GET Call it was "text/xml; charset:utf-8".
Solution:
So as the part of solution we have included the charset:utf-8 in POST request and it works.
In my case this (a with caret) occurred in code I generated from visual studio using my own tool for generating code. It was easy to solve:
Select single spaces ( ) in the document. You should be able to see lots of single spaces that are looking different from the other single spaces, they are not selected. Select these other single spaces - they are the ones responsible for the unwanted characters in the browser. Go to Find and Replace with single space ( ). Done.
PS: It's easier to see all similar characters when you place the cursor on one or if you select it in VS2017+; I hope other IDEs may have similar features
In my case I was getting latin cross sign instead of nbsp, even that a page was correctly encoded into the UTF-8. Nothing of above helped in resolving the issue and I tried all.
In the end changing font for IE (with browser specific css) helped, I was using Helvetica-Nue as a body font changing to the Arial resolved the issue .
I was having the same sort of problem. Apparently it's simply because PHP doesn't recognise utf-8.
I was tearing my hair out at first when a '£' sign kept showing up as '£', despite it appearing ok in DreamWeaver. Eventually I remembered I had been having problems with links relative to the index file, when the pages, if viewed directly would work with slideshows, but not when used with an include (but that's beside the point. Anyway I wondered if this might be a similar problem, so instead of putting into the page that I was having problems with, I simply put it into the index.php file - problem fixed throughout.
The reason for this is PHP doesn't recognise utf-8.
Here you can check it for all Special Characters in HTML
http://www.degraeve.com/reference/specialcharacters.php
Well I got this Issue too in my few websites and all i need to do is customize the content fetler for HTML entites. before that more i delete them more i got, so just change you html fiter or parsing function for the page and it worked. Its mainly due to HTML editors in most of CMSs. the way they store parse the data caused this issue (In My case). May this would Help in your case too