From RFC 3629 5- and 6-bytes UTF-8 sequences are invalid, so remove t… · python/cpython@222b208 · GitHub

python / cpython Public

• Notifications You must be signed in to change notification settings
• Fork 36.1k
• Star 77.2k

• Code
• Issues 5k+
• Pull requests 2.7k
• Actions
• Projects
• Security and quality
• Insights

Additional navigation options

Commit 222b208

Browse filesBrowse the repository at this point in the historyBrowse files

ezio-melotti

committed

From RFC 3629 5- and 6-bytes UTF-8 sequences are invalid, so remove them from the doc.

1 parent a9353db commit 222b208
Copy full SHA for 222b208

1 file changed

+2-7Lines changed: 2 additions & 7 deletions

File tree

Expand file treeCollapse file tree

Open diff view settings

Filter options

• Doc/library
  • codecs.rst

Expand file treeCollapse file tree

Open diff view settings

Collapse file

‎Doc/library/codecs.rst‎

Copy file name to clipboardExpand all lines: Doc/library/codecs.rst

+2-7Lines changed: 2 additions & 7 deletions

• Display the source diff
• Display the rich diff

Original file line number	Diff line number	Diff line change
@@ -839,7 +839,7 @@ There's another encoding that is able to encoding the full range of Unicode
839	839	characters: UTF-8. UTF-8 is an 8-bit encoding, which means there are no issues
840	840	with byte order in UTF-8. Each byte in a UTF-8 byte sequence consists of two
841	841	parts: Marker bits (the most significant bits) and payload bits. The marker bits
842		- are a sequence of zero to six 1 bits followed by a 0 bit. Unicode characters are
	842	+ are a sequence of zero to four ``1`` bits followed by a ``0`` bit. Unicode characters are
843	843	encoded like this (with x being payload bits, which when concatenated give the
844	844	Unicode character):
845	845
@@ -852,12 +852,7 @@ Unicode character):
852	852	+-----------------------------------+----------------------------------------------+
853	853	| ``U-00000800`` ... ``U-0000FFFF`` | 1110xxxx 10xxxxxx 10xxxxxx |
854	854	+-----------------------------------+----------------------------------------------+
855		- | ``U-00010000`` ... ``U-001FFFFF`` | 11110xxx 10xxxxxx 10xxxxxx 10xxxxxx |
856		- +-----------------------------------+----------------------------------------------+
857		- | ``U-00200000`` ... ``U-03FFFFFF`` | 111110xx 10xxxxxx 10xxxxxx 10xxxxxx 10xxxxxx |
858		- +-----------------------------------+----------------------------------------------+
859		- | ``U-04000000`` ... ``U-7FFFFFFF`` | 1111110x 10xxxxxx 10xxxxxx 10xxxxxx 10xxxxxx |
860		- | | 10xxxxxx |
	855	+ | ``U-00010000`` ... ``U-0010FFFF`` | 11110xxx 10xxxxxx 10xxxxxx 10xxxxxx |
861	856	+-----------------------------------+----------------------------------------------+
862	857
863	858	The least significant bit of the Unicode character is the rightmost x bit.

0 commit comments

Comments

0 (0)