liveBook · Manning

Character encoding

As explained in Julia as a Second Language

Character encoding is a scheme for representing textual characters as numeric code units in storage or transmission.

Character encoding represents textual characters as numeric values for storage or transmission. ASCII assigned one-byte values to Latin letters, but separate alphabets made mixed-language text impractical. section 11.1.1

Unicode assigns each character a code point. UTF-8 stores those code points using a variable number of code units, preserving one-byte ASCII compatibility while saving space for common characters. section 11.1.1

How Julia as a Second Language covers it

How deep it goes
Distinguishes code points from code units, demonstrates Julia operations, and examines part of nextind's string implementation.
Examples
Uses ASCII letters, Æ, an emoji, Unicode literals, and the string “Þrúðvangar” for conversion and iteration.
What it assumes
Builds from ASCII before introducing Unicode code points, UTF-8, and variable-width string storage.
What you can do after
Evaluate character values and diagnose indexing assumptions in UTF-8 strings.
How it connects
Connects ASCII, Unicode, UTF-8, code points, code units, strings, and string indexing.
Cover of Julia as a Second Language
liveBookmanning.com
Read Julia as a Second Language on liveBook Get the book at manning.com

Also explained in

Compare how 4 books explain character encoding →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Julia as a Second Language. The section links point to the parts of the book it draws on.