Character encoding
A character encoding is a scheme that maps characters to numeric values and represents them as code units or bytes for storage or transmission.
The Well-Grounded Rubyist, Fourth Edition
An encoding is a scheme that maps sequences of bytes to textual characters and determines their representation.
- How it is used
- Explains how Ruby strings, source files, and file streams interpret bytes as characters.
- How deep it goes
- Defines byte-to-character mapping and demonstrates source settings, transcoding, forced labels, and stream-level differences without exploring encoding deeply.
- Examples
- Uses Ruby source comments, String#encoding, encode, encode!, force_encoding, getc, and getbyte as concrete examples.
- What you can do after
- Apply Ruby encoding methods to inspect, transcode, relabel, and read strings at character or byte boundaries.
Read how The Well-Grounded Rubyist, Fourth Edition explains character encoding →
JavaScript in Depth
A specification for representing text as bytes or code units according to a defined mapping between characters and numeric values.
- How it is used
- Explains how strings, files, and byte sequences become text through explicit numeric-to-symbol mappings.
- How deep it goes
- Traces encoding from ASCII bytes through ECMAScript string elements and filesystem failures, but does not detail encoding algorithms.
- Examples
- Uses “hello” numeric values, ASCII mappings, surrogate pairs, and a Shift-JIS filename failure to expose representation boundaries.
- What you can do after
- Diagnose encoding mismatches and preserve raw filenames with Node.js Buffer-based filesystem APIs.
Grokking Relational Database Design
A character set is a defined mapping and storage scheme for representing characters and symbols in a database.
- How it is used
- Guides early database design decisions for storing multilingual text accurately and compatibly.
- How deep it goes
- Defines representation and storage rules, compares language support, and explains timing without detailing conversion procedures.
- Examples
- Uses English, Chinese, Latin1, UTF-8, and product attributes such as names, descriptions, and photo URLs.
- What you can do after
- Operate/configure databases by selecting a character set early and matching it to required languages and symbols.
Read how Grokking Relational Database Design explains character encoding →
Clojure: The Essential Reference
A character encoding is a scheme that maps characters to byte sequences and decodes byte sequences into characters.
- How it is used
- Controls how Clojure readers decode files and writers encode output streams.
- How deep it goes
- Defines encoding selection and matching requirements but stops short of byte-level implementation details.
- Examples
- Demonstrates uppercasing dictionary lines while reading and appending UTF-16 output.
- What you can do after
- Operate/configure Clojure file processing with an explicitly selected character encoding.
Read how Clojure: The Essential Reference explains character encoding →
Julia as a Second Language
Character encoding is a scheme for representing textual characters as numeric code units in storage or transmission.
- How it is used
- Explains how Julia represents, inspects, and traverses multilingual text safely.
- How deep it goes
- Distinguishes code points from code units, demonstrates Julia operations, and examines part of nextind's string implementation.
- Examples
- Uses ASCII letters, Æ, an emoji, Unicode literals, and the string “Þrúðvangar” for conversion and iteration.
- What you can do after
- Evaluate character values and diagnose indexing assumptions in UTF-8 strings.
Read how Julia as a Second Language explains character encoding →
Also covered in
- API Design Patterns
- How Computers Make Books
- Transfer Learning for Natural Language Processing
- Build a Website with ChatGPT
- Pro Angular 16
What to know first
- bitA bit is a binary digit and unit of digital information that represents one of two distinguishable values, conventionally 0 or 1.
- stream processingStream processing is the incremental processing of data items as they become available, without requiring the complete dataset to be present first.
- integerAn integer is a whole-number mathematical value, including negative numbers, zero, and positive numbers, with no fractional part.
- bytesBytes are an ordered sequence of byte values, typically eight-bit units, used to represent binary data.
Related concepts
- encoderused by · An encoder is a component or process that transforms input into an encoded or internal representation for subsequent processing, transmission, or decoding.
- ASCIIincludes · ASCII is a 7-bit character-encoding standard that assigns numeric codes to 128 basic Latin characters, symbols, punctuation marks, digits, and control characters.
- UTF-8includes · UTF-8 is a variable-width Unicode encoding that represents each Unicode scalar value as one to four bytes and preserves ASCII byte representations.
- databaseconfigures · A database is an organized persistent data store, typically managed by software, that supports storing, retrieving, and modifying data.
Questions about character encoding
What is character encoding?
A character encoding is a scheme that maps characters to numeric values and represents them as code units or bytes for storage or transmission.
Which Manning books explain character encoding?
The Well-Grounded Rubyist, Fourth Edition, JavaScript in Depth, Grokking Relational Database Design, Clojure: The Essential Reference and Julia as a Second Language.
What should I know before learning character encoding?
Manning books that teach character encoding usually introduce bit, stream processing, integer and bytes first.
What kinds of character encoding are there?
Kinds of character encoding include ASCII and UTF-8.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.




