Encoding
Encoding is the transformation of information into a representation defined by a scheme for storage, processing, transmission, or interpretation.
Modern C
- How it is used
- Guides portable C text I/O and string processing when source, execution, and external representations may differ.
- How deep it goes
- Works through character constants, numeric escapes, locale setup, and multibyte-to-wide conversion; stops short of specifying particular external byte encodings.
- Examples
- Uses '\n', hexadecimal escapes, Unicode box-drawing macros, and a separator routine that counts multibyte text through wide-character conversion.
- What you can do after
- Apply it via C literals, <ctype.h>, setlocale, and multibyte conversion functions while avoiding character-to-byte assumptions.
Grokking Algorithms, Second Edition
A character encoding is a system that represents text characters as binary code values.
- How it is used
- Explains how text becomes binary data and why different character sets affect file representation and language coverage.
- How deep it goes
- Defines bits and bytes, walks through ISO-8859-1, and contrasts ASCII, Unicode, and UTF-8 without developing decoding internals.
- Examples
- Uses the letter a, the word “tilt,” file-size output, and binary dumps to make encoding concrete.
- What you can do after
- Evaluate how ASCII, ISO-8859-1, Unicode, and UTF-8 represent characters and affect storage size.
Read how Grokking Algorithms, Second Edition explains encoding →
Deep Learning with PyTorch, Second Edition
A tokenizer function that converts text into numeric token representations.
- How it is used
- Prepares character, word, or token sequences for neural-network input and next-token training.
- How deep it goes
- Works through character and word one-hot tensors, integer sequence shifting, padding, and tokenizer pipelines; defers embeddings to the next treatment.
- Examples
- Uses English characters, an “Impossible, Mr. Bennet” sentence, the name "$ada$", and The Odyssey tokenizer dataset.
- What you can do after
- Builds numeric text inputs, shifted targets, padded batches, and a WordLevel tokenizer with encode and decode functions.
Read how Deep Learning with PyTorch, Second Edition explains encoding →
Modern C, Third Edition
An encoding is a mapping or representation that associates data values with character or textual forms.
- How it is used
- Supports portable C text input, output, character handling, and conversion across differing internal and external representations.
- How deep it goes
- Explains platform conversion, escape syntax, locale-sensitive classification, and character-to-number logic, but not a complete encoding specification.
- Examples
- Uses '\n', hexadecimal escapes, <ctype.h> classifiers, and a hexatridecimal character-to-number conversion.
- What you can do after
- Apply it via C text and character interfaces to write portable handling for newlines, character classes, escapes, and numeric representations.
The Quick Python Book, Fourth Edition
encode is a string method that converts text into a bytes object using a character encoding.
- How it is used
- Converts Unicode strings to bytes for binary data, international text, and data exchanged through files or internet formats.
- How deep it goes
- Explains string-to-bytes conversion, reverse decoding, type incompatibility, and ASCII-versus-UTF-8 pitfalls without detailing codec internals.
- Examples
- Uses an accented character, displayed encoded bytes, failed mixed-type concatenation, and text-file decoding errors.
- What you can do after
- Apply it via string and bytes methods to convert text, reverse the conversion, and recognize incompatible types or encoding errors.
Read how The Quick Python Book, Fourth Edition explains encoding →
Grokking AI Algorithms, Second Edition
Text encoding is the conversion of written language into numerical representations that a computer model can process.
- How it is used
- Prepares text for mathematical processing in language-model training and represents candidate solutions within genetic algorithms.
- How deep it goes
- Explains vocabularies, token IDs, and workflow placement, but stops short of tokenization mechanics or encoding mathematics.
- Examples
- Uses books, papers, forums, code, token vocabularies, numerical IDs, and Knapsack-problem chromosomes as examples.
- What you can do after
- Understand how text becomes model input and why representation choices influence algorithmic performance.
Read how Grokking AI Algorithms, Second Edition explains encoding →
Go in Practice, Second Edition
- How it is used
- Handles data translation when systems exchange differently formatted or encoded information.
- How deep it goes
- Names UTF-8, Base64, JSON, and XML cases and points to packages and interfaces without demonstrating implementation.
- Examples
- Uses Base64 data and JSON or XML translated into local objects or structs as examples.
- What you can do after
- Understand how Go packages and interfaces can translate JSON into structs, switch encodings, or add external support.
PostgreSQL Mistakes and How to Avoid Them
A character encoding maps textual characters to coded representations such as bytes for storage and processing.
- How it is used
- Diagnoses character-data failures during MySQL or MariaDB migrations into PostgreSQL.
- How deep it goes
- Explains byte-level failures, legacy MySQL encodings, conversion, null-byte cleanup, and locale configuration.
- Examples
- Uses international names, the character é, invalid UTF8 errors, iconv conversion, and null-byte removal commands.
- What you can do after
- Diagnose import failures, convert latin1 dumps to UTF-8, remove null bytes, and verify PostgreSQL encoding settings.
Read how PostgreSQL Mistakes and How to Avoid Them explains encoding →
Rust in Action: Systems programming concepts and techniques
An encoding is a representation that maps information such as instructions or data to a defined sequence of symbols or bits.
- How it is used
- Explains how types, files, and CPU instructions assign meaning to shared sequences of bits.
- How deep it goes
- Demonstrates bit reinterpretation in Rust and extends the idea to a hexadecimal CHIP-8 CPU implementation.
- Examples
- Uses signed and unsigned integers, float-to-integer reinterpretation, and a hexadecimal CHIP-8 implementation.
- What you can do after
- Evaluate how types and instructions interpret bit patterns, and understand the foundations of a software CPU emulator.
Read how Rust in Action: Systems programming concepts and techniques explains encoding →
Related concepts
- UTF-8includes · UTF-8 is a variable-width Unicode encoding that represents each Unicode scalar value using one to four bytes and preserves ASCII byte representations.
- latent spaceproduces · A latent space is a learned representational space in which numerical coordinates encode information or features inferred from observed data.
- PasswordEncoderpart of · PasswordEncoder is a Spring Security interface and strategy for encoding passwords and verifying supplied passwords against stored encoded representations.
- stringused by · A string is a programming-language value representing an ordered sequence of characters or character units as text.
- security through obscurityused by · Security through obscurity is a security approach that relies on concealing system designs, implementations, or configurations to impede attacks.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.