liveBook · Manning

Trajectory-based search

As explained in Optimization Algorithms: AI techniques for design, planning, and control problems

An optimization algorithm that generates a sequence of successive candidate states or solutions during its search.

Trajectory-based search explores an optimization problem by moving from one candidate solution to the next. Those successive moves trace a path through the search space. In a trajectory-based metaheuristic, one search agent follows that path; a population-based method instead searches with multiple agents. The single-agent approach tends to emphasize exploitation of the area it is already exploring. section 5.1 section 7.1

Why move away from a good solution?

Imagine reaching a low valley but suspecting that a lower one lies beyond the hills. Staying put protects the solution you have; climbing temporarily makes another valley reachable. Simulated annealing uses this intuition: in a minimization problem, it accepts improving moves and can sometimes accept a move that worsens the objective. section 5.1

Two trajectory-based techniques make different choices about subsequent moves:

  • Simulated annealing uses temperature to control its willingness to accept non-improving moves. Higher temperature favors exploration; gradual cooling shifts the search toward exploitation. At very low temperature, its behavior approaches hill climbing. section 5.7
  • Tabu search combines local search with memory of recently explored solutions. Avoiding a quick return to those solutions helps keep the search from getting stuck in a local optimum. section 6.0

The choice is practical rather than a guarantee of success. Simulated annealing can seek an optimal or near-optimal solution when derivatives are unavailable, unreliable, or too costly, but it does not guarantee feasibility or a particular degree of optimality. Trajectory-based techniques are applied to continuous and discrete problems, including function optimization, Sudoku, traveling-salesperson problems, delivery routing, and assembly-line balancing. section 5.7 section 5.0 section 6.0

How Optimization Algorithms: AI techniques for design, planning, and control problems covers it

How deep it goes
Defines the search pattern and explains simulated annealing’s acceptance and cooling behavior, without specifying a universal move rule for every technique.
Examples
Illustrates the search with a lower valley beyond hills and applications including Sudoku, traveling-salesperson problems, and delivery routing.
What it assumes
Introduces the single-agent distinction directly while relying on basic notions of candidate solutions, an objective function, and a search space.
What you can do after
Evaluate/understand when a single-agent search may trade immediate improvement for exploration, while recognizing that feasibility and optimality are not guaranteed.
How it connects
Connects simulated annealing and tabu search to local search, hill climbing, and population-based metaheuristics.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Optimization Algorithms: AI techniques for design, planning, and control problems. The section links point to the parts of the book it draws on.