Click here to start

Table of contents

Title Slide

Ad-hoc Networks

Ad-hoc Diagram

Example Route

Breakage

Effect Of Decision

Multiple Routes

Stable Nodes

Finding Stable Routes

Finding Stable Links

Reinforcement Learning Problems

Reinf Diagram

Ad-hoc model 1

Model-free

Model-free 2

Model-based

Use of Model in ad-hoc routing

Link Stability

Time Averaging

Probability Formula

Learned Probabilities

Calculating Optimal Values

Exploitative Policy

Evolution of Exploitative Policy

Ad-hoc as reinf

Information Propagation

Exploration Intro

Boltzmann

Exploration Action 1

Flooding Behaviour 1

Evaluation Scenario

Performance Under Load

Performance under Load 2

Performance Results

Slide 35

Slide 36

Slide 37

Slide 38

Slide 39

Author: