menu
{ "item_title" : "Abstraction in Reinforcement Learning", "item_author" : [" Sertan Girgin "], "item_description" : "Reinforcement learning is the problem faced by an agent that must learn behavior through trial-and-error interactions with a dynamic environment. Usually, the problem to be solved contains subtasks that repeat at different regions of the state space. Without any guidance an agent has to learn the solutions of all subtask instances independently, which in turn degrades the performance of the learning process. In this work, we propose two novel approaches for building the connections between different regions of the search space. The first approach efficiently discovers abstractions in the form of conditionally terminating sequences and represents these abstractions compactly as a single tree structure; this structure is then used to determine the actions to be executed by the agent. In the second approach, a similarity function between states is defined based on the number of common action sequences; by using this similarity function, updates on the action-value function of a state are reflected to all similar states that allows experience acquired during learning be applied to a broader context. The effectiveness of both approaches is demonstrated empirically over various domains.", "item_img_path" : "https://covers1.booksamillion.com/covers/bam/3/63/913/652/3639136527_b.jpg", "price_data" : { "retail_price" : "52.92", "online_price" : "52.92", "our_price" : "52.92", "club_price" : "52.92", "savings_pct" : "0", "savings_amt" : "0.00", "club_savings_pct" : "0", "club_savings_amt" : "0.00", "discount_pct" : "10", "store_price" : "" } }
Abstraction in Reinforcement Learning|Sertan Girgin

Abstraction in Reinforcement Learning

local_shippingShip to Me
In Stock.
FREE Shipping for Club Members help

Overview

Reinforcement learning is the problem faced by an agent that must learn behavior through trial-and-error interactions with a dynamic environment. Usually, the problem to be solved contains subtasks that repeat at different regions of the state space. Without any guidance an agent has to learn the solutions of all subtask instances independently, which in turn degrades the performance of the learning process. In this work, we propose two novel approaches for building the connections between different regions of the search space. The first approach efficiently discovers abstractions in the form of conditionally terminating sequences and represents these abstractions compactly as a single tree structure; this structure is then used to determine the actions to be executed by the agent. In the second approach, a similarity function between states is defined based on the number of common action sequences; by using this similarity function, updates on the action-value function of a state are reflected to all similar states that allows experience acquired during learning be applied to a broader context. The effectiveness of both approaches is demonstrated empirically over various domains.

This item is Non-Returnable

Details

  • ISBN-13: 9783639136524
  • ISBN-10: 3639136527
  • Publisher: VDM Verlag
  • Publish Date: March 2009
  • Dimensions: 9 x 6 x 0.25 inches
  • Shipping Weight: 0.36 pounds
  • Page Count: 104

Related Categories

You May Also Like...

    1

BAM Customer Reviews