Skip to content

Curious Actor Optimizer using Actor model parameters #4

@igoldov

Description

@igoldov

if args.algo=="p2e":

Hello, I was wondering, when using p2e algorithm, why do we pass actor_model parameters into curious_actor_optimizer? Same happens with value_model_optimizer and value_model.

In the way I see it, this is bug because curious_actor_model doesn't learn anything while exploring environment with p2e and the way to fix it is to pass curious_actor_model parameters and curious_value_model parameters into curious_actor_optimizer and value_model_optimizer respectively.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions