Skip to content

'gradient of' and 'gradient with respect to' are used interchangeably #226

@ShoufaChen

Description

@ShoufaChen

Thank you very much for the cs231n, which helps me a lot in understanding deep learning.

One thing I'm confused about is that can 'gradient of' and 'gradient with respect to' be used Interchangeably?

in the https://cs231n.github.io/optimization-2/
First,

That is, for example instead of dfdq we would simply write dq, and always assume that the gradient is with respect to the final output

I think here the gradient is of the final output may be right.

Second,

Every gate in a circuit diagram gets some inputs and can right away compute two things: 1. its output value and 2. the local gradient of its inputs with respect to its output value

2. the local gradient of its output value with respect to its inputs

Did I miss something?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions