Skip to Content

adam

View the code on GitHub

Structs

Struct: Adam

Fields

  • params: List[Array]

  • lr: SIMD[float32, 1]

  • beta1: SIMD[float32, 1]

  • beta2: SIMD[float32, 1]

  • eps: SIMD[float32, 1]

  • t: SIMD[float32, 1]

  • m: List[Array]

  • v: List[Array]

Methods

__init__(out self, params: List[Array], lr: SIMD[float32, 1] = SIMD(#kgen.float_literal<1|1000>), beta1: SIMD[float32, 1] = SIMD(#kgen.float_literal<9|10>), beta2: SIMD[float32, 1] = SIMD(#kgen.float_literal<999|1000>), eps: SIMD[float32, 1] = SIMD(#kgen.float_literal<1|100000000>))
more details
Args
  • self: Self

  • params: List[Array]

  • lr: SIMD[float32, 1] (default: SIMD(#kgen.float_literal<1|1000>))

  • beta1: SIMD[float32, 1] (default: SIMD(#kgen.float_literal<9|10>))

  • beta2: SIMD[float32, 1] (default: SIMD(#kgen.float_literal<999|1000>))

  • eps: SIMD[float32, 1] (default: SIMD(#kgen.float_literal<1|100000000>))

step(mut self)
more details
Args
  • self: Self

Functions

Last updated on