adam
Structs
Struct: Adam
Fields
-
params
:List[Array]
-
lr
:SIMD[float32, 1]
-
beta1
:SIMD[float32, 1]
-
beta2
:SIMD[float32, 1]
-
eps
:SIMD[float32, 1]
-
t
:SIMD[float32, 1]
-
m
:List[Array]
-
v
:List[Array]
Methods
__init__(out self, params: List[Array], lr: SIMD[float32, 1] = SIMD(#kgen.float_literal<1|1000>), beta1: SIMD[float32, 1] = SIMD(#kgen.float_literal<9|10>), beta2: SIMD[float32, 1] = SIMD(#kgen.float_literal<999|1000>), eps: SIMD[float32, 1] = SIMD(#kgen.float_literal<1|100000000>))
more details
Args
-
self
:Self
-
params
:List[Array]
-
lr
:SIMD[float32, 1]
(default:SIMD(#kgen.float_literal<1|1000>)
) -
beta1
:SIMD[float32, 1]
(default:SIMD(#kgen.float_literal<9|10>)
) -
beta2
:SIMD[float32, 1]
(default:SIMD(#kgen.float_literal<999|1000>)
) -
eps
:SIMD[float32, 1]
(default:SIMD(#kgen.float_literal<1|100000000>)
)
step(mut self)
Functions
Last updated on