Gradient Descent Visualizer
Starting Position
X:
Y:
Random Start
Pick Point
Animation
Iteration
0
/
0
Speed
1.0
Display Options
Show Trajectory Trails
Optimizers
Batch GD
▶
Learning Rate:
i
0.01
Run Until Convergence
Iterations:
i
100
Max Iterations:
i
10000
Convergence Threshold:
i
1e-4
Momentum GD
▶
Learning Rate:
i
0.01
Momentum:
i
0.9
LR Decay:
i
0.995
Run Until Convergence
Iterations:
i
100
Max Iterations:
i
10000
Convergence Threshold:
i
1e-4
ADAM
▶
Learning Rate:
i
0.01
Beta1:
i
0.900
Beta2:
i
0.9990
Epsilon:
i
1e-8
Run Until Convergence
Iterations:
i
100
Max Iterations:
i
10000
Convergence Threshold:
i
1e-4
SGD (Stochastic)
▶
Learning Rate:
i
0.01
Run Until Convergence
Iterations:
i
100
Max Iterations:
i
10000
Convergence Threshold:
i
1e-4
Ballistic GD
▶
Drop Height:
i
5.0
Gravity:
i
1.0
Elasticity:
i
0.80
Bounce Threshold:
i
0.050
Ball Radius:
i
0.05
Max Iterations:
i
10000
Ballistic Adam
▶
Learning Rate:
i
0.010
Momentum:
i
0.90
Gravity:
i
0.0010
Time Step (dt):
i
1.0
Max Air Steps:
i
20
Max Bisection Iterations:
i
10
Collision Tolerance:
i
1e-3
Run Until Convergence
Iterations:
i
100
Max Iterations:
i
10000
Convergence Threshold:
i
1e-4
Loading landscape...
Manifold:
Loading...
▼
Parameters
▼
Two-Circle Clustering
Two clusters - which one will it find?