Introduction to Storchastic

The following pages introduce the essential concepts and API calls to get started with Storchastic.

Introduction to Storchastic:

• What is Storchastic?
  • Stochastic computation graphs
  • Gradient estimation
    • The pathwise derivative
    • The score function
  • Applications
    • Reinforcement Learning
    • Variational Inference
    • Discrete Random Variables
    • Footnotes
    • References
• Sampling, Inference and Variance Reduction
  • Converting generative stories
  • Gradient estimation
  • Computing gradient statistics
  • Reducing variance
  • Using different estimators
• Discrete Gradient Estimation
  • Discrete Variational Auto-Encoder
  • Experimenting with the Discrete VAE
    • Footnotes
    • References