Wiki/Machine Learning/Reinforcement Learning/Policy GradientsPolicy GradientsChapter·Draft·Updated Aug 9, 2026This chapter is currently a scaffold.PreviousQ-LearningNextActor-Critic MethodsAll chaptersMathematicsFoundationsProofs and LogicDiscrete StructuresCombinatoricsGraph TheoryLinear AlgebraLinear Algebra — Vectors and MatricesLinear Algebra — Vector SpacesLinear Algebra — Eigenvalues and DecompositionsCalculusCalculus — DifferentiationCalculus — Multivariable CalculusProbabilityProbability — FoundationsProbability — Random Variables and DistributionsProbability — Expectation and ConcentrationStatisticsStatistics — EstimationStatistics — Inference and Experimental DesignOptimizationOptimization — FundamentalsOptimization — Convex OptimizationOptimization — Numerical MethodsInformation and ComputationInformation TheoryNumerical ComputationNumerical Linear AlgebraComputer ScienceAlgorithms and Data StructuresData StructuresAlgorithm AnalysisSearching and SortingHashingTrees and HeapsGraph AlgorithmsGreedy AlgorithmsDynamic ProgrammingRandomized AlgorithmsAmortized AnalysisTheory of ComputationFormal Languages and AutomataComputabilityComplexity TheorySystemsComputer ArchitectureData Representation and Machine InstructionsAssembly and the Machine BoundaryProcessor MicroarchitecturePipelines and Branch PredictionCaches and Memory HierarchyOperating SystemsProcesses and ThreadsOperating-System SchedulingVirtual MemoryFilesystems and StorageConcurrencyConcurrency FundamentalsSynchronizationAtomics and Memory OrderingLock-Free AlgorithmsNetworkingNetworking FoundationsInternet Protocol and RoutingTransport ProtocolsDNS, HTTP and TLSDatabasessql normalizationDatabase Storage EnginesDatabase IndexesTransactions and IsolationQuery Planning and OptimizationDistributed SystemsDistributed-Systems FoundationsReplication and ConsistencyConsensusDistributed TransactionsDistributed StorageCompilersCompiler Front EndsIntermediate RepresentationsCompiler OptimizationCode Generation and Runtime SystemsPerformance EngineeringPerformance MeasurementProfiling and ObservabilityMachine LearningClassical Machine LearningLearning FoundationsLinear RegressionLogistic RegressionTrees and EnsemblesKernel Methods and Support-Vector MachinesClusteringPrincipal Component AnalysisGeneralization and Model SelectionProbabilistic Machine LearningNeural NetworksNeural-Network FoundationsBackpropagationAutomatic DifferentiationDeep-Learning OptimizationConvolutional Neural NetworksSequence ModelsTransformers and Language ModelsAttentionTransformersTokenizationLanguage ModelingLanguage-Model Training and AdaptationGenerative ModelingReinforcement LearningReinforcement-Learning FoundationsMarkov Decision ProcessesValue Functions and Bellman EquationsTemporal-Difference LearningQ-LearningPolicy GradientsActor-Critic MethodsModel-Based Reinforcement LearningExplorationOffline Reinforcement LearningImitation LearningML SystemsGPU ComputingGPU ArchitectureGPU Execution and MemoryCUDA ProgrammingGPU Kernel OptimizationRuntimes and FrameworksTensor RuntimesAutomatic-Differentiation SystemsML CompilersML Compiler FoundationsGraph Optimization and Kernel FusionTraining at ScaleDistributed TrainingTraining ParallelismInferenceModel ServingInference RuntimesBatching and SchedulingAttention CachingEfficiencyQuantizationPruning and SparsityKnowledge DistillationSmall Language ModelsEdge Machine LearningHardware-Aware OptimizationAlgorithm-Hardware Co-Design3D & AnimationFundamentalsForm and SilhouetteTopology and Edge FlowScale and ProportionModelingHard-Surface ModelingSubdivision ModelingKitbashingBooleans and CleanupSculptingPrimary Secondary and Tertiary FormsAnatomy for SculptingRetopologyTexturingUV LayoutPBR MaterialsBakingProcedural TexturingLightingThree-Point LightingHDRI and Image-Based LightingVolumetricsColor and ExposureRenderingCycles and EEVEESampling and DenoisingRender PassesCompositingAnimationThe Twelve PrinciplesRigging and Weight PaintingConstraints and DriversCamera AnimationGame ArtPolygon BudgetsLevels of DetailBaking to Real-TimeEngine Import PipelinesDigital & IllustrationFundamentalsPerspectiveValue and LightColor TheoryCompositionDrawingGestureFigure and AnatomyConstructive DrawingLine EconomyDigital PaintingBrush EconomyRendering MaterialsEdge ControlDesignCharacter DesignEnvironment DesignProp and Shape LanguageVisual DevelopmentThumbnails and IterationStyle DevelopmentStoryboardingPractice & FundamentalsProcessStudies and Master CopiesReference DisciplineCritique and RevisionCareerPortfolio CurationClient Work and BriefsPricing and Contracts