通俗理解文本生成的常用解码策略

目录：

  1. 背景简介
  2. 解决的问题
  3. 解码策略
  • Standard Greedy Search
  • Beam Search
  • Sampling
  • Top-k Sampling
  • Sampling with Temperature
  • Top-p (Nucleus) Sampling
  1. 代码快览
  2. 总结

This post covers:

  1. Background
  2. Problem
  3. Decoding Strategies
  • Standard Greedy Search
  • Beam Search
  • Sampling
  • Top-k Sampling
  • Sampling with Temperature
  • Top-p (Nucleus) Sampling
  1. Code Tips
  2. Summary

完整内容见微信公众号文章：https://mp.weixin.qq.com/s/sVZuEkYXQ9ZZYXJCQz7F4A

posted @ 2023-03-11 22:38  createMoMo  阅读(39)  评论(0)  编辑  收藏  举报