Navigation Page
Basic Notes for Coding
Interview Prep
- ML / AI Algorithms from Scratch
- LeetCode Notes
- LeetCode Hot 100
- Interview Experience for RecSys & Ads
Web Development
- Build Lightweight AI SaaS: Next.js + Tailwind CSS
- Build Enterprise-Level AI SaaS: Vue + FastAPI & SQLAlchemy or Django
- Dev Env Config
Search & RecSys & Ads
AI Agent
NLP & LLM
Text Input Preprocessing and Decode
- Tokenizer: BPE, WordPiece, and SentencePiece
- Text Representation: OneHot, BOW, N-grams, TF-IDF, Word2Vec, Glove, FastText, ELMO, BERT, SBERT
- Decode: Greedy Search, Beam Search, Top-K Sampling, Top-P Samping
Model Arcitecture
- RNNs & LSTMs & GRUs
- Transformer
- BERT
- LLAMA 2, Mixtral 8×7B(Mistral MoE)
- Multimodal Large Language Model(MLLM)
- Mamba
Pre-training
Supervised Fine-tuning(SFT)
- Parameter-Efficient Fine-Tuning(PEFT): Prompt-Tuning, P-Tuning, Prefix-Tuning, LoRA, QLoRA, IA3
- Instruction Tuning
Model Preference Alignment
Model Optimization
- Quantization & FLOPs: mixed-precision, fp16, bf16, int8, fp4, nf4
- Pruning
- Distill
- Distributed Training: DeepSpeed ZeRO 1/2/3 + Accelerate, Megatron-LM
- Inference Acceleration: ONNX Runtime, Xinference
Cloud Computing: Linux, Git, Docker and Deployment
Summary
Paper Reading Notes
【推荐】编程新体验,更懂你的AI,立即体验豆包MarsCode编程助手
【推荐】凌霞软件回馈社区,博客园 & 1Panel & Halo 联合会员上线
【推荐】抖音旗下AI助手豆包,你的智能百科全书,全免费不限次数
【推荐】博客园社区专享云产品让利特惠,阿里云新客6.5折上折
【推荐】轻量又高性能的 SSH 工具 IShell:AI 加持,快人一步
· DeepSeek “源神”启动!「GitHub 热点速览」
· 微软正式发布.NET 10 Preview 1:开启下一代开发框架新篇章
· 我与微信审核的“相爱相杀”看个人小程序副业
· C# 集成 DeepSeek 模型实现 AI 私有化(本地部署与 API 调用教程)
· spring官宣接入deepseek,真的太香了~