Prompts · TeX · v0.1.0
Expert guidance for GRPO/RL fine-tuning with TRL for reasoning and task-specific model training
#ai#ai-research#claude
/Catalogue/Prompt/Orchestra-Research/orchestra-research-ai-research-skills-llama-factory
Origin: githubExpert guidance for fine-tuning LLMs with LLaMA-Factory - WebUI no-code, 100+ models, 2/3/4/5/6/8-bit QLoRA, multimodal support
by Orchestra-Research · updated 3mo ago · imported from GitHub
Comprehensive assistance with llama-factory development, generated from official documentation.
This skill should be triggered when:
Quick reference patterns will be added as you use the skill.
This skill includes comprehensive documentation in references/:
Use view to read specific reference files when detailed information is needed.
Start with the getting_started or tutorials reference files for foundational concepts.
Use the appropriate category reference file (api, guides, etc.) for detailed information.
The quick reference section above contains common patterns extracted from the official docs.
Organized documentation extracted from official sources. These files contain:
Add helper scripts here for common automation tasks.
Add templates, boilerplate, or example projects here.
To refresh this skill with updated documentation:
No comments yet — start the thread.
Sign in to join the discussion.
Prompts · TeX · v0.1.0
Expert guidance for GRPO/RL fine-tuning with TRL for reasoning and task-specific model training
#ai#ai-research#claude
Prompts · TeX · v0.1.0
Provides guidance for training and analyzing Sparse Autoencoders (SAEs) using SAELens to decompose neural network activations into interpretable features. Use when discovering interpretable features, analyzing superposition, or studying monosemantic representations in language models.
#ai#ai-research#claude
Prompts · TeX · v0.1.0
RNN+Transformer hybrid with O(n) inference. Linear time, infinite context, no KV cache. Train like GPT (parallel), infer like RNN (sequential). Linux Foundation AI project. Production at Windows, Office, NeMo. RWKV-7 (March 2025). Models up to 14B parameters.
#ai#ai-research#claude
Prompts · TeX · v0.1.0
Provides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP). Use when pretraining Llama 3.1, DeepSeek V3, or custom models at scale from 8 to 512+ GPUs with Float8, torch.compile, and distributed checkpointing.
#ai#ai-research#claude