RLEIF
增强大型语言模型的数学推理能力。
WizardMath 由 WizardLM 发布。它基于 GSM8k 数据集进行训练,针对数学问题。它有 7B、13B 和 70B 参数大小可供选择。
下面示例使用的模型是 wizard-math 模型。
ollama serve ollama pull wizard-math ollama run wizard-math --------------- How many 4-digit numbers have the last digit equal to the sum of the first two digits?
Model | Checkpoint | Paper | HumanEval | MBPP | Demo | License |
---|---|---|---|---|---|---|
WizardCoder-Python-34B-V1.0 | HF Link | [WizardCoder] | 73.2 | 61.2 | Demo | Llama2 |
WizardCoder-15B-V1.0 | HF Link | [WizardCoder] | 59.8 | 50.6 | -- | OpenRAIL-M |
WizardCoder-Python-13B-V1.0 | HF Link | [WizardCoder] | 64.0 | 55.6 | -- | Llama2 |
WizardCoder-Python-7B-V1.0 | HF Link | [WizardCoder] | 55.5 | 51.6 | Demo | Llama2 |
WizardCoder-3B-V1.0 | HF Link | [WizardCoder] | 34.8 | 37.4 | -- | OpenRAIL-M |
WizardCoder-1B-V1.0 | HF Link | [WizardCoder] | 23.8 | 28.6 | -- | OpenRAIL-M |
Model | Checkpoint | Paper | GSM8k | MATH | Online Demo | License |
---|---|---|---|---|---|---|
WizardMath-70B-V1.0 | HF Link | [WizardMath] | 81.6 | 22.7 | Demo | Llama 2 |
WizardMath-13B-V1.0 | HF Link | [WizardMath] | 63.9 | 14.0 | Demo | Llama 2 |
WizardMath-7B-V1.0 | HF Link | [WizardMath] | 54.9 | 10.7 | Demo | Llama 2 |
Model | Checkpoint | Paper | MT-Bench | AlpacaEval | GSM8k | HumanEval | License |
---|---|---|---|---|---|---|---|
WizardLM-70B-V1.0 | HF Link | Coming Soon | 7.78 | 92.91% | 77.6% | 50.6 pass@1 | Llama 2 License |
WizardLM-13B-V1.2 | HF Link | 7.06 | 89.17% | 55.3% | 36.6 pass@1 | Llama 2 License | |
WizardLM-13B-V1.1 | HF Link | 6.76 | 86.32% | 25.0 pass@1 | Non-commercial | ||
WizardLM-30B-V1.0 | HF Link | 7.01 | 37.8 pass@1 | Non-commercial | |||
WizardLM-13B-V1.0 | HF Link | 6.35 | 75.31% | 24.0 pass@1 | Non-commercial | ||
WizardLM-7B-V1.0 | HF Link | [WizardLM] | 19.1 pass@1 | Non-commercial |