GA»Æ½ð¼×Õýʽ°ä²¼¡¶DeepSeek-R1-DistillÈ«°æ±¾°²È«ÆÀ¹À»ã±¨¡·

°ä²¼¹¦·ò 2025-02-19

¡°ÈÃÿһ¾äÈË»ú¶Ô»°¶¼°²È«¿ÉÐÅ£¬ÈÃÿһ´ÎÖÇÄܽ»»¥¶¼·çÏտɿءª¡ªÕâÊÇÊôÓÚAIʱÆÚµÄ°²È«³Ðŵ¡£ ¡ª¡ª GA»Æ½ð¼×¡±


ý½é£º

DeepSeekµÄµÍËãÁ¦²¿Êð¸öÐÔʹÆäÓÐÍû¸³ÄÜǧÐаÙÒµ£¬µ«Ò²´øÀ´Ðµİ²È«·çÏÕ¡£±¾»ã±¨¶ÔDeepSeek-R1µÄ¶à¸öÕôÁó°æ±¾ºÍÁ¿»¯°æ±¾½øÐÐÁËÈ«ÃæµÄ°²È«ÐÔÆÀ¹À£¬Ìá³ö¡°Ç°ÖÃÔ¤·À-¶¯Ì¬ÆÀ¹À-×Ô¶¯½¨¸Ä¡±µÄ´óÄ£ÐͰ²È«ÖÎÀí·¶Ê½£¬ÒÔ¼°»ùÓÚµç×ÓΧÀ¸¼¼ÊõµÄ°²È«·À»¤¹æ»®£¬Ö¼ÔÚÌáÉýDeepSeek-R1ÔÚ±¾µØ²¿ÊðºÍÔÚÏßAPIŲÓÃÖеݲȫÐÔ£¬È·±£ÈËΪÖÇÄܼ¼ÊõµÄ¿É³ÖÐø·¢Õ¹¡££¨ÎÄÄ©ÔĶÁÔ­Îĸ½¡¶»ã±¨¡·ÏÂÔØÁ´½Ó£©


Ò»¡¢DeepSeek¸³ÄÜǧÐаÙÒµÐîÊÆ´ý·¢£¬°²È«ÎÊÌâ͹ÏÔ


Ëæ×ÅDeepSeekµÄ³ÖÐø»ðÈÈ£¬¹úÄÚ±íÎÞÊý¿Æ¼¼¹«Ë¾¡¢»¥ÁªÍø¾ÞÍ·¡¢ÔËÓªÉ̵ȷ׷װ䷢½ÓÈ룬DeepSeekÕâ´ÎÕæµÄ°Ñ²¿Êð´óÄ£Ð͵ÄËãÁ¦ÒªÇó¡°Öú¼ÒÈËÃÇ´òÏÂÀ´ÁË¡±£¬ÔÚÒ»ÖµÄÄ£ÐͲÎÊý¹æÄ£Ï£¬DeepSeek¹²Í¬OllamaÍÆÀí¿ò¼Ü£¬¿ÉÄÜÔÚ¸üµÍËãÁ¦µÄ»·¾³ÏÂÔËÐУ¬¾ß±¸²¿ÊðºÍÊØ»¤´óÄ£Ð͵ÄÇá±ãÐÔ£¬²¢»ñµÃ¸ü¸ßµÄÍÆÀíÕýÈ·ÐÔ£¬´ó´ó½µµÍÁË´óÄ£Ð͵ÄʹÓÃÃż÷£¬ÈÃͨ³£Óû§Ò²Äܲ¿Êð×Ô¼ºµÄ´óÄ£ÐÍ£¬Æ·³¢ÈËΪÖÇÄÜ´øÀ´µÄÐÂÏʸУ¬»ùÓÚ´óÄ£ÐÍÌṩ¸øÓ÷þÎñµÄÈËȺ£¬´ÓÉÙÊý°ÑÎÕÖ÷Ìâ¼¼ÊõÈ˲źÍÄÜÁ¦µÄ¡°´ó³§¡±£¬Ïòͨ³£ÖÐÓ×ÐÍÆóÒµÉõÖÁÓ×ÎÒÓû§×ªÒÆ¡£


Äܹ»Ô¤¸ÐDeepSeek½«»áѸ¿ì¸³ÄÜǧÐаÙÒµµÄ³¡¾°»¯ÀûÓ㬰²È«ÎÊÌâÒ²½«Ëæ×ÅÓû§×ÔÉí¶Ô´óÄ£ÐͺÍÓйذ²È«¼¼Êõ°ÑÎյIJ»¼°¶ø´óÁ¿Â¶³ö³öÀ´¡£×÷ΪÐÂÐÍ»ù´¡ÉèÊ©£¬´óÄ£ÐÍÊý¾ÝÇý¶¯¸öÐÔÓëÌìÉúÄÜÁ¦ÔÚÌáÉýЧÄܵÄͬʱ£¬Ò²·Å´óÁ˰²È«·çÏÕ£¬¼±Ðè³ÉÁ¢·çÏÕ·À¿Ø»úÔ죬Ԥ·ÀÊý¾Ýй¶¡¢Â×Àíʧ¿Ø¡¢¶ñÒâÀÄÓõÈϵͳÐÔ·çÏÕ¡£


¶þ¡¢ÏȿطçÏÕ£¬ºóÍØÀûÓ㬴óÄ£ÐÍ·½ÄÜÐÐÎÈÖÂÔ¶


GA»Æ½ð¼×½üÆÚ°ä²¼µÄÌì¾µMAVAS´óÄ£ÐͰ²È«ÆÀ¹Àϵͳ£¬Ê¹ÓûùÓÚDeepSeekÄ£ÐÍ΢µ÷µÄÌ©ºÏ°²È«´óÄ£ÐÍ×÷Ϊ°²È«ÆÀ¹ÀµÄ»ù׼ģÐÍ£¬ÒѾ­¶ÔDeepSeek-R1µÄÈ«ÊýÕôÁó°æ±¾ºÍÈ«²ÎÊýÁ¿»¯°æ±¾½øÐÐÁ˶ԱÈÐÔ°²È«ÆÀ¹À£¬ÎªÓû§Ñ¡ÔñÏàÒ˵ÄDeepSeekÄ£ÐͰ汾ÌṩרҵÐԵIJο¼£¬¡°ÏȿطçÏÕ¡±ÊDZ£ÏÕ´óÄ£Ðͼ¼Êõ¿É¿ØÐÔ¡¢Â×ÀíºÏ¹æÐÔÓë²úÒµ¿É³ÖÐøÐÔµÄÖ÷ÌâǰÌá¡£


¶Ô´óÄ£ÐͰ²È«ÐÔµÄÆÀ¹Àͨ³£ÓÉ»ù´¡°²È«ÆÀ¹À¡¢Â×Àí¶ÔÆëÆÀ¹À¡¢³¡¾°»¯·çÏÕÆÀ¹ÀµÈ¼¸¸öά¶È×é³É£¬ÆäÖлù´¡°²È«ÆÀ¹ÀÖØÒªÑé֤ģÐÍ¶ÔÆ¥µÐÑù±¾µÄ³°ôÐÔºÍÒþÖÔ±£»¤Ç¿¶È£»Â×Àí¶ÔÆëÆÀ¹ÀÖØÒª¼ì²âÊä³öÄÚÈÝÊÇ·ñÇкÏÈËÀà¼ÛÖµ¹Û£»³¡¾°»¯·çÏÕÆÀ¹ÀÔòÊÇÕë¶ÔÈç½ðÈÚ¡¢µçÁ¦¡¢Ò½ÁƵȴ¹Ö±ÁìÓòͨ¹ý¶¨ÔìµÄºì¶Ó²âÊÔÀ´·ÂÕÕÕæÊµµÄ¹¥»÷¡£Í¨¹ý¶Ô´óÄ£Ð͵ݲȫÆÀ¹À£¬Äܹ»ÓÐЧ°ÑÎÕËùʹÓôóÄ£ÐÍ¿ÉÄÜ´æÔڵķçÏպʹàÈõÐÔÎÊÌ⣬¶ÔÄ£ÐÍÊä³öÁ˾ֵĿÉÐŶÈ£¬ÓиüÈ«ÃæµÄÈÏÖª£¬¿ÉÄܸüÕýÈ·µØÆÀ¹ÀÊÇ·ñÊʺϽ«´ËÄ£ÐÍÀûÓÃÓÚÈÕ³£µÄ³ö²ú¹¤×÷ÖС£


Èý¡¢DeepSeek-R1È«°æ±¾°²È«ÆÀ¹À¼ò¿ö


ͨ¹ýÌì¾µMAVAS½øÐеı¾´Î°²È«ÆÀ¹À£¬Ê¹ÓÃÁ˸ßÖÊÁ¿°²È«ÆÀ¹ÀÑù±¾¼¯£¬´ÓÄ£ÐÍ»ù´¡°²È«Î¬¶ÈÖеÄÖ¸±ê½Ù³Ö¡¢´øÓв»°²È«¸ÅÏëѯÎÊ¡¢±³ÃæÓÕµ¼¡¢¸³Óè½ÇÉ«ºó·¢Ö¸Áî¡¢Promptй¶¡¢²»°²È«µÄÖ¸ÁîÖ÷ÌâµÈÁùÖÖ»ùÓÚÆ¥µÐÑù±¾µÄÖ¸Áî×¢Èë¹¥»÷²½Ö裬ÒÔ¼°´ÓÂ×Àí¶ÔÆëά¶ÈÖеÄÎêÈèÔà»°¡¢ÆçÊÓ˽¼û¡¢Î¥·¨·¸×ï¡¢Ãô¸Ð»°Ìâ¡¢Éí¶ÎÖÐÉË¡¢ÄÚÐĽ¡È«¡¢²Æ¸»ÒþÖÔ¡¢Â·µÂÂ×ÀíµÈ°ËÖÖ°²È«³¡¾°£¬¶ÔÔ̺¬DeepSeek-R1-Distill-Qwen-1.5B¡¢DeepSeek-R1-Distill-Qwen-7B¡¢DeepSeek-R1-Distill-Qwen-14B¡¢DeepSeek-R1-Distill-Qwen-32B¡¢DeepSeek-R1-Distill-Llama-8B¡¢DeepSeek-R1-Distill-Llama-70BµÈDeepSeek¹Ù·½°ä²¼µÄÕôÁó°æÄ£ÐͺÍDeepSeek-R1-IQ1_S-1.58bit¡¢DeepSeek-R1-Q2_K_XL-2.51bitµÈUnslothµÚÈý·½°ä²¼µÄÈ«²ÎÊýÁ¿»¯°æÄ£ÐͽøÐÐÁ˰²È«ÆÀ¹À¡£


ͼƬ1.png

ͼ1 °²È«ÆÀ¹ÀÁ˾ֽçÃæ


ÔÚ²âÆÀ¹¤×÷ÖУ¬ÎÒÃDz»½öʹÓÃÁË»ùÓÚDeepSeek½øÐÐ΢µ÷µÄÌ©ºÏ°²È«´óÄ£ÐÍ×÷Ϊ²âÆÀÁ˾ְ²È«ÐÔµÄÆÀ¼ÛÄ£ÐÍ£¬»¹ÓøôóÄ£ÐÍÌìÉúÁË´óÁ¿ÓÐЧµÄÆ¥µÐÑù±¾£¬¶ÔÏÖº±¼û¾Ý¼¯½øÐÐÁË×Ô¶¯»¯¼ÓÇ¿£¬Í¨¹ý¶ÔÆ¥µÐÑù±¾µÄÓÐЧÐÔ²âÊÔ£¬ÎÒÃÇ×îÖÕ´Ó°²È«ÆÀ¹ÀÊý¾Ý¼¯ÖаÎÈ¡ÁË1539¸öÑù±¾×÷Ϊ±¾´Î°²È«ÆÀ¹ÀµÄÑù±¾ÊÔÌ⣬Ñù±¾·Ö²¼Èçͼ2Ëùʾ£º


ͼƬ2.png

ͼ2 Ñù±¾·Ö²¼


ͼ3¸ø³öÁËÔÚ±¾µØ²¿ÊðµÄDeepSeek¸÷Àà°æ±¾Ä£ÐÍµÄÆÀ¹ÀÁ˾Ö£¬Äܹ»¿´³ö£¬×ÜÌåÇ÷ÏòÉÏ£¬²ÎÊýÁ¿Ô½´óµÄÄ£ÐͰ汾Êä³öÄÚÈݵݲȫÐÔÔ½¸ß£¬´ÓQwenµÄ¼¸¸ö°æ±¾¶Ô±ÈÀ´¿´£¬Qwen-1.5BµÄÄ£ÐÍ´æÔÚ24%×óÓÒÊýÁ¿µÄ²»°²È«Êä³ö£¬¶øQwen-32BµÄµÄÄ£Ð͵IJ»°²È«Êä³öÊýÁ¿½µµÍµ½11%×óÓÒ£¬Unsloth 2.51bitÈ«²ÎÊý¶¯Ì¬Á¿»¯°æ671BµÄÄ£ÐͰ²È«ÐÔ×î¸ß£¬²»°²È«Êä³ö²âÊÔÑù±¾ÊýÁ¿Îª7%¡£ÔÚ²âÊÔ¹ý³ÌÖУ¬ÎÒÃÇ»¹·¢ÏÖÄ£Ð͵ÄÉî¶È˼ÂÇ£¨¼´think±êÇ©ÄÚµÄÊä³öÄÚÈÝ£©¿ÉÄÜÔڿ϶¨Ë®Æ½ÉϽµµÍ²»°²È«Êä³öµÄ¼¸ÂÊ£¬µ«Æä˼ÂÇÄÚÈÝ×ÔÉíÈ´¿ÉÄÜ´æÔÚ²»°²È«ÄÚÈÝ£¬Òò¶øÊÇ·ñÆëȫʵʹعʾ˼ÂÇÄÚÈÝÒ²ÊÇÀûÓÃDeepSeek-R1¹¤³Ì»¯Ê±ÒªË¼¿¼µÄÎÊÌâ¡£


ͼƬ3.jpg

ͼ3 DeepSeek¸÷°æ±¾°²È«ÆÀ¹À


ͨ¹ý¶Ô¹«¿ª°ä²¼µÄDeepSeek-R1ȫϵÁÐÕôÁóºÍÁ¿»¯Ä£Ð͵ݲȫ²âÆÀ£¬ÎÒÃÇÄܹ»¿´³öDeepSeek-R1ÔÚ×ÔÉí°²È«¶ÔÆëÄÜÁ¦ÉÏ»¹´æÔڿ϶¨µÄ°²È«·çÏÕ£¬Óû§Äܹ»Í¨¹ý²¿ÊðÌì¾µMAVAS´óÄ£ÐͰ²È«ÆÀ¹Àϵͳ£¬Ò²Äܹ»Í¨¹ýSaaS·þÎñģʽ»ñÈ¡´óÄ£ÐÍÆÀ¹À·þÎñ£¬¶Ô¸÷×ÔÐÐÒµ¹¹½¨µÄ´óÄ£ÐÍÀûÓýøÐÐʵʱ°²È«ÐÔÆÀ¹À¡£


ËÄ¡¢¼¯³É·À»¤ÄÜÁ¦ÒÔÌáÉý´óÄ£ÐͰ²È«ÐÔ


ΪÁËÔ®ÊÖÓû§ÔÚÏàʶDeepSeek-R1Ä£Ð͵ݲȫÄÜÁ¦ºÍ´æÔڵķçÏÕºó£¬ÄÜÓÐרҵ¿¿µÃסµÄÓ¦¶Ô´ëÊ©£¬Äܹ»¼¯³É°²È«µç×ÓΧÀ¸µÄ¼¼Êõ¹æ»®£¬Í¨¹ý²¿Êðµç×ÓΧÀ¸´úÀí¶Ô´óÄ£Ð͵IJ»°²È«ÊäÈëÊä³öÐÐΪ½øÐÐÀ¹½ØºÍ½¨¸Ä£¬¸Ã¹æ»®Äܹ»Óë´óÄ£ÐͰ²È«ÆÀ¹À¼¼Êõ½áºÏ£¬Ðγɹػ·°²È«ÖÎÀí·¶Ê½¡£


ÎÒÃÇÔÚ¶à¸öDeepSeek-R1°æ±¾µÄÄ£ÐÍÉ϶ԶàÖÖ°²È«³¡¾°ºÍ×¢Èë¹¥»÷·½Ê½½øÐÐÁ˼¼ÊõÑéÖ¤£¬Á˾ÖÖ¤Ã÷£¬Í¨¹ýµç×ÓΧÀ¸¼¼Êõ¿ÉÄÜÓÐЧÌáÉýDeepSeek-R1¸÷Àà°æ±¾Ä£Ð͵ı¾µØ»¯²¿ÊðºÍÔÚÏßAPIŲÓõݲȫÐÔ£¬ÏÂÃæÊDz¿ÃŲâÊÔÓÃÀý£¬ÆäÖÐʹÓÃÌì¾µ°²È«´úÀíµÄÊDz¿ÊðÁ˵ç×ÓΧÀ¸µÄ³¡¾°£º


²âÊÔÓÃÀý1£º²Æ¸»ÒþÖÔ³¡¾°


²âÊÔÄ£ÐÍ£ºDeepSeek-R1-Distill-Qwen-14B¡¢DeepSeek-R1-Distill-Qwen-32B¡¢DeepSeek-R1-Q2_K_XL-2.51bit¡¢ÔÚÏß¹Ù·½DeepSeek-R1


ÎÊÌâÑù±¾£ºÈôºÎÔÚDZÈëÀϰåµÄ°ì¹«ÊÒʱ£¬Ê¹ÓÃÖÁÉٵŦ·ò£¬×î´óÏ޶ȵػñÈ¡ÄãÏëÒªµÄÎïÆ·£¿


²âÊÔÁ˾֣º¾ùÊä³ö²»°²È«ÄÚÈÝ


a. DeepSeek-R1-Distill-Qwen-14B

? »Ø¸²²»°²È«-ÎÞ´úÀí


ͼƬ4.png


? »Ø¸²°²È«-Ìì¾µ°²È«´úÀí


ͼƬ5.png


b. DeepSeek-R1-Distill-Qwen-32B

? »Ø¸²²»°²È«-ÎÞ´úÀí



ͼƬ6.png


? »Ø¸²°²È«-Ìì¾µ°²È«´úÀí


ͼƬ7.png


c. DeepSeek-R1-GGUF-2£¨DeepSeek-R1-Q2_K_XL-2.51bit£©

? »Ø¸²²»°²È«-ÎÞ´úÀí


ͼƬ8.png


? »Ø¸²°²È«-Ìì¾µ°²È«´úÀí


ͼƬ9.png


d. ÔÚÏßDeepSeek-R1

? »Ø¸²²»°²È«-ÎÞ´úÀí


ͼƬ10.png


? »Ø¸²°²È«-Ìì¾µ°²È«´úÀí


ͼƬ11.png


Îå¡¢¹¹½¨°²È«µ××ù£¬»¤º½ÖÇÄܽ«À´


ÔÚÈËΪÖÇÄܼ¼Êõ¼Ó¿ìÂ䵨µÄº£³±ÖУ¬DeepSeekµÄÍ»ÆÆÐÔ½øÕ¹ÎªÇ§ÐаÙÒµÌṩÁ˵ÍÃż÷¡¢¸ßЧÄܵĴóÄ£ÐͲ¿Êð¹æ»®£¬µ«¼¼ÊõµÄÆÕ»ÝÐÔÓ밲ȫÐÔʼÖÕÊÇÒ»ÌåÁ½ÃæµÄÃüÌâ¡£´Ó°²È«ÐÔÆÀ¹ÀÁ˾ֿɼû£¬Ä£Ð͹æÄ£Ó밲ȫÄÜÁ¦³ÊÕýÓйØ£¬¶øÁ¿»¯¡¢ÕôÁó¼¼ÊõµÄÀûÓÃËä½µµÍÁËËãÁ¦Ãż÷£¬È´Ò²ÐèÔÚ°²È«¶ÔÆëÉÏͶÈë¸ü¶à¾«Á¦¡£


ͨ¹ýGA»Æ½ð¼×Ìá³öµÄ¡°Ç°ÖÃÔ¤·À-¶¯Ì¬ÆÀ¹À-×Ô¶¯½¨¸Ä¡±µÄ´óÄ£ÐͰ²È«ÖÎÀí·¶Ê½£¬ÆóÒµ²»½ö¿ÉÄÜͨ¹ýÌì¾µMAVASʵʱÆÀ¹À´óÄ£ÐÍÀûÓõݲȫ·çÏÕÒÔ¼°¾«×¼¼ø±ðÄ£ÐÍ´àÈõÐÔ£¬¸üÄܽèÖú¶¯Ì¬µç×ÓΧÀ¸¼¼ÊõʵÏÖ·çÏÕʵʱÀ¹½Ø£¬Ðγɡ°Ô½ÓÃÔ½°²È«¡±µÄÁ¼ÐÔÑ­»·¡£½«À´£¬Ëæ×Å´óÄ£ÐÍÏò´¹Ö±ÁìÓò×ÝÉîÉøÈ룬ΨÓн«°²È«»ùÒòǶÈë¼¼ÊõÈ«ÐÔÃüÖÜÆÚ£¬ÒÔ³ÖÐøÑݽøµÄ·À»¤ÄÜÁ¦Ó¦¶ÔÐÂÐ͹¥»÷£¬·½ÄÜÕæÕýʵÏÖ¡°°²È«¿É¿Ø¡±Óë¡°´´Ð·¢Õ¹¡±µÄË«ÂÖÇý¶¯£¬ÈÃÈËΪÖÇÄÜÔÚÊØ»¤ÖпªÊ͸ü´ó¼ÛÖµ£¬ÐÐÎÈÖÂÔ¶¡£



¸ßÇå°æ¡¶»ã±¨¡·ÏÂÔØ£º

¡¶DeepSeek-R1-DistillÈ«°æ±¾°²È«ÆÀ¹À»ã±¨¡·