{"id":9897,"date":"2025-05-02T15:11:30","date_gmt":"2025-05-02T07:11:30","guid":{"rendered":"https:\/\/ai-stack.ai\/?p=9897"},"modified":"2025-05-06T15:57:31","modified_gmt":"2025-05-06T07:57:31","slug":"blackwell-vs-mi300x","status":"publish","type":"post","link":"https:\/\/ai-stack.orca-biz.tw\/zh-hant\/blackwell-vs-mi300x","title":{"rendered":"MI300X vs Blackwell\uff1a\u8ab0\u624d\u662f 2025\u201126 \u5e74\u300cLLM \u5361\u738b\u300d"},"content":{"rendered":"\n<p><strong>\u4e00\u53e5\u8a71\u6458\u8981\uff1a<\/strong> \u60f3\u6975\u901f\u8207\u6700\u9577\u4e0a\u4e0b\u6587\uff0c\u7528\u202fNVIDIA\u202fBlackwell\uff1b\u8981\u4f4e\u74e6\u9ad8\u5bb9\u91cf\u8207\u9ad8\u202fCP\u202f\u503c\uff0c\u9078\u202fAMD\u202fMI300X\u2014\u2014\u771f\u6b63\u7684\u52dd\u8ca0\u53d6\u6c7a\u65bc\u4f60\u7684 <strong>KPI<\/strong> \u8207\u8377\u5305\u3002<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>1. \u524d\u8a00\uff1a\u70ba\u4f55 2025 \u5e74\u6210\u4e86\u300c\u96d9\u96c4\u6c7a\u6230\u5e74\u300d\uff1f<\/strong><\/h2>\n\n\n\n<p>\u5728 Hopper\u202fH100 \u7a31\u9738\u5169\u5e74\u5f8c\uff0c\u751f\u6210\u5f0f\u202fAI \u7684\u7b97\u529b\u9700\u6c42\u4f9d\u820a\u760b\u72c2\u66b4\u6f32\uff1a<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u4e0a\u4e0b\u6587\u9577\u5ea6\u5f9e 32\u202fK \u8e8d\u5347\u81f3 <strong>1\u202fM token<\/strong>\uff0c\u5f15\u7206\u8a18\u61b6\u9ad4\u98e2\u6e34\u3002<a href=\"https:\/\/developer.nvidia.com\/blog\/nvidia-blackwell-delivers-massive-performance-leaps-in-mlperf-inference-v5-0\/?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noopener\">NVIDIA Developer<br><\/a><\/li>\n\n\n\n<li>\u958b\u6e90\u6a21\u578b\u4e0b\u8f09\u5df2\u7834 <strong>12\u202f\u5104<\/strong>\uff1b\u4f01\u696d\u6108\u4f86\u6108\u60f3\u628a LLM \u79c1\u6709\u5316\uff0c\u964d\u4f4e API \u6210\u672c\u8207\u6cd5\u898f\u98a8\u96aa\u3002<br><\/li>\n<\/ul>\n\n\n\n<p>\u786c\u9ad4\u5546\u56e0\u800c\u8d70\u51fa\u5169\u689d\u76f8\u53cd\u537b\u4e92\u88dc\u7684\u8def\u7dda\u2014\u2014<strong>\u6975\u81f4\u7b97\u529b vs. \u8d85\u5927\u5bb9\u91cf<\/strong>\u2014\u2014\u6700\u5177\u4ee3\u8868\u6027\u7684\uff0c\u5c31\u662f <strong>NVIDIA\u202fBlackwell\u202fB200<\/strong> \u8207 <strong>AMD\u202fInstinct\u202fMI300X<\/strong>\u3002<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>2. \u5169\u5927\u67b6\u69cb\uff1a\u540c\u662f 192\u202fGB HBM\uff0c\u9748\u9b42\u537b\u8fe5\u7570<\/strong><\/h2>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh7-rt.googleusercontent.com\/docsz\/AD_4nXdoBqKFSsEmjzgh09YfaQa_BgCOUInw0Eh3kOOEZNWx2AWi7L7NCC30XQOZ3iLHrsAshpMZ-k3SwuVf2o9MOFP2dfzPDhLZewmlfz6GXf0k8vcMapezfbYxx8VXhXZriQr9ZDaz-w?key=n7rC6w9f6h9HnS6ed0XuXcsh\" alt=\"\"\/><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>2\u20111. Blackwell\uff1a\u628a\u300c\u4e00\u5ea7\u8d85\u7b97\u300d\u7e2e\u9032\u4e00\u5f35\u5361<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u88fd\u7a0b<\/strong>\uff1aTSMC\u202f4N\uff0c\u96d9\u202fdie CoWoS\uff1b\u5171 <strong>208\u202fB<\/strong> \u96fb\u6676\u9ad4\u3002<br><\/li>\n\n\n\n<li><strong>\u5cf0\u503c\u7b97\u529b<\/strong>\uff1aFP4 \u6a21\u5f0f <strong>40\u202fPFLOPS<\/strong>\uff0cFP8\u202f20\u202fPFLOPS\uff0cFP16\u202f10\u202fPFLOPS\u3002<a href=\"https:\/\/www.anandtech.com\/show\/21310\/nvidia-blackwell-architecture-and-b200b100-accelerators-announced-going-bigger-with-smaller-data?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noopener\">AnandTech<br><\/a><\/li>\n\n\n\n<li><strong>\u8a18\u61b6\u9ad4<\/strong>\uff1a\u6700\u65b0 <strong>HBM3E 192\u202fGB<\/strong>\uff0c\u983b\u5bec\u9ad8\u9054 <strong>8\u202fTB\/s<\/strong>\u3002<br><\/li>\n\n\n\n<li><strong>\u4e92\u806f<\/strong>\uff1a\u6bcf\u5361\u639b 18\u202fG\u202fBps NVLink\u20115\uff1bNVL72 \u6a5f\u6ac3\u628a <strong>72\u202f\u9846<\/strong> GPU \u4e32\u6210\u300c\u4e00\u5f35\u8d85\u7d1a GPU\u300d\u3002<a href=\"https:\/\/developer.nvidia.com\/blog\/nvidia-blackwell-delivers-massive-performance-leaps-in-mlperf-inference-v5-0\/?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noopener\">NVIDIA Developer<br><\/a><\/li>\n\n\n\n<li><strong>\u529f\u8017<\/strong>\uff1a\u55ae\u5361\u7d04 <strong>1\u202fkW<\/strong>\uff0c8\u202f\u5361 DGX\u202fB200 \u6a5f\u7bb1\u5403\u6389 <strong>14\u202fkW<\/strong>\u3002<a href=\"https:\/\/www.theregister.com\/2024\/03\/18\/nvidia_turns_up_the_ai\/?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noopener\">Enterprise Technology News and Analysis<br><\/a><\/li>\n<\/ul>\n\n\n\n<p><strong>\u8a2d\u8a08\u54f2\u5b78<\/strong>\uff1a\u7528\u8d85\u9ad8\u983b\u5bec\uff0bFP4 \u91cf\u5316\u63db\u53d6\u300c\u6700\u5927 tokens\/sec\u300d\uff0c\u670d\u52d9\u5168\u7403\u7d1a Copilot \u8207\u591a\u6a21\u614b\u63a8\u7406\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh7-rt.googleusercontent.com\/docsz\/AD_4nXfwazsYLjbmnksLPlaM6cQ227lO-_zpIeJ27d30tmdFi0sVGDSQ9Uht6KmwpzQZFGSuZtedxGulOS2pRF4uh9XtnJIvmziFVM_BIjoiGxmqB8878k3SOMvBIt1ncwU185T2-nHLlQ?key=n7rC6w9f6h9HnS6ed0XuXcsh\" alt=\"\"\/><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>2\u20112. MI300X\uff1a3D Chiplet + \u4f4e\u74e6\uff0c\u8b93\u5927\u6a21\u578b\u585e\u9032\u55ae\u5361<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u88fd\u7a0b<\/strong>\uff1a5\u202fnm + 6\u202fnm 3D Chiplet\uff08CDNA\u202f3\uff09\uff0c\u628a 24\u202f\u5c64 HBM \u5806\u758a\u5728 GPU \u4e0a\u3002<a href=\"https:\/\/www.amd.com\/en\/products\/accelerators\/instinct\/mi300\/mi300x.html?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noopener\">AMD<br><\/a><\/li>\n\n\n\n<li><strong>\u5cf0\u503c\u7b97\u529b<\/strong>\uff1aFP8 \u7d04 <strong>2.6\u202fPFLOPS<\/strong>\uff1bFP16\u202f1.3\u202fPFLOPS\u3002<br><\/li>\n\n\n\n<li><strong>\u8a18\u61b6\u9ad4<\/strong>\uff1aHBM3 192\u202fGB\uff0c\u983b\u5bec <strong>5.3\u202fTB\/s<\/strong>\u3002<br><\/li>\n\n\n\n<li><strong>\u529f\u8017<\/strong>\uff1a<strong>750\u202fW<\/strong>\uff08OAM \u6a21\u7d44\uff09\u3002<br><\/li>\n\n\n\n<li><strong>\u552e\u50f9<\/strong>\uff1a\u64da\u7522\u696d\u5831\u50f9 <strong>$10\u201315\u202fk<\/strong>\uff0c\u50c5\u70ba Blackwell \u4e09\u5206\u4e4b\u4e00\u3002<a href=\"https:\/\/www.reddit.com\/r\/hardware\/comments\/1ahgu7q\/nvidias_h100_ai_gpus_cost_up_to_four_times_more\/?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noopener\">Reddit<br><\/a><\/li>\n<\/ul>\n\n\n\n<p><strong>\u8a2d\u8a08\u54f2\u5b78<\/strong>\uff1a\u7528\u300c\u5927\u5bb9\u91cf\uff0b\u5408\u7406\u74e6\u6578\uff0b\u5e73\u50f9\u300d\u653b\u4f54\u79c1\u6709\u96f2\u8207\u4f01\u696d on\u2011prem \u5e02\u5834\u3002<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>3. \u6027\u80fd\u5be6\u6e2c\uff1aMLPerf\u202fv5.0 \u600e\u9ebc\u8aaa\uff1f<\/strong><\/h2>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><tbody><tr><td><strong>Benchmark<\/strong><\/td><td><strong>8\u00d7\u202fB200 NVL<\/strong><\/td><td><strong>8\u00d7\u202fH200<\/strong><\/td><td><strong>8\u00d7\u202fMI325X*<\/strong><\/td><\/tr><tr><td><strong>Llama\u202f2\u202f70B\uff08\u4e92\u52d5\uff09<\/strong><\/td><td><strong>3.1\u202f\u00d7<\/strong> H200 throughput<\/td><td>1\u202f\u00d7<\/td><td>0.93\u202f\u00d7 H200<\/td><\/tr><tr><td><strong>Llama\u202f3.1\u202f405B\uff08Server\uff09<\/strong><\/td><td><strong>3.4\u202f\u00d7<\/strong> H200<\/td><td>1\u202f\u00d7<\/td><td>\u2014<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>MI325X \u8207 MI300X \u67b6\u69cb\u8207\u5bb9\u91cf\u76f8\u540c\uff0c\u6642\u8108\u7565\u9ad8\uff0c\u6545\u53ef\u8996\u70ba MI300X \u4e0a\u9650\u3002<a href=\"https:\/\/developer.nvidia.com\/blog\/nvidia-blackwell-delivers-massive-performance-leaps-in-mlperf-inference-v5-0\/?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noopener\">NVIDIA Developer<\/a><a href=\"https:\/\/rocm.blogs.amd.com\/artificial-intelligence\/mi325x-accelerates-mlperf-inference\/README.html?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noopener\">ROCm Blogs<\/a><\/p>\n\n\n\n<p><strong>\u95dc\u9375\u89c0\u5bdf<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u5ef6\u9072\/\u541e\u5410\u6975\u9650<\/strong>\uff1aBlackwell + TensorRT\u2011LLM \u628a FP4 \u8207 NVLink \u69a8\u5230\u6975\u81f4\uff0c8 \u5361\u5373\u53ef\u9054 H200 3\u00d7\u202f\u541e\u5410\u3002<br><\/li>\n\n\n\n<li><strong>\u5927\u6a21\u578b\u4e00\u6b21\u88dd\u8f09<\/strong>\uff1a70\u2011110\u202fB \u53c3\u6578\u6a21\u578b\u55ae\u5361\u585e\u5f97\u4e0b MI300X\uff1b\u82e5\u62c6\u5206\u5c64\u6578\u904e\u591a\u540c\u6642\u5f71\u97ff\u5ef6\u9072\u8207\u80fd\u6e90\u3002<br><\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>4. \u8edf\u9ad4\u751f\u614b\uff1aCUDA \u512a\u52e2\u4ecd\u5728\uff0cROCm \u8ffd\u8d95\u901f\u5ea6\u524d\u6240\u672a\u898b<\/strong><\/h2>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><tbody><tr><td><strong>\u9762\u5411<\/strong><\/td><td><strong>NVIDIA<\/strong><\/td><td><strong>AMD<\/strong><\/td><\/tr><tr><td>SDK<\/td><td>CUDA\u202f12 + <strong>TensorRT\u2011LLM<\/strong>\uff08\u5167\u5efa FP4 \u81ea\u52d5\u91cf\u5316\uff09<\/td><td><strong>ROCm\u202f6.4<\/strong>\uff0c\u6574\u5408 vLLM \/ SGLang \/ Flash\u2011Attention\u20113<\/td><\/tr><tr><td>\u958b\u6e90\u652f\u63f4<\/td><td>cuDNN\u3001PyTorch nightly \u540c\u6b65\u66f4\u65b0<\/td><td>vLLM \u5b98\u65b9 Docker\u3001MII\u3001llama.cpp \u7686\u5df2\u4e3b\u7dda\u5316<\/td><\/tr><tr><td>\u96f2\u7aef<\/td><td>AWS\u3001Azure\u3001GCP \u5747\u5ba3\u544a 2025\u202fH2\u202fBlackwell \u5be6\u4f8b<\/td><td>Azure\u3001Meta\u3001Lambda \u5927\u91cf\u63a1\u8cfc MI300X<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p><strong>\u8da8\u52e2\uff1a<\/strong> CUDA \u5c01\u9589\u537b\u6210\u719f\uff1bROCm \u958b\u6e90\u7b56\u7565\u5438\u5f15\u300c\u628a LLM \u4e0b\u653e\u5230\u79c1\u6709\u6a5f\u623f\u300d\u7684\u5ba2\u6236\uff0c\u4e26\u85c9\u793e\u7fa4\u8ca2\u737b\u8fc5\u901f\u62b9\u5e73\u5dee\u8ddd\u3002<a href=\"https:\/\/www.anandtech.com\/show\/21310\/nvidia-blackwell-architecture-and-b200b100-accelerators-announced-going-bigger-with-smaller-data?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noopener\">AnandTech<\/a><a href=\"https:\/\/mlcommons.org\/2025\/04\/mlperf-inference-v5-0-results\/?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noopener\">MLCommons<\/a><\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>5. \u6210\u672c\u3001\u80fd\u8017\u8207 TCO<\/strong><\/h2>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><tbody><tr><td><strong>\u6307\u6a19<\/strong><\/td><td><strong>B200<\/strong><\/td><td><strong>MI300X<\/strong><\/td><\/tr><tr><td>\u55ae\u5361\u552e\u50f9\uff08\u4f30\uff09<\/td><td>$30\u201340\u202fk<\/td><td>$10\u201315\u202fk<\/td><\/tr><tr><td>TBP<\/td><td>~1\u202fkW<\/td><td>750\u202fW<\/td><\/tr><tr><td>\u5e74\u96fb\u8cbb\uff08$0.12\/kWh\uff09<\/td><td>$10\u202fk<\/td><td>$7.9\u202fk<\/td><\/tr><tr><td>\u6a5f\u6ac3\u5bc6\u5ea6<\/td><td>14\u202fkW \/\u202f8\u202fGPU<\/td><td>6\u202fkW \/\u202f8\u202fGPU<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>\u82e5\u4f60\u6253\u7b97\u64f4\u5145\u5230\u767e\u5361\u7b49\u7d1a\uff0c<strong>\u786c\u9ad4 CAPEX + \u96fb\u529b OPEX<\/strong> \u5dee\u8ddd\u53ef\u9054\u6578\u767e\u842c\u7f8e\u5143\uff1b\u9664\u975e\u5ef6\u9072\u662f\u9996\u8981\u547d\u9580\uff0c\u5426\u5247 MI300X \u7684\u6027\u50f9\u6bd4\u66f4\u96e3\u5ffd\u8996\u3002<a href=\"https:\/\/www.theregister.com\/2024\/03\/18\/nvidia_turns_up_the_ai\/?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noopener\">Enterprise Technology News and Analysis<\/a><a href=\"https:\/\/www.reddit.com\/r\/hardware\/comments\/1ahgu7q\/nvidias_h100_ai_gpus_cost_up_to_four_times_more\/?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noopener\">Reddit<\/a><\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>6. \u9069\u7528\u5834\u666f\u6c7a\u7b56\u77e9\u9663<\/strong><\/h2>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><tbody><tr><td><strong>\u9700\u6c42\u7279\u5fb5<\/strong><\/td><td><strong>\u5efa\u8b70 GPU<\/strong><\/td><td><strong>\u7406\u7531<\/strong><\/td><\/tr><tr><td><strong>\u5168\u7403\u7d1a Copilot \/ \u591a\u6a21\u614b\u52a9\u624b<\/strong>\uff0899th \u5ef6\u9072 &lt;\u202f100\u202fms\uff09<\/td><td><strong>Blackwell<\/strong><\/td><td>FP4 + NVLink \u6253\u6975\u9650\uff0c\u5ef6\u9072\u6700\u4f4e<\/td><\/tr><tr><td><strong>\u79c1\u6709\u96f2 \/ \u6a5f\u5bc6\u8cc7\u6599\u5fae\u8abf<\/strong>\uff0870\u2011110\u202fB \u6a21\u578b\u55ae\u5361\uff09<\/td><td><strong>MI300X<\/strong><\/td><td>\u5927\u5bb9\u91cf\u3001\u4f4e\u74e6\uff0c\u53ef\u7701 60\u202f% \u6210\u672c<\/td><\/tr><tr><td><strong>API\u2011SaaS \u591a\u79df\u6236<\/strong>\uff08\u8ffd\u6c42 tokens\/\u74e6\uff09<\/td><td>\u8996\u9810\u7b97\u6df7\u914d<\/td><td>\u5148\u7528 MI300X \u8d77\u91cf\uff0c\u518d\u52a0\u5165 B200 \u4f5c\u71b1\u9580\u6a21\u578b\u5feb\u53d6<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>7. \u672a\u4f86\u5c55\u671b\uff1a\u5361\u738b\u4e4b\u6230\u9060\u672a\u7d50\u675f<\/strong><\/h2>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>\u8edf\u9ad4\u512a\u5316\u4ecd\u53ef\u7ffb\u76e4<\/strong><strong><br><\/strong> AMD \u5df2\u516c\u958b FP6\/FP4 \u91cf\u5316 roadmap\uff1b\u82e5 2026\u202f\u524d\u6574\u5408\u6210\u529f\uff0cMI300X \u53ef\u80fd\u628a\u300c\u6bcf\u74e6\u541e\u5410\u300d\u518d\u63d0 40\u202f%\u3002<br><\/li>\n\n\n\n<li><strong>HBM \u7522\u80fd\u74f6\u9838<\/strong><strong><br><\/strong> \u5169\u5bb6\u90fd\u5403\u540c\u4e00\u689d\u4f9b\u61c9\u93c8\uff1bHBM3E \u826f\u7387\u6c7a\u5b9a\u4ea4\u8ca8\u901f\u5ea6\uff0c\u4e5f\u5c07\u5f71\u97ff\u4f60\u7684\u63a1\u8cfc\u6392\u7a0b\u3002<br><\/li>\n\n\n\n<li><strong>\u76e3\u7ba1\u8207\u7da0\u80fd\u58d3\u529b<\/strong><strong><br><\/strong> \u6b50\u76df\u202fAI\u202fAct \u8207\u5404\u570b\u78b3\u7a05\uff0c\u8b93\u300c\u529f\u8017 \/\u202fCO\u2082 \u6392\u653e\u300d\u6210\u70ba\u8463\u4e8b\u6703 KPI\u3002\u5c11 250\u202fW \u807d\u8d77\u4f86\u4e0d\u591a\uff0c\u82e5\u4f60\u6709\u5343\u5361\u96c6\u7fa4\u5c31\u662f 250\u202fkW\u3002<a href=\"https:\/\/www.reddit.com\/r\/hardware\/comments\/1ahgu7q\/nvidias_h100_ai_gpus_cost_up_to_four_times_more\/?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noopener\">Reddit<br><\/a><\/li>\n<\/ol>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>8. \u7d50\u8ad6\uff1a\u6c92\u6709\u5b8c\u7f8e GPU\uff0c\u53ea\u6709\u5408\u8eab KPI<\/strong><\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u901f\u5ea6\u738b<\/strong>\uff1aBlackwell \u628a\u300c\u4e00\u584a\u5361\u300d\u505a\u5230\u6975\u81f4\uff0c\u5c0f\u81f3 Chat \u5b8c\u6210\u6642\u9593\uff0c\u5927\u5230 Llama\u202f3 \u767e\u5104\u7d1a\u8a13\u7df4\uff0c\u90fd\u80fd\u7528\u541e\u5410\u63db\u6642\u9593\u3002<br><\/li>\n\n\n\n<li><strong>CP \u503c\u738b<\/strong>\uff1aMI300X \u4ee5\u4e09\u5206\u4e4b\u4e00\u6210\u672c\u3001\u56db\u5206\u4e4b\u4e09\u6027\u80fd\uff0b\u540c\u7d1a\u8a18\u61b6\u9ad4\uff0c\u5728\u79c1\u6709\u96f2\u8207\u63a8\u7406\u5e02\u5834\u6bba\u51fa\u8840\u8def\u3002<br><\/li>\n<\/ul>\n\n\n\n<p><strong>\u6c7a\u7b56\u516c\u5f0f<\/strong>\uff1a<br>\u7e3d TCO = (GPU \u50f9\u683c + \u96fb\u529b + \u6a5f\u623f\u6539\u9020) \/ \u9810\u671f tokens<br>\u5225\u5fd8\u4e86\u628a <strong>\u5de5\u7a0b\u5e2b\u751f\u7522\u529b\u3001\u5408\u898f\u6642\u9593\u8207\u98a8\u96aa\u4fdd\u96aa<\/strong> \u6253\u9032\u8ca0\u865f\uff0c\u7b54\u6848\u81ea\u7136\u6d6e\u73fe\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u4e00\u53e5\u8a71\u6458\u8981\uff1a \u60f3\u6975\u901f\u8207\u6700\u9577\u4e0a\u4e0b\u6587\uff0c\u7528\u202fNVIDIA\u202fBlackwell\uff1b\u8981\u4f4e\u74e6\u9ad8\u5bb9\u91cf\u8207\u9ad8\u202fCP\u202f\u503c\uff0c\u9078\u202fAMD\u202fMI300X\u2014\u2014\u771f\u6b63\u7684\u52dd\u8ca0\u53d6\u6c7a\u65bc\u4f60\u7684 KPI \u8207\u8377\u5305\u3002 1. \u524d\u8a00\uff1a\u70ba\u4f55 2025 \u5e74\u6210&#8230;<\/p>\n","protected":false},"author":253372381,"featured_media":9907,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[96987580,96987573],"tags":[96988052,96988053],"class_list":["post-9897","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-news","category-featured-articles","tag-blackwell","tag-mi300x"],"blocksy_meta":[],"acf":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/ai-stack.orca-biz.tw\/wp-content\/uploads\/2025\/05\/%E6%A8%A1%E5%9E%8BA-5.jpg?fit=1920%2C1080&quality=100&ssl=1","jetpack_shortlink":"https:\/\/wp.me\/ph344V-2zD","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/ai-stack.orca-biz.tw\/zh-hant\/wp-json\/wp\/v2\/posts\/9897","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ai-stack.orca-biz.tw\/zh-hant\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ai-stack.orca-biz.tw\/zh-hant\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ai-stack.orca-biz.tw\/zh-hant\/wp-json\/wp\/v2\/users\/253372381"}],"replies":[{"embeddable":true,"href":"https:\/\/ai-stack.orca-biz.tw\/zh-hant\/wp-json\/wp\/v2\/comments?post=9897"}],"version-history":[{"count":0,"href":"https:\/\/ai-stack.orca-biz.tw\/zh-hant\/wp-json\/wp\/v2\/posts\/9897\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ai-stack.orca-biz.tw\/zh-hant\/wp-json\/wp\/v2\/media\/9907"}],"wp:attachment":[{"href":"https:\/\/ai-stack.orca-biz.tw\/zh-hant\/wp-json\/wp\/v2\/media?parent=9897"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ai-stack.orca-biz.tw\/zh-hant\/wp-json\/wp\/v2\/categories?post=9897"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ai-stack.orca-biz.tw\/zh-hant\/wp-json\/wp\/v2\/tags?post=9897"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}