{ "text": "OK 今天我们来讲一下\n为什么要部署本地大模型\n每次我做关于本地模型的视频\n都会看到评论区\n有一些朋友不理解\n就问你本地模型的意义是什么\nDeepSeek一个月用下来才多少钱\n现在买硬件\n你可能要好几年才能回本\n然后还要花时间折腾\n然后本地模型又没有云端模型\n速度快\n也没有云端模型的质量好\n那么今天我正好是在用本地的\nqwen 3.8 27b帮我把NAS改造成\n一个专门给我的云端和本地的AI\n用的共享记忆库\n所以就想趁机跟大家聊一下我的想法\n那么首先就是隐私\n隐私是当下用本地大模型最重要的理由\n那么我这个NAS里面是有很多的私人的照片\n我很多私人的文件\n同时为了把整个NAS从底层改造成一个安全的\n适合用来给我的云端Agent\n还有我的本地Agent\n共用的这样一个记忆库\n数据库知识库\n我还是需要给我的Agent\n全权限的SSH进去做很多操作\n所以首先在对模型的选用上\n直接一棒子就把所有云端API给打死了\n那有的朋友可能就要说了\n在线的很多API都是明确写了的\n就是不会用你的数据去训练的\n你要是真的信\n我也只能就尊重你的想法\n我们就假设\n假设测试真的\n他不会选择你的数据进行训练\n你发过去的数据\n他是一点都不关心\n真的一点都不看\n良心爆棚阅后即焚\n但是你的风险不仅仅是说你的隐私\n会被上传到云端\n因为在你自己的局域网里面\n连着这么多台电脑手机等等设备\nagent 一个拥有root权限的agent\n它是会遍历你整个文件系统的\n所有文件系统\n不是说你让他读什么\n他就只读什么的\n他是自己会去搜索记录\n也可能会擅自去访问你的敏感信息\n虽然我也觉得我的数据可能就不止几块钱\n我又不是什么正在攻克最前沿的\n数学难题的数学家\n不用怕被剽窃点子\n但同时我也觉得大模型的云服务商\n他们最喜欢的就是用户的这种想法\n你觉得不值钱的东西\n在他们看来有可能是非常值钱\n所以在做这一类\n在局域网里面给他全线做工作的时候\n比起把数据送到一个嘴很甜\n但小动作可能不干净的云服务上\n我的做法是把AI直接放在我的数据旁边\n然后把他们照起来让他们出不去\n那么隐私是使用本地大模型最大的\n也是最一刀切的理由\n但它并不是所有理由\n接下来我还想从金钱速度还有质量的角度\n再扒开来跟大家聊聊我的想法\n先说金钱\n比如说DeepSeek是我用的最多的模型\n我很喜欢这个模型\n但是中间一段日子\n它要涨价就涨价\n可能是用的太多了\n真的很霸道就是说\n而且涨的不是一星半点\n那个涨价是直接可以让我的API费用\n从以前一个月300块人民币\n直接暴涨到一个月1000多人民币的那种涨价\n你怎么办\n它后来现在又更新了DeepSeek V4.1\nflash价格又降下来了\n但降价之后仍就是比涨价之前还要贵的\n也仍就是比本地部署AI的电费要贵\n贵得多\n按照我自己的用量一个月电费大概是200块钱\n但国内的朋友电价是我这边的三分之一\n也就是六七十块电费就够了\n那这时候也有的小伙伴要说了\n您这本地硬件也是要钱的\n更何况现在显卡这么贵\n内存也这么贵\n你想整一台AI主机\n那不得好几万块吗\n这句话对也不对\n就如果你现在在这个时间点\n像从零开始整一台用的相对舒服的AI主机\n比如说3090 4090甚至5090\n或者AMD AI PRO R9700或者7900XTX\n确实很贵\n假设你两万块钱配一套主机\n掐指一算\n也够你API用个两三年了\n而且这两三年你都一直可以用在线的\n最新的最好的比本地能力更强的大模型\n然而这笔账你还能反过来算\n就比如说我当时买我的4090的时候是1万块钱出头\n几年过去\n含泪血赚一倍\n还有比如说7900XTX这种AMD的显卡\n在它的生态起来之前\n它是只用5000来块钱\n而现在它被各路开源的大神优化好了\n价格也就涨上去了\n涨了好几千块钱\n这时候你再去买它\n划不划算呢\n我觉得非常见仁见智\n因为当时它只有5000块钱\n是因为它本来速度就慢\n一如它只有5000块钱的价值\n而现在它涨价了\n是因为它的价值变高了\n大家都意识到A卡被优化好了\n居然还这么好用\n所以显卡它的价格早就已经被它的算力提前定价了\n这时候你想买到便宜的算力\n只有两种可能\n一种就是像我运气好\n我本身当时就是有做3D方面的相关的工作的需求\n才买到4090\n我也没有想到有一天这张卡居然会能拿来跑本地AI\n还有一种就是你真的非常有远见\n你成天泡在社区\n非常懂技术\n第一时间能了解到某个框架的突然炸裂优化\n你看到了它无限的可能性\n而别人都还没看到\n然后你直接大手一挥低价抄底\n对于这两种人来说\n你买硬件不仅不亏钱\n还赚钱\n我当然不是说硬件接下来还会接着涨\n你们现在立马都要去充一张高端显卡\n绝对不是的\n因为我认为作为消费者我们能赚到的\n终究是少数\n大多数人都是等八手资料\n在社交网络上\n在飞个两三个月才能意识到趋势来了\n届时你看到的价格\n就是那张显卡当下的算力能够体现的价格\n要是回路再长一点\n你看到的时候已经是被黄牛炒到虚高的价格\n所以现在你们也要去买显卡\n买了显卡就可能还会再涨两年\n也可能第二天就开始跌\n我也不知道\n但是如果你买了显卡\n会因为涨了3000块或者跌了3000块\n就不买了\n说明你就不是刚需\n这个卡也没有为你产生什么价值\n所以你大概率就没必要买\n你就用API省心还划算\n因为如果是刚需\n十几万一张的Pro6000都会有人买的\n所以总结下来就是说\n价格这个事情\n没有一种视角是绝对正确的\n因为每个人的需求都不一样\n那么讲完价格\n我们再来说一下本地模型的能力\n很多不关注这方面的朋友\n可能是真的体会不到\n本地模型发展有多迅猛\n就在几个月前\n我这样一台4090的主机\n我用它来部署qwen 3.6 27B\n那个时候这个模型是给我带来了\n它确实给我带来了眼前一亮的感觉\n它相当于一个转折点\n就它越过了那条可用不可用的线\n第一次\n我是在一张消费级显卡上体会到\n一个本地仅有27B的模型\n居然能做那么多事情\n那时候我记得Hermes Agent\n也是刚出来没多久\n我就用本地的Hermes\n再搭配本地的qwen 3.6 27B这个模型\n代替Codex做了好多事情\n当然和Codex里面的GPT比起来\n差距也是实打实的很明显的\n你用它来做一些本地的小任务\n是没什么问题\n但是一旦干那种长链任务\n它干到一半还是会飘\n如果你不开MTP的话\n我记得一开始配好就有二三十token每秒\n后来我是研究优化配置\n然后又换框架\n然后开了MTP\n好的情况下\n也就五六十\n然后上下文是只能开到100K左右的\n然而仅仅过了不到半年\n才4个月\n现在qwen 3.8 27b出来\n然后新的推理框架\n比如说ninfer出来\nllama.cpp也是迎来了很大的更新\n现在基本是开箱即用\n然后同样的显卡\n我能优化到100多Token每秒\n上下文也是开到256K\n塞满也不会飘\n这边可以加一个资料\n最后就是我开头说的\n我要让qwen 3.8 27b 一把的NAS\n改造成一个用memorybear的记忆库的\n这样一个任务\n这个任务其实非常的复杂\n要涉及到NAS\n局域网云服务器\n然后还有自制的Gateway等等\n很多方面\n以及涉及到NAS的隐私\n还有安全性的问题\n在整个部署的过程中的遇到问题\n它还是要自主的去排查\n还有搜索网络\n像这样一个巨大的任务\n我是用云端的\nqwen 3.8 Max和GPT\n给它做了一个Plan\n然后一旦我把Plan给到位了\nqwen 3.8 27b\n它自己是能在后台工作好几个小时\n而且完美的完成每一个中间phase\n这样一个任务\n我从头到尾没有开新session\n就是截图里的这个\n比如说连续三小时的长连任务\n在之前好几个部署\n也都是一小时两小时起步的\n在那之后\n我也是又跑了好几个小时连续的\n我是直接把上下文开到256K\n就随它跑随它压\n几十轮上千步\n完全不会飘\n不会崩速度稳定\n在大概90到100tokens每秒\n就太离谱了\n太爽了\n题外话\n我现在是把它放在Codex里面用的\n我觉得目前我用下来\n是Codex是最好用的\nhermes agent做的还是好\n很稳很稳\n那么话说回来\n这种级别的任务\n如果你在四个月前\n就qwen 3.6 27B那个时代\n你跟我说\n我们做个本地小模型\n就3.6的下一代\n就已经可以做到\n自主推进好几个小时的任务\n并且成功\n那我会觉得你有幻觉了\n而且它任务完成的质量好\n也不是我随口说说的\n就是你把它交给云端顶级模型\n他们看了都说好\n那么下一点就是关于API的稳定性\n就为API万一炸了怎么办\n这种事情不常发生\n但是一旦发生了\n是真的要命的\n我自己也是经历过好几次了\n就是云端AI突然炸了\n连不上了\n就在我一边写这篇稿子\n一边在推另外一个自动剪辑的任务的时候\nOpenAI炸了\n它自己内部应该是在进行一个更新\n反正就在好久都用不了\n包括我之前用OpenCode的时候也炸过\n然后再用DeepSeek官方的API的时候也炸过\n对于我个人而言\n我现在大部分工作室没有AI\n就完全没有办法推进了\n当然当OpenAI炸了的时候\nDeepSeek不会说也同时炸了\n这种情况是很少发生的\n你完全可以切换到别的服务商去用\n但是如果是你自己的网络炸了\n谁来替你排查\n谁来替你干活\n所以现在在本地有一个4090级别\n再加上qwen 3.8 27b这个级别的算力\n对于我个人而言\n说是一个非常安心的保险\n我知道就即便出了任何事情\n只要不是整个世界都断电了\n我就还有一个算力可以用\n最后再简单提一下\n就很多朋友会关心的\n非常担心的部署的问题\n大家可能会觉得本地模型是不是超级复杂\n自己是不是要会编程才能玩\n这些说实话都没有担心的必要了\n四个月前qwen 3.6的那个时代\n我觉得确实是要一点动手能力的\n你自己要理解比较多的计算机基础的东西\n因为那时候的大模型还有Agent\n以及Harness都没有现在这么强的\n自主长链任务的能力\n那时候你要配置VLLM什么的是真的\n我自己又进终端手搓的\n当然是和AI一边聊天\n一边当Prompt的搬运工\n但整个流程就是非常繁琐\n要各种排错各种研究\n而现在不管是用comfy UI\n还是本地的语言大模型\n你随便找个云端API\n就比如说DeepSeek V4.1 Flash这种级别的\n再用hermes agent\n你就让它给你配\n两三句话的事情配好了\n配置好之后\n你就让它根据你的硬件去做测试\n它顺时就能自己自主跑一整天\n然后把你的硬件情况下\n你最好的参数全都给你试出来\n所以配置的门槛其实也是一直在下降的\nOK 最后\n其实我想说的是\n我并不认为每一个人\n都需要去部署自己的本地大模型\n我甚至不认为每个人都要去用AI\n我也不认为每个人都要去用电脑\n每个人都要去开车\n大家都有自己的生活方式\n你觉得怎么舒服怎么来\n对吧\n普通用户\n你偶尔问几个问题\n一天花个几万Token\n你有必要为这件事情去买个显卡吗\n不必吧\n或者你是做公司的工作\n你写代码虽然写的很多\n但是你公司会给你报销API费用\n或者给你买200美金一个月的Token plan\n那也很爽\n你也没有必要搞本地\n本地AI它是一个拥有权\n但同时也是一个取舍\n是一种妥协\n你要用一个更弱的模型\n你要自己去部署\n去维护麻烦的事情\n它还很吵\n噪音很大\n还有放热\n夏天的时候就是开着空调\n你都会觉得房间里面有种桑拿的感觉\n但是我个人\n我所有的创作\n包括我公司的管理\n包括各种乱七八糟的杂物\n全都是交给Agent去办的\n所以本地算力对于我来说\n是一个相当有必要的基础设施\n对于你自己的用途人员\n它也有可能是一个很合理的选择\n而最后的最后\n我想说的是\n所有事情都是图个开心而已\n本地部署一个AI大模型\n对于我个人来说\n是一个非常让我开心\n让我觉得非常好玩的事情\n就跟自己装电脑\n或者说自己修车一样\n我自己折腾的每分每秒都是在享受\n所以如果你喜欢类似的话题\n有空欢迎再来听我唠嗑\n我们下期再见", "language": "zh", "duration": 701.0, "segments": [ { "id": 0, "start": 0.166, "end": 1.468, "text": "OK 今天我们来讲一下", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 1, "start": 1.601, "end": 3.503, "text": "为什么要部署本地大模型", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 2, "start": 3.57, "end": 5.772, "text": "每次我做关于本地模型的视频", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 3, "start": 5.772, "end": 6.606, "text": "都会看到评论区", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 4, "start": 6.606, "end": 7.774, "text": "有一些朋友不理解", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 5, "start": 7.774, "end": 10.343, "text": "就问你本地模型的意义是什么", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 6, "start": 10.343, "end": 12.112, "text": "DeepSeek一个月用下来才多少钱", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 7, "start": 12.145, "end": 12.912, "text": "现在买硬件", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 8, "start": 12.912, "end": 14.547, "text": "你可能要好几年才能回本", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 9, "start": 14.547, "end": 16.049, "text": "然后还要花时间折腾", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 10, "start": 16.116, "end": 18.084, "text": "然后本地模型又没有云端模型", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 11, "start": 18.084, "end": 18.651, "text": "速度快", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 12, "start": 18.651, "end": 20.253, "text": "也没有云端模型的质量好", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 13, "start": 20.253, "end": 22.389, "text": "那么今天我正好是在用本地的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 14, "start": 22.389, "end": 25.291, "text": "qwen 3.8 27b帮我把NAS改造成", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 15, "start": 25.291, "end": 27.794, "text": "一个专门给我的云端和本地的AI", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 16, "start": 28.028, "end": 29.496, "text": "用的共享记忆库", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 17, "start": 29.696, "end": 31.931, "text": "所以就想趁机跟大家聊一下我的想法", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 18, "start": 31.931, "end": 33.533, "text": "那么首先就是隐私", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 19, "start": 33.666, "end": 36.369, "text": "隐私是当下用本地大模型最重要的理由", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 20, "start": 36.369, "end": 39.105, "text": "那么我这个NAS里面是有很多的私人的照片", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 21, "start": 39.105, "end": 40.473, "text": "我很多私人的文件", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 22, "start": 40.573, "end": 44.644, "text": "同时为了把整个NAS从底层改造成一个安全的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 23, "start": 44.644, "end": 46.246, "text": "适合用来给我的云端Agent", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 24, "start": 46.246, "end": 47.547, "text": "还有我的本地Agent", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 25, "start": 47.68, "end": 49.482, "text": "共用的这样一个记忆库", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 26, "start": 49.516, "end": 50.617, "text": "数据库知识库", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 27, "start": 50.683, "end": 52.018, "text": "我还是需要给我的Agent", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 28, "start": 52.018, "end": 55.088, "text": "全权限的SSH进去做很多操作", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 29, "start": 55.088, "end": 57.257, "text": "所以首先在对模型的选用上", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 30, "start": 57.323, "end": 59.726, "text": "直接一棒子就把所有云端API给打死了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 31, "start": 59.726, "end": 61.728, "text": "那有的朋友可能就要说了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 32, "start": 61.728, "end": 63.83, "text": "在线的很多API都是明确写了的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 33, "start": 63.83, "end": 66.433, "text": "就是不会用你的数据去训练的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 34, "start": 66.433, "end": 67.567, "text": "你要是真的信", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 35, "start": 67.6, "end": 69.836, "text": "我也只能就尊重你的想法", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 36, "start": 69.836, "end": 70.87, "text": "我们就假设", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 37, "start": 70.904, "end": 72.005, "text": "假设测试真的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 38, "start": 72.005, "end": 74.007, "text": "他不会选择你的数据进行训练", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 39, "start": 74.007, "end": 75.041, "text": "你发过去的数据", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 40, "start": 75.041, "end": 76.142, "text": "他是一点都不关心", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 41, "start": 76.142, "end": 77.21, "text": "真的一点都不看", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 42, "start": 77.31, "end": 79.045, "text": "良心爆棚阅后即焚", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 43, "start": 79.145, "end": 81.948, "text": "但是你的风险不仅仅是说你的隐私", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 44, "start": 81.948, "end": 83.149, "text": "会被上传到云端", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 45, "start": 83.249, "end": 85.151, "text": "因为在你自己的局域网里面", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 46, "start": 85.218, "end": 87.587, "text": "连着这么多台电脑手机等等设备", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 47, "start": 87.754, "end": 90.69, "text": "agent 一个拥有root权限的agent", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 48, "start": 90.69, "end": 93.359, "text": "它是会遍历你整个文件系统的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 49, "start": 93.359, "end": 94.394, "text": "所有文件系统", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 50, "start": 94.394, "end": 95.829, "text": "不是说你让他读什么", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 51, "start": 95.829, "end": 97.063, "text": "他就只读什么的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 52, "start": 97.063, "end": 98.631, "text": "他是自己会去搜索记录", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 53, "start": 98.765, "end": 100.934, "text": "也可能会擅自去访问你的敏感信息", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 54, "start": 101.034, "end": 103.937, "text": "虽然我也觉得我的数据可能就不止几块钱", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 55, "start": 103.937, "end": 106.473, "text": "我又不是什么正在攻克最前沿的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 56, "start": 106.473, "end": 107.707, "text": "数学难题的数学家", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 57, "start": 107.707, "end": 109.175, "text": "不用怕被剽窃点子", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 58, "start": 109.175, "end": 111.778, "text": "但同时我也觉得大模型的云服务商", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 59, "start": 111.778, "end": 114.247, "text": "他们最喜欢的就是用户的这种想法", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 60, "start": 114.38, "end": 115.748, "text": "你觉得不值钱的东西", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 61, "start": 115.748, "end": 118.451, "text": "在他们看来有可能是非常值钱", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 62, "start": 118.451, "end": 119.385, "text": "所以在做这一类", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 63, "start": 119.519, "end": 122.188, "text": "在局域网里面给他全线做工作的时候", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 64, "start": 122.388, "end": 124.657, "text": "比起把数据送到一个嘴很甜", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 65, "start": 124.657, "end": 126.793, "text": "但小动作可能不干净的云服务上", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 66, "start": 126.993, "end": 130.129, "text": "我的做法是把AI直接放在我的数据旁边", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 67, "start": 130.129, "end": 132.332, "text": "然后把他们照起来让他们出不去", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 68, "start": 132.332, "end": 134.767, "text": "那么隐私是使用本地大模型最大的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 69, "start": 134.767, "end": 136.369, "text": "也是最一刀切的理由", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 70, "start": 136.369, "end": 137.971, "text": "但它并不是所有理由", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 71, "start": 137.971, "end": 140.64, "text": "接下来我还想从金钱速度还有质量的角度", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 72, "start": 140.707, "end": 142.709, "text": "再扒开来跟大家聊聊我的想法", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 73, "start": 142.709, "end": 143.443, "text": "先说金钱", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 74, "start": 143.643, "end": 146.079, "text": "比如说DeepSeek是我用的最多的模型", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 75, "start": 146.112, "end": 147.213, "text": "我很喜欢这个模型", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 76, "start": 147.213, "end": 148.948, "text": "但是中间一段日子", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 77, "start": 148.948, "end": 150.316, "text": "它要涨价就涨价", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 78, "start": 150.45, "end": 151.584, "text": "可能是用的太多了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 79, "start": 151.584, "end": 153.152, "text": "真的很霸道就是说", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 80, "start": 153.152, "end": 154.954, "text": "而且涨的不是一星半点", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 81, "start": 154.988, "end": 157.39, "text": "那个涨价是直接可以让我的API费用", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 82, "start": 157.39, "end": 159.225, "text": "从以前一个月300块人民币", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 83, "start": 159.292, "end": 162.328, "text": "直接暴涨到一个月1000多人民币的那种涨价", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 84, "start": 162.428, "end": 163.029, "text": "你怎么办", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 85, "start": 163.163, "end": 165.532, "text": "它后来现在又更新了DeepSeek V4.1", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 86, "start": 165.532, "end": 167.033, "text": "flash价格又降下来了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 87, "start": 167.033, "end": 169.936, "text": "但降价之后仍就是比涨价之前还要贵的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 88, "start": 170.036, "end": 172.872, "text": "也仍就是比本地部署AI的电费要贵", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 89, "start": 172.972, "end": 173.673, "text": "贵得多", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 90, "start": 173.74, "end": 176.91, "text": "按照我自己的用量一个月电费大概是200块钱", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 91, "start": 176.91, "end": 179.379, "text": "但国内的朋友电价是我这边的三分之一", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 92, "start": 179.379, "end": 181.581, "text": "也就是六七十块电费就够了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 93, "start": 181.681, "end": 183.75, "text": "那这时候也有的小伙伴要说了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 94, "start": 183.75, "end": 185.852, "text": "您这本地硬件也是要钱的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 95, "start": 185.885, "end": 187.554, "text": "更何况现在显卡这么贵", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 96, "start": 187.554, "end": 188.688, "text": "内存也这么贵", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 97, "start": 188.788, "end": 190.189, "text": "你想整一台AI主机", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 98, "start": 190.189, "end": 191.257, "text": "那不得好几万块吗", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 99, "start": 191.558, "end": 193.326, "text": "这句话对也不对", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 100, "start": 193.693, "end": 195.662, "text": "就如果你现在在这个时间点", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 101, "start": 195.662, "end": 199.065, "text": "像从零开始整一台用的相对舒服的AI主机", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 102, "start": 199.165, "end": 201.601, "text": "比如说3090 4090甚至5090", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 103, "start": 201.601, "end": 204.971, "text": "或者AMD AI PRO R9700或者7900XTX", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 104, "start": 204.971, "end": 205.738, "text": "确实很贵", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 105, "start": 206.005, "end": 207.84, "text": "假设你两万块钱配一套主机", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 106, "start": 207.84, "end": 208.608, "text": "掐指一算", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 107, "start": 208.708, "end": 210.543, "text": "也够你API用个两三年了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 108, "start": 210.543, "end": 213.112, "text": "而且这两三年你都一直可以用在线的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 109, "start": 213.112, "end": 216.449, "text": "最新的最好的比本地能力更强的大模型", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 110, "start": 216.616, "end": 219.152, "text": "然而这笔账你还能反过来算", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 111, "start": 219.152, "end": 222.455, "text": "就比如说我当时买我的4090的时候是1万块钱出头", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 112, "start": 222.522, "end": 223.556, "text": "几年过去", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 113, "start": 223.556, "end": 225.024, "text": "含泪血赚一倍", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 114, "start": 225.024, "end": 227.56, "text": "还有比如说7900XTX这种AMD的显卡", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 115, "start": 227.794, "end": 229.128, "text": "在它的生态起来之前", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 116, "start": 229.229, "end": 230.73, "text": "它是只用5000来块钱", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 117, "start": 230.964, "end": 234.033, "text": "而现在它被各路开源的大神优化好了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 118, "start": 234.2, "end": 235.468, "text": "价格也就涨上去了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 119, "start": 235.535, "end": 236.703, "text": "涨了好几千块钱", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 120, "start": 236.703, "end": 238.137, "text": "这时候你再去买它", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 121, "start": 238.304, "end": 239.272, "text": "划不划算呢", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 122, "start": 239.405, "end": 240.907, "text": "我觉得非常见仁见智", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 123, "start": 241.074, "end": 243.042, "text": "因为当时它只有5000块钱", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 124, "start": 243.042, "end": 244.51, "text": "是因为它本来速度就慢", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 125, "start": 244.677, "end": 246.446, "text": "一如它只有5000块钱的价值", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 126, "start": 246.446, "end": 247.58, "text": "而现在它涨价了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 127, "start": 247.58, "end": 249.015, "text": "是因为它的价值变高了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 128, "start": 249.015, "end": 250.917, "text": "大家都意识到A卡被优化好了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 129, "start": 250.917, "end": 252.051, "text": "居然还这么好用", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 130, "start": 252.051, "end": 256.422, "text": "所以显卡它的价格早就已经被它的算力提前定价了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 131, "start": 256.489, "end": 258.524, "text": "这时候你想买到便宜的算力", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 132, "start": 258.524, "end": 259.192, "text": "只有两种可能", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 133, "start": 259.225, "end": 260.393, "text": "一种就是像我运气好", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 134, "start": 260.393, "end": 263.496, "text": "我本身当时就是有做3D方面的相关的工作的需求", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 135, "start": 263.496, "end": 264.43, "text": "才买到4090", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 136, "start": 264.43, "end": 268.268, "text": "我也没有想到有一天这张卡居然会能拿来跑本地AI", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 137, "start": 268.534, "end": 270.97, "text": "还有一种就是你真的非常有远见", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 138, "start": 270.97, "end": 272.472, "text": "你成天泡在社区", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 139, "start": 272.505, "end": 273.339, "text": "非常懂技术", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 140, "start": 273.339, "end": 276.876, "text": "第一时间能了解到某个框架的突然炸裂优化", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 141, "start": 276.976, "end": 278.511, "text": "你看到了它无限的可能性", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 142, "start": 278.511, "end": 279.545, "text": "而别人都还没看到", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 143, "start": 279.746, "end": 282.015, "text": "然后你直接大手一挥低价抄底", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 144, "start": 282.148, "end": 283.516, "text": "对于这两种人来说", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 145, "start": 283.516, "end": 285.018, "text": "你买硬件不仅不亏钱", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 146, "start": 285.018, "end": 285.685, "text": "还赚钱", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 147, "start": 285.885, "end": 288.688, "text": "我当然不是说硬件接下来还会接着涨", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 148, "start": 288.688, "end": 290.957, "text": "你们现在立马都要去充一张高端显卡", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 149, "start": 290.99, "end": 291.824, "text": "绝对不是的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 150, "start": 291.824, "end": 294.26, "text": "因为我认为作为消费者我们能赚到的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 151, "start": 294.293, "end": 295.328, "text": "终究是少数", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 152, "start": 295.561, "end": 297.43, "text": "大多数人都是等八手资料", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 153, "start": 297.43, "end": 298.264, "text": "在社交网络上", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 154, "start": 298.264, "end": 300.967, "text": "在飞个两三个月才能意识到趋势来了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 155, "start": 301.2, "end": 302.869, "text": "届时你看到的价格", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 156, "start": 302.869, "end": 306.272, "text": "就是那张显卡当下的算力能够体现的价格", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 157, "start": 306.272, "end": 307.44, "text": "要是回路再长一点", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 158, "start": 307.573, "end": 310.677, "text": "你看到的时候已经是被黄牛炒到虚高的价格", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 159, "start": 310.677, "end": 312.679, "text": "所以现在你们也要去买显卡", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 160, "start": 312.679, "end": 314.914, "text": "买了显卡就可能还会再涨两年", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 161, "start": 314.981, "end": 316.549, "text": "也可能第二天就开始跌", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 162, "start": 316.549, "end": 317.05, "text": "我也不知道", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 163, "start": 317.283, "end": 318.951, "text": "但是如果你买了显卡", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 164, "start": 318.951, "end": 321.054, "text": "会因为涨了3000块或者跌了3000块", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 165, "start": 321.154, "end": 322.155, "text": "就不买了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 166, "start": 322.288, "end": 323.723, "text": "说明你就不是刚需", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 167, "start": 323.823, "end": 325.758, "text": "这个卡也没有为你产生什么价值", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 168, "start": 325.758, "end": 327.16, "text": "所以你大概率就没必要买", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 169, "start": 327.16, "end": 328.828, "text": "你就用API省心还划算", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 170, "start": 328.895, "end": 330.163, "text": "因为如果是刚需", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 171, "start": 330.196, "end": 332.465, "text": "十几万一张的Pro6000都会有人买的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 172, "start": 332.498, "end": 333.966, "text": "所以总结下来就是说", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 173, "start": 334.067, "end": 334.901, "text": "价格这个事情", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 174, "start": 335.101, "end": 337.103, "text": "没有一种视角是绝对正确的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 175, "start": 337.103, "end": 338.604, "text": "因为每个人的需求都不一样", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 176, "start": 338.771, "end": 339.772, "text": "那么讲完价格", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 177, "start": 339.772, "end": 342.275, "text": "我们再来说一下本地模型的能力", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 178, "start": 342.275, "end": 343.409, "text": "很多不关注这方面的朋友", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 179, "start": 343.509, "end": 344.744, "text": "可能是真的体会不到", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 180, "start": 344.811, "end": 347.046, "text": "本地模型发展有多迅猛", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 181, "start": 347.146, "end": 348.081, "text": "就在几个月前", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 182, "start": 348.081, "end": 349.549, "text": "我这样一台4090的主机", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 183, "start": 349.549, "end": 351.684, "text": "我用它来部署qwen 3.6 27B", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 184, "start": 351.984, "end": 354.087, "text": "那个时候这个模型是给我带来了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 185, "start": 354.087, "end": 356.189, "text": "它确实给我带来了眼前一亮的感觉", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 186, "start": 356.189, "end": 357.657, "text": "它相当于一个转折点", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 187, "start": 357.724, "end": 360.159, "text": "就它越过了那条可用不可用的线", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 188, "start": 360.326, "end": 360.76, "text": "第一次", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 189, "start": 360.76, "end": 363.229, "text": "我是在一张消费级显卡上体会到", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 190, "start": 363.229, "end": 365.465, "text": "一个本地仅有27B的模型", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 191, "start": 365.465, "end": 366.799, "text": "居然能做那么多事情", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 192, "start": 366.999, "end": 368.501, "text": "那时候我记得Hermes Agent", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 193, "start": 368.601, "end": 369.635, "text": "也是刚出来没多久", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 194, "start": 369.669, "end": 370.737, "text": "我就用本地的Hermes", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 195, "start": 370.737, "end": 373.206, "text": "再搭配本地的qwen 3.6 27B这个模型", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 196, "start": 373.506, "end": 375.174, "text": "代替Codex做了好多事情", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 197, "start": 375.308, "end": 377.577, "text": "当然和Codex里面的GPT比起来", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 198, "start": 377.577, "end": 379.645, "text": "差距也是实打实的很明显的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 199, "start": 379.645, "end": 381.147, "text": "你用它来做一些本地的小任务", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 200, "start": 381.147, "end": 381.681, "text": "是没什么问题", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 201, "start": 381.781, "end": 383.85, "text": "但是一旦干那种长链任务", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 202, "start": 383.85, "end": 385.218, "text": "它干到一半还是会飘", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 203, "start": 385.318, "end": 386.652, "text": "如果你不开MTP的话", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 204, "start": 386.652, "end": 390.056, "text": "我记得一开始配好就有二三十token每秒", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 205, "start": 390.056, "end": 391.758, "text": "后来我是研究优化配置", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 206, "start": 391.758, "end": 392.792, "text": "然后又换框架", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 207, "start": 392.792, "end": 393.593, "text": "然后开了MTP", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 208, "start": 393.826, "end": 394.727, "text": "好的情况下", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 209, "start": 394.894, "end": 395.928, "text": "也就五六十", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 210, "start": 396.162, "end": 399.232, "text": "然后上下文是只能开到100K左右的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 211, "start": 399.298, "end": 401.2, "text": "然而仅仅过了不到半年", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 212, "start": 401.2, "end": 402.168, "text": "才4个月", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 213, "start": 402.368, "end": 404.203, "text": "现在qwen 3.8 27b出来", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 214, "start": 404.203, "end": 405.238, "text": "然后新的推理框架", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 215, "start": 405.238, "end": 406.239, "text": "比如说ninfer出来", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 216, "start": 406.439, "end": 409.041, "text": "llama.cpp也是迎来了很大的更新", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 217, "start": 409.308, "end": 410.877, "text": "现在基本是开箱即用", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 218, "start": 410.877, "end": 412.311, "text": "然后同样的显卡", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 219, "start": 412.345, "end": 414.48, "text": "我能优化到100多Token每秒", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 220, "start": 414.48, "end": 416.549, "text": "上下文也是开到256K", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 221, "start": 416.549, "end": 417.683, "text": "塞满也不会飘", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 222, "start": 417.784, "end": 419.051, "text": "这边可以加一个资料", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 223, "start": 419.085, "end": 420.486, "text": "最后就是我开头说的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 224, "start": 420.486, "end": 422.321, "text": "我要让qwen 3.8 27b 一把的NAS", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 225, "start": 422.388, "end": 424.757, "text": "改造成一个用memorybear的记忆库的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 226, "start": 424.757, "end": 425.491, "text": "这样一个任务", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 227, "start": 425.491, "end": 426.926, "text": "这个任务其实非常的复杂", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 228, "start": 426.926, "end": 427.927, "text": "要涉及到NAS", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 229, "start": 427.927, "end": 429.128, "text": "局域网云服务器", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 230, "start": 429.362, "end": 430.83, "text": "然后还有自制的Gateway等等", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 231, "start": 430.963, "end": 431.564, "text": "很多方面", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 232, "start": 431.697, "end": 433.232, "text": "以及涉及到NAS的隐私", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 233, "start": 433.232, "end": 434.233, "text": "还有安全性的问题", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 234, "start": 434.4, "end": 436.202, "text": "在整个部署的过程中的遇到问题", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 235, "start": 436.202, "end": 437.737, "text": "它还是要自主的去排查", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 236, "start": 437.737, "end": 438.604, "text": "还有搜索网络", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 237, "start": 438.771, "end": 440.106, "text": "像这样一个巨大的任务", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 238, "start": 440.106, "end": 441.04, "text": "我是用云端的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 239, "start": 441.04, "end": 443.176, "text": "qwen 3.8 Max和GPT", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 240, "start": 443.376, "end": 444.377, "text": "给它做了一个Plan", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 241, "start": 444.644, "end": 446.446, "text": "然后一旦我把Plan给到位了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 242, "start": 446.546, "end": 447.647, "text": "qwen 3.8 27b", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 243, "start": 447.647, "end": 450.416, "text": "它自己是能在后台工作好几个小时", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 244, "start": 450.416, "end": 452.919, "text": "而且完美的完成每一个中间phase", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 245, "start": 453.052, "end": 453.686, "text": "这样一个任务", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 246, "start": 453.686, "end": 455.388, "text": "我从头到尾没有开新session", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 247, "start": 455.388, "end": 456.622, "text": "就是截图里的这个", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 248, "start": 456.756, "end": 458.424, "text": "比如说连续三小时的长连任务", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 249, "start": 458.424, "end": 459.826, "text": "在之前好几个部署", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 250, "start": 459.892, "end": 461.661, "text": "也都是一小时两小时起步的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 251, "start": 461.661, "end": 462.228, "text": "在那之后", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 252, "start": 462.228, "end": 464.23, "text": "我也是又跑了好几个小时连续的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 253, "start": 464.33, "end": 466.232, "text": "我是直接把上下文开到256K", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 254, "start": 466.232, "end": 467.567, "text": "就随它跑随它压", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 255, "start": 467.567, "end": 469.001, "text": "几十轮上千步", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 256, "start": 469.068, "end": 470.002, "text": "完全不会飘", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 257, "start": 470.002, "end": 471.137, "text": "不会崩速度稳定", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 258, "start": 471.137, "end": 473.039, "text": "在大概90到100tokens每秒", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 259, "start": 473.172, "end": 474.607, "text": "就太离谱了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 260, "start": 474.607, "end": 475.675, "text": "太爽了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 261, "start": 475.741, "end": 476.209, "text": "题外话", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 262, "start": 476.209, "end": 478.077, "text": "我现在是把它放在Codex里面用的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 263, "start": 478.077, "end": 479.579, "text": "我觉得目前我用下来", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 264, "start": 479.579, "end": 481.18, "text": "是Codex是最好用的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 265, "start": 481.214, "end": 483.082, "text": "hermes agent做的还是好", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 266, "start": 483.082, "end": 483.783, "text": "很稳很稳", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 267, "start": 483.783, "end": 484.517, "text": "那么话说回来", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 268, "start": 484.517, "end": 485.384, "text": "这种级别的任务", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 269, "start": 485.384, "end": 486.786, "text": "如果你在四个月前", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 270, "start": 486.786, "end": 489.021, "text": "就qwen 3.6 27B那个时代", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 271, "start": 489.021, "end": 489.589, "text": "你跟我说", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 272, "start": 489.655, "end": 490.923, "text": "我们做个本地小模型", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 273, "start": 490.923, "end": 492.825, "text": "就3.6的下一代", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 274, "start": 492.825, "end": 493.86, "text": "就已经可以做到", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 275, "start": 493.86, "end": 496.095, "text": "自主推进好几个小时的任务", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 276, "start": 496.095, "end": 496.963, "text": "并且成功", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 277, "start": 496.963, "end": 499.098, "text": "那我会觉得你有幻觉了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 278, "start": 499.098, "end": 500.867, "text": "而且它任务完成的质量好", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 279, "start": 500.867, "end": 502.001, "text": "也不是我随口说说的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 280, "start": 502.001, "end": 503.803, "text": "就是你把它交给云端顶级模型", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 281, "start": 503.903, "end": 505.204, "text": "他们看了都说好", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 282, "start": 505.204, "end": 507.74, "text": "那么下一点就是关于API的稳定性", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 283, "start": 507.74, "end": 509.308, "text": "就为API万一炸了怎么办", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 284, "start": 509.308, "end": 510.71, "text": "这种事情不常发生", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 285, "start": 510.71, "end": 511.878, "text": "但是一旦发生了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 286, "start": 511.878, "end": 513.045, "text": "是真的要命的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 287, "start": 513.045, "end": 514.68, "text": "我自己也是经历过好几次了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 288, "start": 514.68, "end": 516.148, "text": "就是云端AI突然炸了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 289, "start": 516.148, "end": 516.782, "text": "连不上了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 290, "start": 516.883, "end": 518.551, "text": "就在我一边写这篇稿子", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 291, "start": 518.584, "end": 521.02, "text": "一边在推另外一个自动剪辑的任务的时候", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 292, "start": 521.287, "end": 522.288, "text": "OpenAI炸了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 293, "start": 522.288, "end": 524.19, "text": "它自己内部应该是在进行一个更新", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 294, "start": 524.19, "end": 525.625, "text": "反正就在好久都用不了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 295, "start": 525.691, "end": 528.227, "text": "包括我之前用OpenCode的时候也炸过", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 296, "start": 528.227, "end": 531.163, "text": "然后再用DeepSeek官方的API的时候也炸过", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 297, "start": 531.163, "end": 531.998, "text": "对于我个人而言", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 298, "start": 531.998, "end": 533.866, "text": "我现在大部分工作室没有AI", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 299, "start": 533.866, "end": 535.635, "text": "就完全没有办法推进了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 300, "start": 535.768, "end": 537.637, "text": "当然当OpenAI炸了的时候", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 301, "start": 537.703, "end": 539.605, "text": "DeepSeek不会说也同时炸了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 302, "start": 539.605, "end": 541.574, "text": "这种情况是很少发生的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 303, "start": 541.707, "end": 544.243, "text": "你完全可以切换到别的服务商去用", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 304, "start": 544.277, "end": 546.612, "text": "但是如果是你自己的网络炸了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 305, "start": 546.679, "end": 547.68, "text": "谁来替你排查", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 306, "start": 547.713, "end": 548.548, "text": "谁来替你干活", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 307, "start": 548.848, "end": 551.317, "text": "所以现在在本地有一个4090级别", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 308, "start": 551.317, "end": 553.819, "text": "再加上qwen 3.8 27b这个级别的算力", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 309, "start": 553.853, "end": 554.787, "text": "对于我个人而言", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 310, "start": 554.787, "end": 556.622, "text": "说是一个非常安心的保险", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 311, "start": 556.722, "end": 558.291, "text": "我知道就即便出了任何事情", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 312, "start": 558.357, "end": 560.159, "text": "只要不是整个世界都断电了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 313, "start": 560.159, "end": 561.794, "text": "我就还有一个算力可以用", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 314, "start": 561.794, "end": 562.929, "text": "最后再简单提一下", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 315, "start": 562.929, "end": 564.063, "text": "就很多朋友会关心的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 316, "start": 564.063, "end": 565.765, "text": "非常担心的部署的问题", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 317, "start": 565.932, "end": 568.367, "text": "大家可能会觉得本地模型是不是超级复杂", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 318, "start": 568.367, "end": 570.169, "text": "自己是不是要会编程才能玩", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 319, "start": 570.202, "end": 572.271, "text": "这些说实话都没有担心的必要了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 320, "start": 572.338, "end": 574.74, "text": "四个月前qwen 3.6的那个时代", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 321, "start": 574.74, "end": 576.842, "text": "我觉得确实是要一点动手能力的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 322, "start": 577.009, "end": 579.478, "text": "你自己要理解比较多的计算机基础的东西", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 323, "start": 579.478, "end": 581.347, "text": "因为那时候的大模型还有Agent", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 324, "start": 581.347, "end": 583.816, "text": "以及Harness都没有现在这么强的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 325, "start": 583.883, "end": 585.618, "text": "自主长链任务的能力", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 326, "start": 585.618, "end": 587.586, "text": "那时候你要配置VLLM什么的是真的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 327, "start": 587.586, "end": 589.555, "text": "我自己又进终端手搓的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 328, "start": 589.822, "end": 591.857, "text": "当然是和AI一边聊天", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 329, "start": 591.924, "end": 593.326, "text": "一边当Prompt的搬运工", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 330, "start": 593.559, "end": 595.661, "text": "但整个流程就是非常繁琐", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 331, "start": 595.661, "end": 597.196, "text": "要各种排错各种研究", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 332, "start": 597.196, "end": 598.831, "text": "而现在不管是用comfy UI", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 333, "start": 598.831, "end": 600.399, "text": "还是本地的语言大模型", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 334, "start": 600.399, "end": 602.101, "text": "你随便找个云端API", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 335, "start": 602.101, "end": 604.437, "text": "就比如说DeepSeek V4.1 Flash这种级别的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 336, "start": 604.437, "end": 605.304, "text": "再用hermes agent", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 337, "start": 605.371, "end": 606.339, "text": "你就让它给你配", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 338, "start": 606.672, "end": 608.307, "text": "两三句话的事情配好了", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 339, "start": 608.441, "end": 609.075, "text": "配置好之后", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 340, "start": 609.075, "end": 611.21, "text": "你就让它根据你的硬件去做测试", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 341, "start": 611.377, "end": 613.479, "text": "它顺时就能自己自主跑一整天", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 342, "start": 613.646, "end": 615.214, "text": "然后把你的硬件情况下", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 343, "start": 615.214, "end": 617.216, "text": "你最好的参数全都给你试出来", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 344, "start": 617.316, "end": 620.419, "text": "所以配置的门槛其实也是一直在下降的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 345, "start": 620.486, "end": 621.32, "text": "OK 最后", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 346, "start": 621.42, "end": 622.521, "text": "其实我想说的是", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 347, "start": 622.521, "end": 624.223, "text": "我并不认为每一个人", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 348, "start": 624.223, "end": 626.258, "text": "都需要去部署自己的本地大模型", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 349, "start": 626.459, "end": 628.461, "text": "我甚至不认为每个人都要去用AI", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 350, "start": 628.527, "end": 630.563, "text": "我也不认为每个人都要去用电脑", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 351, "start": 630.663, "end": 631.63, "text": "每个人都要去开车", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 352, "start": 631.797, "end": 633.332, "text": "大家都有自己的生活方式", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 353, "start": 633.332, "end": 634.8, "text": "你觉得怎么舒服怎么来", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 354, "start": 634.8, "end": 635.334, "text": "对吧", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 355, "start": 635.534, "end": 635.968, "text": "普通用户", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 356, "start": 636.068, "end": 637.103, "text": "你偶尔问几个问题", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 357, "start": 637.203, "end": 638.304, "text": "一天花个几万Token", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 358, "start": 638.404, "end": 640.506, "text": "你有必要为这件事情去买个显卡吗", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 359, "start": 640.706, "end": 641.507, "text": "不必吧", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 360, "start": 641.507, "end": 643.476, "text": "或者你是做公司的工作", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 361, "start": 643.476, "end": 644.877, "text": "你写代码虽然写的很多", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 362, "start": 644.877, "end": 646.912, "text": "但是你公司会给你报销API费用", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 363, "start": 646.912, "end": 648.914, "text": "或者给你买200美金一个月的Token plan", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 364, "start": 649.148, "end": 649.849, "text": "那也很爽", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 365, "start": 649.849, "end": 650.916, "text": "你也没有必要搞本地", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 366, "start": 651.083, "end": 653.085, "text": "本地AI它是一个拥有权", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 367, "start": 653.085, "end": 654.653, "text": "但同时也是一个取舍", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 368, "start": 654.653, "end": 655.821, "text": "是一种妥协", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 369, "start": 656.088, "end": 657.657, "text": "你要用一个更弱的模型", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 370, "start": 657.657, "end": 658.824, "text": "你要自己去部署", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 371, "start": 658.824, "end": 660.526, "text": "去维护麻烦的事情", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 372, "start": 660.76, "end": 661.927, "text": "它还很吵", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 373, "start": 662.061, "end": 662.828, "text": "噪音很大", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 374, "start": 662.828, "end": 663.996, "text": "还有放热", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 375, "start": 664.163, "end": 665.631, "text": "夏天的时候就是开着空调", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 376, "start": 665.664, "end": 667.9, "text": "你都会觉得房间里面有种桑拿的感觉", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 377, "start": 667.9, "end": 668.801, "text": "但是我个人", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 378, "start": 668.801, "end": 669.802, "text": "我所有的创作", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 379, "start": 669.802, "end": 670.936, "text": "包括我公司的管理", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 380, "start": 670.936, "end": 673.072, "text": "包括各种乱七八糟的杂物", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 381, "start": 673.172, "end": 674.707, "text": "全都是交给Agent去办的", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 382, "start": 674.707, "end": 676.208, "text": "所以本地算力对于我来说", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 383, "start": 676.208, "end": 678.377, "text": "是一个相当有必要的基础设施", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 384, "start": 678.544, "end": 679.845, "text": "对于你自己的用途人员", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 385, "start": 679.845, "end": 682.181, "text": "它也有可能是一个很合理的选择", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 386, "start": 682.181, "end": 683.249, "text": "而最后的最后", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 387, "start": 683.249, "end": 683.916, "text": "我想说的是", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 388, "start": 683.916, "end": 685.751, "text": "所有事情都是图个开心而已", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 389, "start": 685.818, "end": 687.386, "text": "本地部署一个AI大模型", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 390, "start": 687.386, "end": 688.421, "text": "对于我个人来说", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 391, "start": 688.421, "end": 690.523, "text": "是一个非常让我开心", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 392, "start": 690.523, "end": 692.091, "text": "让我觉得非常好玩的事情", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 393, "start": 692.091, "end": 693.359, "text": "就跟自己装电脑", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 394, "start": 693.359, "end": 694.86, "text": "或者说自己修车一样", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 395, "start": 694.96, "end": 697.496, "text": "我自己折腾的每分每秒都是在享受", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 396, "start": 697.697, "end": 699.031, "text": "所以如果你喜欢类似的话题", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 397, "start": 699.031, "end": 700.166, "text": "有空欢迎再来听我唠嗑", "source": "video_source_subtitle", "authority": "video_source_subtitle" }, { "id": 398, "start": 700.166, "end": 700.933, "text": "我们下期再见", "source": "video_source_subtitle", "authority": "video_source_subtitle" } ], "transcript_selection": { "schema": "videonote.transcript_selection.v1", "status": "SELECTED", "requested_language": "zh", "duration": 701.0, "reference_path": "/Users/sagawa/AI_WORK/video_notes/url/20260927_230505__云端AI已经这么强了_我为什么还要跑本地模型_拥有自己的算力的体验/reference_subtitle.vtt", "reference_kind": "manual", "reference_language": "zh", "selected_source": "video_source_subtitle", "source_caption_kind": "manual", "source_caption_processing": "verbatim_direct", "youtube_overlap_clamps": [], "general_high_confidence_repairs": [], "decision_reason": "complete_source_subtitle_fast_path_no_whisper", "whisper_rejected": false, "source_profile": { "segment_count": 399, "duration_coverage": 0.968016 } } }