{ "text": "本地大模型到底能不能打?你看哈,我的這個文件夾有70多個文件。非常的凌亂,在Deepseek Harness裡面,我送出了提示詞。不一會兒,四個文件夾建好了,文件全部歸類整齊,還生成了一份整理報告。從我發出命令到結束全部的任務,我沒有碰過一次鍵盤。這個就是千萬3.827B,這個部署在我電腦本地的大模型。和Deepseek Harness配合起來的效果,都是本地哈,網線你都不用插,純純的國內生態,零費用。所以說,到底本地大模型是否有一個大模型?\n能不能幹活?我們的電腦帶不帶的動?本地模型能幹哪些事?不著急哈,今天都給你答案。又是手把手的教程,點好收藏與關注,我們這就發車。\n你如果用Codex,Code,Code,這些雲端Agent就繞不開幾個問題。價格高,本地讀寫麻煩,隱私不能被保護,還可能被封號。而千萬呢,剛剛推出了3.827B,這個本地大模型。\n但是直接跑在你的電腦上的,上面所有的問題就解決了。雲端大模型呢,咱們只能租用,本地的才是完全屬於你。\n不過本地模型啊,吃硬件,對於普通人來說呢,安裝還有門檻。速度和智力呢,肯定也比雲端的主流模型可能要弱一點。\n那今天咱們就來看一下哈,這套組合到底能不能打?\n今天內容有點長啊,而且呢,建議有時間的時候慢慢看,最好是一步一步的跟著做。\n咱第一步呢,需要下載模型。\n我們打開摩搭社區,都不用搜哈,在主頁上就能看到千萬3.8了。\n如果沒有的話呢,你也可以點這個放大鏡,直接搜的到。\n這個呢,你可以理解為是原廠原裝的模型,大概有50多G。\n所以硬件的要求啊,特別的高,咱普通的家用電腦,咱就不要想了。\n不過呢,社區的大神多哈,下面能看到一個後墜GGUF的。\n這個GGUF呢,是大模型的一種壓縮包裝格式,類似於像音樂文件一樣的。\n官方的50G的版本呢,就等於是無損母帶WAV格式。\n一首歌呀,幾十兆上百兆都很正常。\n這個GGUF壓縮之後呢,就像是MP3了。\n一首歌呢,也就是3、5兆的體積。\n常人呢,還一般都聽不出來音質有什麼區別。\n這個作者有點厲害哈,可以說是全世界做模型量化。\n最出名的。光是這一個模型的倉庫,一個月的下載量就有700多萬次。\n基本上呢,是家用電腦最適合的選擇了。\n在模型文件這個裡面,你能看到一大堆的模型清單。\n有幾個G的,還有幾十個G的都有。\n選擇也不難哈,咱們簡單粗暴的理解,你顯存多少個G,\n基本上呢,就是選多少G的模型。\n但注意哈,一定要留一定的餘量。\n因為你運行的時候呢,還會有上下文緩存這樣的一些開銷。\n我是16G的5060Ti,咱保守一點哈。\n我就選這個13G的Q3版本。\n當然呢,選16G的Q4,它也不是不能跑,只是速度呢,會慢一點。\n你可以多下幾個版本來自己比較一下。\n大模型只是腦子哈,要跑起來呢,還需要一個容器。\n趁它在下載的時候啊,咱們再給它安裝一套運行環境。\n前幾天,Deep-seek Harness不是才開源了嗎?\n今天咱們就用它。\n主頁上是它的主張,一切皆插件。\n安裝也不難哈,提示也是說一鍵使用。\n不過有一個前提,你的電腦必須有依賴的環境。\n它需要一個叫做Node.js的環境。\n但不用管它是幹嘛的哈。\n打開它的主頁,點這個綠色的按鈕,下載對應的版本。\n安裝呢,就是下一步下一步的事。\n這些具體的過程呢,我都會放到配套的文檔裡面。\n如果說你以前用過別的Aten的工具啊,大概率Node.js是你部署過的。\n這一步呢,就可以省略了。\n我們按下Wn加R這個快接鍵,輸入CMD,回車。\n彈出來一個黑乎乎的窗口,這個呢叫做終端。\n你啥都不用管哈,在Harness的主頁上,點這個複製按鈕。\n到終端裡面,Ctrl加V粘貼上,然後回車。\n按照提示,輸入字母Y,再回車。\n下面這個滾動起來,就表示已經開始安裝了。\n由於它可能會下載很多的東西,需要多等待一會兒。\n好了,這個時候呢,安裝結束了。\n它自動彈出了瀏覽器。\n如果說你的沒有彈出呢,你就把這一行地址,複製到你的瀏覽器。\n就OK,封面就有內側聲明,表示啊,這個產品還在測試階段。\n展開之後呢,還會提示你輸入Deep-seek的API-key。\n由於我們今天用的是本地大模型,所以這一步呢,就跳過就好。\n看到了這個黑鯊魚,咱們就算是正式的進入到了Deep-seek Harness的內部了。\n這會兒呢,仍然還用不了,因為Harness本身它不能直接的裝入一個本地模型。\n只能通過兼容OpenAI的API方式來調用。\n所以說我們還需要一個工具,把這個模型給它跑起來。\n這個工具呢,叫做Lama.CPP。\n現在非常火的什麼Olama呀,LM Studio啊,這些引擎啊,底層用的也都是它。\n打開它的地址,點開這裡,把頁面往下拉,找到符合你的操作系統和顯卡的版本,下載到本地。\n因為我是Windows系統哈,顯卡是50系的。\n所以我下載COODA13這個版本。\n如果你是稍微老一點的,什麼30系40系的顯卡,就要選COODA12這個版本了。\n文件不大,只有140Mbps。\n下載完呢,是一個壓縮包。\n解壓不用安裝。\n我的i盤是一個固態硬盤。\n在這裡呢,我新建了一個MODE文件夾。\n把Lama和剛才下載好的CENW3.8全部都放到了這個裡面。\n我也強烈的建議啊,你們也要放到固態硬盤裡。\n盡量啊,不要放機械硬盤,速度呢才會更快。\n就在這個文件夾裡,我們點擊鼠標的右鍵,選擇在終端中打開。\n咱們輸入這樣的一條命令。\n這個命令呢,我也會放到文檔裡哈。\n大概意思呢,就是告訴系統。\n把這個模型交給引擎。\n而且盡量把模型層放進顯卡。\n然後在本機的8080端口開一個接口,等著別的程序來調用它。\n回車之後呢,能看到它開始滾動了。\n直到你能看到一行127打頭的地址,就表示已經啟動好了。\n你可以按住鍵盤上的Ctrl鍵,點擊這個地址。\n它就會自動的打開你的默認瀏覽器。\n輸入一個你好,如果說它能回覆的話,說明大模型已經啟動成功了。\n好了,到這兒啊,冰箱門都打開了。\n最後一步,咱就是把大象放進去了。\n注意哈,剛才那個終端啊,這個時候是不能關的。\n你關了,大模型的服務就停了哈。\n以後你重新要打開Harness的話呢,不需要重新安裝。\n在終端裡頭,輸入這個命令。\n在Harness的頁面,咱們進入設置,模型,添加自定義提供方。\n你可以照著我來填哈。\n第一個框呢,必須是小寫字母開頭。\n顯示名稱,可以取一個你自己記得住的名字。\nAPI地址呢,就是剛才那個後綴是8080的那一段。\n但是後面啊,一定要有一個斜槓V1。\nAPI協議保持不變,密要,由於我們是本地模型哈。\n所以說就隨便填了,咱就敲了三個1。\n點一下獲取可用模型,就能看到咱們的千問3.8了。\n點下面的創建提供方,這就添加成功了。\n回到Harness主頁,這個時候呢,你還選不了模型,必須還有添加工作區。\n添加好了之後啊,就可以選擇模型了。\n趙莉,咱發一個你好,第一次可能想應慢一點。\n能看到它的回复,咱今天就算是全部的大功告成了。\n能回你好,不算本事啊,得看它能不能幹活。\n我們先看一個最直觀的例子。\n這個文件夾裡面有77個凌亂的文件,什麼格式都有。\n文件名也很亂。\n如果你的文件夾也這樣,按摩走一波。\n手動整理啊,當然很麻煩了。\n我在Harness裡面,按摩了這個文件夾。\n提示詞是這麼寫的。\n我送出命令之後啊,能看到它開始先列舉文件,統計文件數量。\n然後挨個的查看文件內容,匯報77個文件清理好了,準備分類。\n等到13分鐘的時候,終於看到幾個文件夾出現了。\n根下呢,還有一個report和復盤。看來根下兩個文件是臨時文件。\n它又把它清理掉了。22分鐘左右,整理報告終於出來了。\n你覺得這份報告寫的詳細嗎?\n我們的這個任務一共花了20多分鐘。這個時間還是有點久。\n當然呢,這個只是參考。\n畢竟呢,是它第一次跑任務。\n可能啊,有些環境啊工具啊還不具備。\n而且呢,我的後臺開著很多的agent,還有陸皮軟件啊這些,都會有一定的影響。\n都免費了,還要啥自行車呀?\n你的硬件不同,任務不同,當然可以自己去測。\n剛才呢,只是文件的整理。它能幹的事兒啊,遠遠不止這些。\n通常呢,有幾個共同的特點。\n處理大量的本地文件,規則相對明確,反覆發聲,還有一定的隱私性。\n我提煉了三大類,你可以來對號入座。\n第一類呢,是高頻任務,像什麼清理文件啊,給筆記打標圈啊,寫摘要啊這些。\n第二類呢,隱私,敏感型的任務。\n像是你的個人日記啊,商務文件啊,這些你當然不想上傳到雲端了。\n還有就是,常駐後台型的任務。\n比如說呢,你讓它監聽某一個文件家,一旦發生變化,就觸發任務。\n你可以不用每次都打開對話框,重新的下命令,它自己就能搞定了。\n感謝你能看到這裡啊,總的來說呢,只要你的硬件跑得動,這套模式呢,它是能幹活的。\n但是本地大模型呢,它不是雲端Agent的平替。\n雲端模型呢,負責最難的判斷,本地模型呢,負責長期的執行。\n兩邊都有用。\n我們今天不僅是部署了一套模型,更是搭建了一套本地的AI系統。\n以後啊,換掉簽文,換掉Harness,你的本地的上下文,永遠都在。\n和往常一樣的,今天用到的全部的下載地址而運行命令。\n還有這次案例的完整提示詞,所有資料我也都打包好了。\n需要的同學,評論區提我。\n我是船長,讓我們下期再見,拜拜。", "language": "zh", "duration": 576.783688, "segments": [ { "id": 0, "seek": 0, "start": 0.0, "end": 29.98, "text": "本地大模型到底能不能打?你看哈,我的這個文件夾有70多個文件。非常的凌亂,在Deepseek Harness裡面,我送出了提示詞。不一會兒,四個文件夾建好了,文件全部歸類整齊,還生成了一份整理報告。從我發出命令到結束全部的任務,我沒有碰過一次鍵盤。這個就是千萬3.827B,這個部署在我電腦本地的大模型。和Deepseek Harness配合起來的效果,都是本地哈,網線你都不用插,純純的國內生態,零費用。所以說,到底本地大模型是否有一個大模型?", "tokens": [ 50365, 8802, 10928, 3582, 41908, 39823, 33883, 8225, 28590, 12467, 30, 16529, 10595, 11, 14200, 6287, 17174, 20485, 1787, 122, 2412, 5867, 6392, 3338, 17174, 20485, 1543, 48263, 6336, 234, 1369, 224, 11, 3581, 11089, 595, 405, 916, 389, 16937, 32399, 11, 1654, 29309, 7781, 2289, 20949, 25696, 6716, 252, 1543, 1960, 2257, 6236, 35125, 11, 19425, 3338, 17174, 20485, 1787, 122, 34157, 12621, 11, 17174, 20485, 38714, 4287, 116, 40092, 27662, 44628, 232, 11, 7824, 8244, 11336, 2289, 2257, 36266, 27662, 13876, 17803, 16846, 1543, 21068, 1654, 14637, 7781, 25236, 49061, 4511, 17144, 44320, 38714, 1546, 26443, 39517, 11, 1654, 6963, 16337, 108, 8816, 27505, 41668, 113, 5419, 97, 1543, 6287, 5620, 20787, 14099, 18, 13, 23, 10076, 33, 11, 6287, 13470, 16469, 110, 3581, 1654, 20545, 21184, 99, 8802, 10928, 1546, 3582, 41908, 39823, 1543, 12565, 11089, 595, 405, 916, 389, 16937, 38846, 14245, 21670, 1546, 43076, 9319, 11, 22796, 8802, 10928, 10595, 11, 26352, 31699, 2166, 7182, 24384, 11673, 240, 11, 7732, 242, 7732, 242, 1546, 8053, 28472, 8244, 45248, 11, 6306, 114, 50071, 9254, 1543, 7239, 4622, 11, 33883, 8802, 10928, 3582, 41908, 39823, 1541, 45334, 2412, 8990, 3582, 41908, 39823, 30, 51864 ], "temperature": 0, "avg_logprob": -0.2080727198615146, "compression_ratio": 1.3870967741935485, "no_speech_prob": 1.0434302727402311e-11, "source": "whisper" }, { "id": 1, "seek": 2998, "start": 29.98, "end": 40.28, "text": "能不能幹活?我們的電腦帶不帶的動?本地模型能幹哪些事?不著急哈,今天都給你答案。又是手把手的教程,點好收藏與關注,我們這就發車。", "tokens": [ 50365, 8225, 28590, 29932, 25956, 30, 33641, 20545, 21184, 99, 32379, 1960, 32379, 1546, 12572, 30, 8802, 10928, 41908, 39823, 8225, 29932, 17028, 13824, 6973, 30, 1960, 19382, 36379, 10595, 11, 12074, 7182, 17798, 2166, 28223, 28899, 1543, 17047, 1541, 11389, 16075, 11389, 1546, 21936, 29649, 11, 8216, 2131, 18681, 21782, 237, 34127, 14899, 26432, 11, 5884, 2664, 3111, 14637, 25941, 1543, 50880 ], "temperature": 0, "avg_logprob": -0.17875934782482328, "compression_ratio": 1.2158730158730158, "no_speech_prob": 1.4677899520809667e-11, "source": "whisper" }, { "id": 2, "seek": 2998, "start": 43.6, "end": 56.1, "text": "你如果用Codex,Code,Code,這些雲端Agent就繞不開幾個問題。價格高,本地讀寫麻煩,隱私不能被保護,還可能被封號。而千萬呢,剛剛推出了3.827B,這個本地大模型。", "tokens": [ 51046, 2166, 13119, 9254, 34, 1429, 87, 11, 34, 1429, 11, 34, 1429, 11, 29869, 6306, 110, 11957, 107, 32, 6930, 3111, 23141, 252, 1960, 8949, 23575, 3338, 17197, 1543, 45441, 30921, 12979, 11, 8802, 10928, 7422, 222, 4510, 104, 38999, 17867, 102, 11, 10673, 109, 20083, 28590, 23238, 24302, 48289, 11, 7824, 16657, 23238, 1530, 223, 18616, 1543, 11070, 20787, 14099, 6240, 11, 32795, 33597, 7781, 2289, 18, 13, 23, 10076, 33, 11, 6287, 8802, 10928, 3582, 41908, 39823, 1543, 51671 ], "temperature": 0, "avg_logprob": -0.17875934782482328, "compression_ratio": 1.2158730158730158, "no_speech_prob": 1.4677899520809667e-11, "source": "whisper" }, { "id": 3, "seek": 5610, "start": 56.1, "end": 63.6, "text": "但是直接跑在你的電腦上的,上面所有的問題就解決了。雲端大模型呢,咱們只能租用,本地的才是完全屬於你。", "tokens": [ 50365, 11189, 43297, 32585, 3581, 18961, 20545, 21184, 99, 5708, 1546, 11, 49750, 39300, 1546, 17197, 3111, 17278, 33540, 2289, 1543, 6306, 110, 11957, 107, 3582, 41908, 39823, 6240, 11, 8975, 109, 4623, 14003, 8225, 8204, 253, 9254, 11, 8802, 10928, 1546, 18888, 1541, 37100, 9636, 105, 19488, 2166, 1543, 50740 ], "temperature": 0, "avg_logprob": -0.12022918608130478, "compression_ratio": 1.3439306358381502, "no_speech_prob": 1.478636137142164e-11, "source": "whisper" }, { "id": 4, "seek": 5610, "start": 63.6, "end": 71.68, "text": "不過本地模型啊,吃硬件,對於普通人來說呢,安裝還有門檻。速度和智力呢,肯定也比雲端的主流模型可能要弱一點。", "tokens": [ 50740, 28193, 8802, 10928, 41908, 39823, 4905, 11, 10123, 38114, 105, 20485, 11, 2855, 19488, 29993, 19550, 4035, 36979, 6240, 11, 16206, 44453, 15569, 37232, 162, 33411, 1543, 31217, 13127, 12565, 5094, 118, 13486, 6240, 11, 14356, 107, 12088, 6404, 11706, 6306, 110, 11957, 107, 1546, 13557, 27854, 41908, 39823, 16657, 4275, 5702, 109, 19202, 1543, 51144 ], "temperature": 0, "avg_logprob": -0.12022918608130478, "compression_ratio": 1.3439306358381502, "no_speech_prob": 1.478636137142164e-11, "source": "whisper" }, { "id": 5, "seek": 5610, "start": 71.68, "end": 74.78, "text": "那今天咱們就來看一下哈,這套組合到底能不能打?", "tokens": [ 51144, 4184, 12074, 8975, 109, 4623, 3111, 3763, 28324, 10595, 11, 2664, 1881, 245, 30052, 14245, 33883, 8225, 28590, 12467, 30, 51299 ], "temperature": 0, "avg_logprob": -0.12022918608130478, "compression_ratio": 1.3439306358381502, "no_speech_prob": 1.478636137142164e-11, "source": "whisper" }, { "id": 6, "seek": 5610, "start": 74.78, "end": 80.1, "text": "今天內容有點長啊,而且呢,建議有時間的時候慢慢看,最好是一步一步的跟著做。", "tokens": [ 51299, 12074, 28472, 25750, 42440, 15353, 4905, 11, 22942, 6240, 11, 34157, 24686, 2412, 20788, 20643, 41439, 4200, 11, 8661, 2131, 1541, 2257, 31429, 2257, 31429, 1546, 9678, 19382, 10907, 1543, 51565 ], "temperature": 0, "avg_logprob": -0.12022918608130478, "compression_ratio": 1.3439306358381502, "no_speech_prob": 1.478636137142164e-11, "source": "whisper" }, { "id": 7, "seek": 8010, "start": 80.1, "end": 82.1, "text": "咱第一步呢,需要下載模型。", "tokens": [ 50365, 8975, 109, 18049, 31429, 6240, 11, 35748, 4438, 12290, 231, 41908, 39823, 1543, 50465 ], "temperature": 0, "avg_logprob": -0.158823116009052, "compression_ratio": 1.2338129496402879, "no_speech_prob": 1.739496741093305e-11, "source": "whisper" }, { "id": 8, "seek": 8010, "start": 86.1, "end": 90.6, "text": "我們打開摩搭社區,都不用搜哈,在主頁上就能看到千萬3.8了。", "tokens": [ 50665, 5884, 12467, 8949, 34783, 102, 22220, 255, 27658, 44526, 11, 7182, 24384, 162, 14987, 10595, 11, 3581, 13557, 8313, 223, 5708, 3111, 8225, 18032, 20787, 14099, 18, 13, 23, 2289, 1543, 50890 ], "temperature": 0, "avg_logprob": -0.158823116009052, "compression_ratio": 1.2338129496402879, "no_speech_prob": 1.739496741093305e-11, "source": "whisper" }, { "id": 9, "seek": 8010, "start": 90.6, "end": 93.6, "text": "如果沒有的話呢,你也可以點這個放大鏡,直接搜的到。", "tokens": [ 50890, 13119, 6963, 21358, 6240, 11, 2166, 47935, 8216, 6287, 12744, 3582, 46241, 94, 11, 43297, 162, 14987, 1546, 4511, 1543, 51040 ], "temperature": 0, "avg_logprob": -0.158823116009052, "compression_ratio": 1.2338129496402879, "no_speech_prob": 1.739496741093305e-11, "source": "whisper" }, { "id": 10, "seek": 8010, "start": 93.6, "end": 97.6, "text": "這個呢,你可以理解為是原廠原裝的模型,大概有50多G。", "tokens": [ 51040, 6287, 6240, 11, 42766, 13876, 17278, 6344, 1541, 19683, 17527, 254, 19683, 44453, 1546, 41908, 39823, 11, 32044, 2412, 2803, 6392, 38, 1543, 51240 ], "temperature": 0, "avg_logprob": -0.158823116009052, "compression_ratio": 1.2338129496402879, "no_speech_prob": 1.739496741093305e-11, "source": "whisper" }, { "id": 11, "seek": 8010, "start": 97.6, "end": 101.6, "text": "所以硬件的要求啊,特別的高,咱普通的家用電腦,咱就不要想了。", "tokens": [ 51240, 7239, 38114, 105, 20485, 1546, 4275, 32718, 4905, 11, 38446, 1546, 12979, 11, 8975, 109, 29993, 19550, 1546, 5155, 9254, 20545, 21184, 99, 11, 8975, 109, 3111, 11962, 7093, 2289, 1543, 51440 ], "temperature": 0, "avg_logprob": -0.158823116009052, "compression_ratio": 1.2338129496402879, "no_speech_prob": 1.739496741093305e-11, "source": "whisper" }, { "id": 12, "seek": 10160, "start": 101.6, "end": 106.6, "text": "不過呢,社區的大神多哈,下面能看到一個後墜GGUF的。", "tokens": [ 50365, 28193, 6240, 11, 27658, 44526, 1546, 3582, 20432, 6392, 10595, 11, 47150, 8225, 18032, 8990, 5661, 24228, 250, 27561, 52, 37, 1546, 1543, 50615 ], "temperature": 0, "avg_logprob": -0.11114185087142452, "compression_ratio": 1.347457627118644, "no_speech_prob": 2.0818251636467444e-11, "source": "whisper" }, { "id": 13, "seek": 10160, "start": 106.6, "end": 112.1, "text": "這個GGUF呢,是大模型的一種壓縮包裝格式,類似於像音樂文件一樣的。", "tokens": [ 50615, 6287, 27561, 52, 37, 6240, 11, 1541, 3582, 41908, 39823, 1546, 2257, 16516, 45964, 21030, 106, 23305, 44453, 30921, 27584, 11, 40092, 7384, 120, 19488, 12760, 18034, 34043, 17174, 20485, 22977, 1546, 1543, 50890 ], "temperature": 0, "avg_logprob": -0.11114185087142452, "compression_ratio": 1.347457627118644, "no_speech_prob": 2.0818251636467444e-11, "source": "whisper" }, { "id": 14, "seek": 10160, "start": 112.1, "end": 116.1, "text": "官方的50G的版本呢,就等於是無損母帶WAV格式。", "tokens": [ 50890, 31929, 9249, 1546, 2803, 38, 1546, 42096, 8802, 6240, 11, 3111, 10187, 19488, 1541, 16976, 22220, 235, 35744, 32379, 21449, 53, 30921, 27584, 1543, 51090 ], "temperature": 0, "avg_logprob": -0.11114185087142452, "compression_ratio": 1.347457627118644, "no_speech_prob": 2.0818251636467444e-11, "source": "whisper" }, { "id": 15, "seek": 10160, "start": 116.1, "end": 119.1, "text": "一首歌呀,幾十兆上百兆都很正常。", "tokens": [ 51090, 2257, 25444, 29582, 15348, 11, 23575, 20145, 2347, 228, 5708, 31906, 2347, 228, 7182, 4563, 15789, 11279, 1543, 51240 ], "temperature": 0, "avg_logprob": -0.11114185087142452, "compression_ratio": 1.347457627118644, "no_speech_prob": 2.0818251636467444e-11, "source": "whisper" }, { "id": 16, "seek": 10160, "start": 119.1, "end": 122.1, "text": "這個GGUF壓縮之後呢,就像是MP3了。", "tokens": [ 51240, 6287, 27561, 52, 37, 45964, 21030, 106, 26362, 6240, 11, 3111, 12760, 1541, 12224, 18, 2289, 1543, 51390 ], "temperature": 0, "avg_logprob": -0.11114185087142452, "compression_ratio": 1.347457627118644, "no_speech_prob": 2.0818251636467444e-11, "source": "whisper" }, { "id": 17, "seek": 10160, "start": 122.1, "end": 124.1, "text": "一首歌呢,也就是3、5兆的體積。", "tokens": [ 51390, 2257, 25444, 29582, 6240, 11, 6404, 5620, 18, 1231, 20, 2347, 228, 1546, 23987, 13740, 235, 1543, 51490 ], "temperature": 0, "avg_logprob": -0.11114185087142452, "compression_ratio": 1.347457627118644, "no_speech_prob": 2.0818251636467444e-11, "source": "whisper" }, { "id": 18, "seek": 10160, "start": 124.1, "end": 127.1, "text": "常人呢,還一般都聽不出來音質有什麼區別。", "tokens": [ 51490, 11279, 4035, 6240, 11, 7824, 2257, 49640, 7182, 21524, 1960, 29741, 18034, 43450, 2412, 7598, 44526, 16158, 1543, 51640 ], "temperature": 0, "avg_logprob": -0.11114185087142452, "compression_ratio": 1.347457627118644, "no_speech_prob": 2.0818251636467444e-11, "source": "whisper" }, { "id": 19, "seek": 10160, "start": 127.1, "end": 131.1, "text": "這個作者有點厲害哈,可以說是全世界做模型量化。", "tokens": [ 51640, 6287, 11914, 12444, 42440, 20939, 10595, 11, 6723, 4622, 1541, 11319, 24486, 10907, 41908, 39823, 26748, 23756, 1543, 51840 ], "temperature": 0, "avg_logprob": -0.11114185087142452, "compression_ratio": 1.347457627118644, "no_speech_prob": 2.0818251636467444e-11, "source": "whisper" }, { "id": 20, "seek": 13110, "start": 131.1, "end": 136.6, "text": "最出名的。光是這一個模型的倉庫,一個月的下載量就有700多萬次。", "tokens": [ 50365, 8661, 7781, 15940, 1546, 1543, 20690, 1541, 2664, 8990, 41908, 39823, 1546, 2122, 231, 6346, 104, 11, 8990, 6939, 1546, 4438, 12290, 231, 26748, 3111, 2412, 18197, 6392, 14099, 9487, 1543, 50640 ], "temperature": 0, "avg_logprob": -0.1133213141025641, "compression_ratio": 1.4021739130434783, "no_speech_prob": 1.7781935646166147e-11, "source": "whisper" }, { "id": 21, "seek": 13110, "start": 136.6, "end": 139.6, "text": "基本上呢,是家用電腦最適合的選擇了。", "tokens": [ 50640, 37946, 5708, 6240, 11, 1541, 5155, 9254, 20545, 21184, 99, 8661, 3330, 102, 14245, 1546, 21625, 13167, 229, 2289, 1543, 50790 ], "temperature": 0, "avg_logprob": -0.1133213141025641, "compression_ratio": 1.4021739130434783, "no_speech_prob": 1.7781935646166147e-11, "source": "whisper" }, { "id": 22, "seek": 13110, "start": 139.6, "end": 143.1, "text": "在模型文件這個裡面,你能看到一大堆的模型清單。", "tokens": [ 50790, 3581, 41908, 39823, 17174, 20485, 6287, 32399, 11, 2166, 8225, 18032, 2257, 3582, 10726, 228, 1546, 41908, 39823, 21784, 24227, 1543, 50965 ], "temperature": 0, "avg_logprob": -0.1133213141025641, "compression_ratio": 1.4021739130434783, "no_speech_prob": 1.7781935646166147e-11, "source": "whisper" }, { "id": 23, "seek": 13110, "start": 143.1, "end": 145.6, "text": "有幾個G的,還有幾十個G的都有。", "tokens": [ 50965, 2412, 23575, 3338, 38, 1546, 11, 15569, 23575, 20145, 3338, 38, 1546, 48121, 1543, 51090 ], "temperature": 0, "avg_logprob": -0.1133213141025641, "compression_ratio": 1.4021739130434783, "no_speech_prob": 1.7781935646166147e-11, "source": "whisper" }, { "id": 24, "seek": 13110, "start": 145.6, "end": 149.1, "text": "選擇也不難哈,咱們簡單粗暴的理解,你顯存多少個G,", "tokens": [ 51090, 21625, 13167, 229, 6404, 1960, 21192, 10595, 11, 8975, 109, 4623, 31995, 18393, 245, 23826, 112, 1546, 13876, 17278, 11, 2166, 46605, 39781, 41492, 3338, 38, 11, 51265 ], "temperature": 0, "avg_logprob": -0.1133213141025641, "compression_ratio": 1.4021739130434783, "no_speech_prob": 1.7781935646166147e-11, "source": "whisper" }, { "id": 25, "seek": 13110, "start": 149.1, "end": 151.1, "text": "基本上呢,就是選多少G的模型。", "tokens": [ 51265, 37946, 5708, 6240, 11, 5620, 21625, 41492, 38, 1546, 41908, 39823, 1543, 51365 ], "temperature": 0, "avg_logprob": -0.1133213141025641, "compression_ratio": 1.4021739130434783, "no_speech_prob": 1.7781935646166147e-11, "source": "whisper" }, { "id": 26, "seek": 13110, "start": 151.1, "end": 153.6, "text": "但注意哈,一定要留一定的餘量。", "tokens": [ 51365, 8395, 40794, 10595, 11, 48161, 24456, 24272, 1546, 22217, 246, 26748, 1543, 51490 ], "temperature": 0, "avg_logprob": -0.1133213141025641, "compression_ratio": 1.4021739130434783, "no_speech_prob": 1.7781935646166147e-11, "source": "whisper" }, { "id": 27, "seek": 13110, "start": 153.6, "end": 157.6, "text": "因為你運行的時候呢,還會有上下文緩存這樣的一些開銷。", "tokens": [ 51490, 11471, 2166, 32772, 8082, 20643, 6240, 11, 7824, 6236, 2412, 5708, 4438, 17174, 12608, 102, 39781, 39425, 38515, 8949, 42041, 115, 1543, 51690 ], "temperature": 0, "avg_logprob": -0.1133213141025641, "compression_ratio": 1.4021739130434783, "no_speech_prob": 1.7781935646166147e-11, "source": "whisper" }, { "id": 28, "seek": 13110, "start": 157.6, "end": 160.6, "text": "我是16G的5060Ti,咱保守一點哈。", "tokens": [ 51690, 15914, 6866, 38, 1546, 2803, 4550, 51, 72, 11, 8975, 109, 24302, 48480, 19202, 10595, 1543, 51840 ], "temperature": 0, "avg_logprob": -0.1133213141025641, "compression_ratio": 1.4021739130434783, "no_speech_prob": 1.7781935646166147e-11, "source": "whisper" }, { "id": 29, "seek": 16060, "start": 160.6, "end": 163.6, "text": "我就選這個13G的Q3版本。", "tokens": [ 50365, 22020, 21625, 6287, 7668, 38, 1546, 48, 18, 42096, 8802, 1543, 50515 ], "temperature": 0, "avg_logprob": -0.15276094872181809, "compression_ratio": 1.1515151515151516, "no_speech_prob": 2.0068738337819525e-11, "source": "whisper" }, { "id": 30, "seek": 16060, "start": 163.6, "end": 167.6, "text": "當然呢,選16G的Q4,它也不是不能跑,只是速度呢,會慢一點。", "tokens": [ 50515, 21707, 6240, 11, 21625, 6866, 38, 1546, 48, 19, 11, 11284, 6404, 7296, 28590, 32585, 11, 36859, 31217, 13127, 6240, 11, 6236, 20645, 19202, 1543, 50715 ], "temperature": 0, "avg_logprob": -0.15276094872181809, "compression_ratio": 1.1515151515151516, "no_speech_prob": 2.0068738337819525e-11, "source": "whisper" }, { "id": 31, "seek": 16060, "start": 167.6, "end": 170.1, "text": "你可以多下幾個版本來自己比較一下。", "tokens": [ 50715, 42766, 6392, 4438, 23575, 3338, 42096, 8802, 3763, 17645, 25174, 8861, 1543, 50840 ], "temperature": 0, "avg_logprob": -0.15276094872181809, "compression_ratio": 1.1515151515151516, "no_speech_prob": 2.0068738337819525e-11, "source": "whisper" }, { "id": 32, "seek": 16060, "start": 170.1, "end": 173.6, "text": "大模型只是腦子哈,要跑起來呢,還需要一個容器。", "tokens": [ 50840, 3582, 41908, 39823, 36859, 21184, 99, 7626, 10595, 11, 4275, 32585, 21670, 6240, 11, 7824, 35748, 8990, 25750, 34386, 1543, 51015 ], "temperature": 0, "avg_logprob": -0.15276094872181809, "compression_ratio": 1.1515151515151516, "no_speech_prob": 2.0068738337819525e-11, "source": "whisper" }, { "id": 33, "seek": 16060, "start": 173.6, "end": 177.1, "text": "趁它在下載的時候啊,咱們再給它安裝一套運行環境。", "tokens": [ 51015, 9759, 223, 11284, 3581, 4438, 12290, 231, 20643, 4905, 11, 8975, 109, 4623, 8623, 17798, 11284, 16206, 44453, 2257, 1881, 245, 32772, 8082, 40063, 108, 47885, 1543, 51190 ], "temperature": 0, "avg_logprob": -0.15276094872181809, "compression_ratio": 1.1515151515151516, "no_speech_prob": 2.0068738337819525e-11, "source": "whisper" }, { "id": 34, "seek": 16060, "start": 181.1, "end": 183.6, "text": "前幾天,Deep-seek Harness不是才開源了嗎?", "tokens": [ 51390, 8945, 23575, 6135, 11, 11089, 595, 12, 405, 916, 389, 16937, 7296, 18888, 8949, 47402, 2289, 7434, 30, 51515 ], "temperature": 0, "avg_logprob": -0.15276094872181809, "compression_ratio": 1.1515151515151516, "no_speech_prob": 2.0068738337819525e-11, "source": "whisper" }, { "id": 35, "seek": 18360, "start": 183.6, "end": 184.6, "text": "今天咱們就用它。", "tokens": [ 50365, 12074, 8975, 109, 4623, 3111, 9254, 11284, 1543, 50415 ], "temperature": 0, "avg_logprob": -0.108357275317529, "compression_ratio": 1.3364779874213837, "no_speech_prob": 2.2243722488934914e-11, "source": "whisper" }, { "id": 36, "seek": 18360, "start": 184.6, "end": 187.6, "text": "主頁上是它的主張,一切皆插件。", "tokens": [ 50415, 13557, 8313, 223, 5708, 1541, 45224, 13557, 18889, 11, 2257, 23632, 32056, 11673, 240, 20485, 1543, 50565 ], "temperature": 0, "avg_logprob": -0.108357275317529, "compression_ratio": 1.3364779874213837, "no_speech_prob": 2.2243722488934914e-11, "source": "whisper" }, { "id": 37, "seek": 18360, "start": 187.6, "end": 190.6, "text": "安裝也不難哈,提示也是說一鍵使用。", "tokens": [ 50565, 16206, 44453, 6404, 1960, 21192, 10595, 11, 20949, 25696, 22021, 4622, 2257, 41668, 113, 22982, 9254, 1543, 50715 ], "temperature": 0, "avg_logprob": -0.108357275317529, "compression_ratio": 1.3364779874213837, "no_speech_prob": 2.2243722488934914e-11, "source": "whisper" }, { "id": 38, "seek": 18360, "start": 190.6, "end": 193.6, "text": "不過有一個前提,你的電腦必須有依賴的環境。", "tokens": [ 50715, 28193, 2412, 8990, 8945, 20949, 11, 18961, 20545, 21184, 99, 28531, 8313, 230, 2412, 3254, 251, 164, 7062, 1546, 40063, 108, 47885, 1543, 50865 ], "temperature": 0, "avg_logprob": -0.108357275317529, "compression_ratio": 1.3364779874213837, "no_speech_prob": 2.2243722488934914e-11, "source": "whisper" }, { "id": 39, "seek": 18360, "start": 193.6, "end": 195.6, "text": "它需要一個叫做Node.js的環境。", "tokens": [ 50865, 11284, 35748, 8990, 19855, 10907, 45, 1429, 13, 25530, 1546, 40063, 108, 47885, 1543, 50965 ], "temperature": 0, "avg_logprob": -0.108357275317529, "compression_ratio": 1.3364779874213837, "no_speech_prob": 2.2243722488934914e-11, "source": "whisper" }, { "id": 40, "seek": 18360, "start": 195.6, "end": 197.6, "text": "但不用管它是幹嘛的哈。", "tokens": [ 50965, 8395, 24384, 23131, 11284, 1541, 44854, 1546, 10595, 1543, 51065 ], "temperature": 0, "avg_logprob": -0.108357275317529, "compression_ratio": 1.3364779874213837, "no_speech_prob": 2.2243722488934914e-11, "source": "whisper" }, { "id": 41, "seek": 18360, "start": 197.6, "end": 201.6, "text": "打開它的主頁,點這個綠色的按鈕,下載對應的版本。", "tokens": [ 51065, 12467, 8949, 45224, 13557, 8313, 223, 11, 8216, 6287, 9261, 254, 17673, 1546, 26613, 41597, 243, 11, 4438, 12290, 231, 2855, 20481, 1546, 42096, 8802, 1543, 51265 ], "temperature": 0, "avg_logprob": -0.108357275317529, "compression_ratio": 1.3364779874213837, "no_speech_prob": 2.2243722488934914e-11, "source": "whisper" }, { "id": 42, "seek": 18360, "start": 201.6, "end": 203.6, "text": "安裝呢,就是下一步下一步的事。", "tokens": [ 51265, 16206, 44453, 6240, 11, 5620, 45271, 31429, 45271, 31429, 1546, 6973, 1543, 51365 ], "temperature": 0, "avg_logprob": -0.108357275317529, "compression_ratio": 1.3364779874213837, "no_speech_prob": 2.2243722488934914e-11, "source": "whisper" }, { "id": 43, "seek": 18360, "start": 203.6, "end": 206.6, "text": "這些具體的過程呢,我都會放到配套的文檔裡面。", "tokens": [ 51365, 29869, 39806, 23987, 1546, 8816, 29649, 6240, 11, 1654, 7182, 6236, 12744, 4511, 38846, 1881, 245, 1546, 17174, 40741, 242, 32399, 1543, 51515 ], "temperature": 0, "avg_logprob": -0.108357275317529, "compression_ratio": 1.3364779874213837, "no_speech_prob": 2.2243722488934914e-11, "source": "whisper" }, { "id": 44, "seek": 20660, "start": 206.6, "end": 211.6, "text": "如果說你以前用過別的Aten的工具啊,大概率Node.js是你部署過的。", "tokens": [ 50365, 13119, 4622, 2166, 44996, 9254, 8816, 16158, 1546, 32, 1147, 1546, 23323, 39806, 4905, 11, 32044, 44866, 45, 1429, 13, 25530, 1541, 2166, 13470, 16469, 110, 8816, 1546, 1543, 50615 ], "temperature": 0, "avg_logprob": -0.12847401545597956, "compression_ratio": 1.2436974789915967, "no_speech_prob": 1.9463831588129032e-11, "source": "whisper" }, { "id": 45, "seek": 20660, "start": 211.6, "end": 212.6, "text": "這一步呢,就可以省略了。", "tokens": [ 50615, 32260, 31429, 6240, 11, 36781, 2862, 223, 6904, 98, 2289, 1543, 50665 ], "temperature": 0, "avg_logprob": -0.12847401545597956, "compression_ratio": 1.2436974789915967, "no_speech_prob": 1.9463831588129032e-11, "source": "whisper" }, { "id": 46, "seek": 20660, "start": 212.6, "end": 217.6, "text": "我們按下Wn加R這個快接鍵,輸入CMD,回車。", "tokens": [ 50665, 5884, 26613, 4438, 54, 77, 9990, 49, 6287, 10251, 14468, 41668, 113, 11, 12290, 116, 14028, 34, 44, 35, 11, 8350, 25941, 1543, 50915 ], "temperature": 0, "avg_logprob": -0.12847401545597956, "compression_ratio": 1.2436974789915967, "no_speech_prob": 1.9463831588129032e-11, "source": "whisper" }, { "id": 47, "seek": 20660, "start": 217.6, "end": 220.6, "text": "彈出來一個黑乎乎的窗口,這個呢叫做終端。", "tokens": [ 50915, 7391, 230, 29741, 8990, 32141, 2930, 236, 2930, 236, 1546, 30771, 245, 18144, 11, 6287, 6240, 19855, 10907, 29371, 11957, 107, 1543, 51065 ], "temperature": 0, "avg_logprob": -0.12847401545597956, "compression_ratio": 1.2436974789915967, "no_speech_prob": 1.9463831588129032e-11, "source": "whisper" }, { "id": 48, "seek": 20660, "start": 220.6, "end": 225.6, "text": "你啥都不用管哈,在Harness的主頁上,點這個複製按鈕。", "tokens": [ 51065, 2166, 3284, 98, 7182, 24384, 23131, 10595, 11, 3581, 39, 16937, 1546, 13557, 8313, 223, 5708, 11, 8216, 6287, 164, 97, 229, 8083, 121, 26613, 41597, 243, 1543, 51315 ], "temperature": 0, "avg_logprob": -0.12847401545597956, "compression_ratio": 1.2436974789915967, "no_speech_prob": 1.9463831588129032e-11, "source": "whisper" }, { "id": 49, "seek": 20660, "start": 225.6, "end": 229.6, "text": "到終端裡面,Ctrl加V粘貼上,然後回車。", "tokens": [ 51315, 4511, 29371, 11957, 107, 32399, 11, 34, 28269, 9990, 53, 18393, 246, 11561, 120, 5708, 11, 10213, 8350, 25941, 1543, 51515 ], "temperature": 0, "avg_logprob": -0.12847401545597956, "compression_ratio": 1.2436974789915967, "no_speech_prob": 1.9463831588129032e-11, "source": "whisper" }, { "id": 50, "seek": 20660, "start": 229.6, "end": 232.6, "text": "按照提示,輸入字母Y,再回車。", "tokens": [ 51515, 26613, 32150, 20949, 25696, 11, 12290, 116, 14028, 22381, 35744, 56, 11, 8623, 8350, 25941, 1543, 51665 ], "temperature": 0, "avg_logprob": -0.12847401545597956, "compression_ratio": 1.2436974789915967, "no_speech_prob": 1.9463831588129032e-11, "source": "whisper" }, { "id": 51, "seek": 20660, "start": 232.6, "end": 235.6, "text": "下面這個滾動起來,就表示已經開始安裝了。", "tokens": [ 51665, 47150, 6287, 15868, 122, 12572, 21670, 11, 3111, 40053, 25338, 21017, 16206, 44453, 2289, 1543, 51815 ], "temperature": 0, "avg_logprob": -0.12847401545597956, "compression_ratio": 1.2436974789915967, "no_speech_prob": 1.9463831588129032e-11, "source": "whisper" }, { "id": 52, "seek": 23560, "start": 235.6, "end": 238.6, "text": "由於它可能會下載很多的東西,需要多等待一會兒。", "tokens": [ 50365, 23786, 19488, 11284, 16657, 6236, 4438, 12290, 231, 20778, 1546, 26978, 11, 35748, 6392, 10187, 18390, 2257, 6236, 35125, 1543, 50515 ], "temperature": 0, "avg_logprob": -0.11440567876778397, "compression_ratio": 1.3241206030150754, "no_speech_prob": 1.6678432940286925e-11, "source": "whisper" }, { "id": 53, "seek": 23560, "start": 238.6, "end": 241.6, "text": "好了,這個時候呢,安裝結束了。", "tokens": [ 50515, 12621, 11, 6287, 14010, 6240, 11, 16206, 44453, 17144, 44320, 2289, 1543, 50665 ], "temperature": 0, "avg_logprob": -0.11440567876778397, "compression_ratio": 1.3241206030150754, "no_speech_prob": 1.6678432940286925e-11, "source": "whisper" }, { "id": 54, "seek": 23560, "start": 241.6, "end": 243.6, "text": "它自動彈出了瀏覽器。", "tokens": [ 50665, 11284, 9722, 12572, 7391, 230, 7781, 2289, 163, 222, 237, 2888, 121, 34386, 1543, 50765 ], "temperature": 0, "avg_logprob": -0.11440567876778397, "compression_ratio": 1.3241206030150754, "no_speech_prob": 1.6678432940286925e-11, "source": "whisper" }, { "id": 55, "seek": 23560, "start": 243.6, "end": 247.6, "text": "如果說你的沒有彈出呢,你就把這一行地址,複製到你的瀏覽器。", "tokens": [ 50765, 13119, 4622, 18961, 6963, 7391, 230, 7781, 6240, 11, 41045, 16075, 32260, 8082, 10928, 14872, 222, 11, 164, 97, 229, 8083, 121, 4511, 18961, 163, 222, 237, 2888, 121, 34386, 1543, 50965 ], "temperature": 0, "avg_logprob": -0.11440567876778397, "compression_ratio": 1.3241206030150754, "no_speech_prob": 1.6678432940286925e-11, "source": "whisper" }, { "id": 56, "seek": 23560, "start": 247.6, "end": 251.6, "text": "就OK,封面就有內側聲明,表示啊,這個產品還在測試階段。", "tokens": [ 50965, 3111, 9443, 11, 1530, 223, 8833, 3111, 2412, 28472, 7437, 112, 29454, 11100, 11, 40053, 4905, 11, 6287, 33299, 30246, 7824, 3581, 9592, 105, 22099, 10673, 236, 28427, 1543, 51165 ], "temperature": 0, "avg_logprob": -0.11440567876778397, "compression_ratio": 1.3241206030150754, "no_speech_prob": 1.6678432940286925e-11, "source": "whisper" }, { "id": 57, "seek": 23560, "start": 251.6, "end": 255.6, "text": "展開之後呢,還會提示你輸入Deep-seek的API-key。", "tokens": [ 51165, 43491, 8949, 26362, 6240, 11, 7824, 6236, 20949, 25696, 2166, 12290, 116, 14028, 11089, 595, 12, 405, 916, 1546, 4715, 40, 12, 4119, 1543, 51365 ], "temperature": 0, "avg_logprob": -0.11440567876778397, "compression_ratio": 1.3241206030150754, "no_speech_prob": 1.6678432940286925e-11, "source": "whisper" }, { "id": 58, "seek": 23560, "start": 255.6, "end": 259.6, "text": "由於我們今天用的是本地大模型,所以這一步呢,就跳過就好。", "tokens": [ 51365, 23786, 19488, 5884, 12074, 9254, 24620, 8802, 10928, 3582, 41908, 39823, 11, 7239, 32260, 31429, 6240, 11, 3111, 29366, 8816, 3111, 2131, 1543, 51565 ], "temperature": 0, "avg_logprob": -0.11440567876778397, "compression_ratio": 1.3241206030150754, "no_speech_prob": 1.6678432940286925e-11, "source": "whisper" }, { "id": 59, "seek": 23560, "start": 259.6, "end": 264.6, "text": "看到了這個黑鯊魚,咱們就算是正式的進入到了Deep-seek Harness的內部了。", "tokens": [ 51565, 18032, 2289, 6287, 32141, 165, 107, 232, 40042, 11, 8975, 109, 4623, 3111, 19497, 1541, 15789, 27584, 1546, 18214, 14028, 21381, 11089, 595, 12, 405, 916, 389, 16937, 1546, 28472, 13470, 2289, 1543, 51815 ], "temperature": 0, "avg_logprob": -0.11440567876778397, "compression_ratio": 1.3241206030150754, "no_speech_prob": 1.6678432940286925e-11, "source": "whisper" }, { "id": 60, "seek": 26460, "start": 264.6, "end": 270.6, "text": "這會兒呢,仍然還用不了,因為Harness本身它不能直接的裝入一個本地模型。", "tokens": [ 50365, 2664, 6236, 35125, 6240, 11, 1550, 235, 5823, 7824, 9254, 47225, 11, 11471, 39, 16937, 8802, 19847, 11284, 28590, 43297, 1546, 44453, 14028, 8990, 8802, 10928, 41908, 39823, 1543, 50665 ], "temperature": 0, "avg_logprob": -0.09711519006180437, "compression_ratio": 1.0753768844221105, "no_speech_prob": 2.273937114993796e-11, "source": "whisper" }, { "id": 61, "seek": 26460, "start": 270.6, "end": 274.6, "text": "只能通過兼容OpenAI的API方式來調用。", "tokens": [ 50665, 14003, 8225, 19550, 8816, 2347, 120, 25750, 45569, 48698, 1546, 4715, 40, 9249, 27584, 3763, 32943, 9254, 1543, 50865 ], "temperature": 0, "avg_logprob": -0.09711519006180437, "compression_ratio": 1.0753768844221105, "no_speech_prob": 2.273937114993796e-11, "source": "whisper" }, { "id": 62, "seek": 26460, "start": 274.6, "end": 277.6, "text": "所以說我們還需要一個工具,把這個模型給它跑起來。", "tokens": [ 50865, 7239, 4622, 5884, 7824, 35748, 8990, 23323, 39806, 11, 16075, 6287, 41908, 39823, 17798, 11284, 32585, 21670, 1543, 51015 ], "temperature": 0, "avg_logprob": -0.09711519006180437, "compression_ratio": 1.0753768844221105, "no_speech_prob": 2.273937114993796e-11, "source": "whisper" }, { "id": 63, "seek": 27760, "start": 277.6, "end": 283.6, "text": "這個工具呢,叫做Lama.CPP。", "tokens": [ 50365, 6287, 23323, 39806, 6240, 11, 19855, 10907, 43, 2404, 13, 34, 17755, 1543, 50665 ], "temperature": 0, "avg_logprob": -0.14595056087412733, "compression_ratio": 1.0526315789473684, "no_speech_prob": 1.680812954096833e-11, "source": "whisper" }, { "id": 64, "seek": 27760, "start": 283.6, "end": 289.6, "text": "現在非常火的什麼Olama呀,LM Studio啊,這些引擎啊,底層用的也都是它。", "tokens": [ 50665, 12648, 14392, 26171, 1546, 7598, 46, 40868, 15348, 11, 43, 44, 13500, 4905, 11, 29869, 41301, 13167, 236, 4905, 11, 22816, 9636, 97, 9254, 1546, 6404, 22796, 11284, 1543, 50965 ], "temperature": 0, "avg_logprob": -0.14595056087412733, "compression_ratio": 1.0526315789473684, "no_speech_prob": 1.680812954096833e-11, "source": "whisper" }, { "id": 65, "seek": 27760, "start": 289.6, "end": 296.6, "text": "打開它的地址,點開這裡,把頁面往下拉,找到符合你的操作系統和顯卡的版本,下載到本地。", "tokens": [ 50965, 12467, 8949, 45224, 10928, 14872, 222, 11, 8216, 8949, 18771, 11, 16075, 8313, 223, 8833, 29510, 4438, 29717, 11, 25085, 4511, 5437, 99, 14245, 18961, 13167, 235, 11914, 25368, 33725, 12565, 46605, 32681, 1546, 42096, 8802, 11, 4438, 12290, 231, 4511, 8802, 10928, 1543, 51315 ], "temperature": 0, "avg_logprob": -0.14595056087412733, "compression_ratio": 1.0526315789473684, "no_speech_prob": 1.680812954096833e-11, "source": "whisper" }, { "id": 66, "seek": 29660, "start": 296.6, "end": 299.6, "text": "因為我是Windows系統哈,顯卡是50系的。", "tokens": [ 50365, 11471, 15914, 45813, 1509, 25368, 33725, 10595, 11, 46605, 32681, 1541, 2803, 25368, 1546, 1543, 50515 ], "temperature": 0, "avg_logprob": -0.16056388032202626, "compression_ratio": 1.144736842105263, "no_speech_prob": 1.811804872797751e-11, "source": "whisper" }, { "id": 67, "seek": 29660, "start": 299.6, "end": 302.6, "text": "所以我下載COODA13這個版本。", "tokens": [ 50515, 7239, 1654, 4438, 12290, 231, 34, 3783, 7509, 7668, 6287, 42096, 8802, 1543, 50665 ], "temperature": 0, "avg_logprob": -0.16056388032202626, "compression_ratio": 1.144736842105263, "no_speech_prob": 1.811804872797751e-11, "source": "whisper" }, { "id": 68, "seek": 29660, "start": 302.6, "end": 307.6, "text": "如果你是稍微老一點的,什麼30系40系的顯卡,就要選COODA12這個版本了。", "tokens": [ 50665, 13119, 32526, 10415, 235, 39152, 10439, 19202, 1546, 11, 7598, 3446, 25368, 5254, 25368, 1546, 46605, 32681, 11, 3111, 4275, 21625, 34, 3783, 7509, 4762, 6287, 42096, 8802, 2289, 1543, 50915 ], "temperature": 0, "avg_logprob": -0.16056388032202626, "compression_ratio": 1.144736842105263, "no_speech_prob": 1.811804872797751e-11, "source": "whisper" }, { "id": 69, "seek": 29660, "start": 307.6, "end": 309.6, "text": "文件不大,只有140Mbps。", "tokens": [ 50915, 17174, 20485, 1960, 3582, 11, 35244, 49258, 44, 65, 1878, 1543, 51015 ], "temperature": 0, "avg_logprob": -0.16056388032202626, "compression_ratio": 1.144736842105263, "no_speech_prob": 1.811804872797751e-11, "source": "whisper" }, { "id": 70, "seek": 29660, "start": 309.6, "end": 311.6, "text": "下載完呢,是一個壓縮包。", "tokens": [ 51015, 4438, 12290, 231, 14128, 6240, 11, 1541, 8990, 45964, 21030, 106, 23305, 1543, 51115 ], "temperature": 0, "avg_logprob": -0.16056388032202626, "compression_ratio": 1.144736842105263, "no_speech_prob": 1.811804872797751e-11, "source": "whisper" }, { "id": 71, "seek": 29660, "start": 311.6, "end": 312.6, "text": "解壓不用安裝。", "tokens": [ 51115, 17278, 45964, 24384, 16206, 44453, 1543, 51165 ], "temperature": 0, "avg_logprob": -0.16056388032202626, "compression_ratio": 1.144736842105263, "no_speech_prob": 1.811804872797751e-11, "source": "whisper" }, { "id": 72, "seek": 31260, "start": 312.6, "end": 315.6, "text": "我的i盤是一個固態硬盤。", "tokens": [ 50365, 14200, 72, 5419, 97, 1541, 8990, 3919, 118, 45248, 38114, 105, 5419, 97, 1543, 50515 ], "temperature": 0, "avg_logprob": -0.1216681169316093, "compression_ratio": 1.3676470588235294, "no_speech_prob": 1.7090939774533354e-11, "source": "whisper" }, { "id": 73, "seek": 31260, "start": 315.6, "end": 318.6, "text": "在這裡呢,我新建了一個MODE文件夾。", "tokens": [ 50515, 3581, 18771, 6240, 11, 1654, 12560, 34157, 2289, 8990, 44, 14632, 36, 17174, 20485, 1787, 122, 1543, 50665 ], "temperature": 0, "avg_logprob": -0.1216681169316093, "compression_ratio": 1.3676470588235294, "no_speech_prob": 1.7090939774533354e-11, "source": "whisper" }, { "id": 74, "seek": 31260, "start": 318.6, "end": 323.6, "text": "把Lama和剛才下載好的CENW3.8全部都放到了這個裡面。", "tokens": [ 50665, 16075, 43, 2404, 12565, 16940, 18888, 4438, 12290, 231, 20715, 34, 2195, 54, 18, 13, 23, 38714, 7182, 12744, 21381, 6287, 32399, 1543, 50915 ], "temperature": 0, "avg_logprob": -0.1216681169316093, "compression_ratio": 1.3676470588235294, "no_speech_prob": 1.7090939774533354e-11, "source": "whisper" }, { "id": 75, "seek": 31260, "start": 323.6, "end": 326.6, "text": "我也強烈的建議啊,你們也要放到固態硬盤裡。", "tokens": [ 50915, 27761, 22752, 23661, 230, 1546, 34157, 24686, 4905, 11, 19891, 6404, 4275, 12744, 4511, 3919, 118, 45248, 38114, 105, 5419, 97, 11066, 1543, 51065 ], "temperature": 0, "avg_logprob": -0.1216681169316093, "compression_ratio": 1.3676470588235294, "no_speech_prob": 1.7090939774533354e-11, "source": "whisper" }, { "id": 76, "seek": 31260, "start": 326.6, "end": 330.6, "text": "盡量啊,不要放機械硬盤,速度呢才會更快。", "tokens": [ 51065, 5419, 94, 26748, 4905, 11, 11962, 12744, 17543, 19017, 108, 38114, 105, 5419, 97, 11, 31217, 13127, 6240, 18888, 6236, 19002, 10251, 1543, 51265 ], "temperature": 0, "avg_logprob": -0.1216681169316093, "compression_ratio": 1.3676470588235294, "no_speech_prob": 1.7090939774533354e-11, "source": "whisper" }, { "id": 77, "seek": 31260, "start": 330.6, "end": 335.6, "text": "就在這個文件夾裡,我們點擊鼠標的右鍵,選擇在終端中打開。", "tokens": [ 51265, 3111, 3581, 6287, 17174, 20485, 1787, 122, 11066, 11, 5884, 8216, 37813, 41111, 254, 46299, 1546, 22060, 41668, 113, 11, 21625, 13167, 229, 3581, 29371, 11957, 107, 5975, 12467, 8949, 1543, 51515 ], "temperature": 0, "avg_logprob": -0.1216681169316093, "compression_ratio": 1.3676470588235294, "no_speech_prob": 1.7090939774533354e-11, "source": "whisper" }, { "id": 78, "seek": 31260, "start": 335.6, "end": 337.6, "text": "咱們輸入這樣的一條命令。", "tokens": [ 51515, 8975, 109, 4623, 12290, 116, 14028, 39425, 2257, 31106, 25236, 49061, 1543, 51615 ], "temperature": 0, "avg_logprob": -0.1216681169316093, "compression_ratio": 1.3676470588235294, "no_speech_prob": 1.7090939774533354e-11, "source": "whisper" }, { "id": 79, "seek": 31260, "start": 337.6, "end": 339.6, "text": "這個命令呢,我也會放到文檔裡哈。", "tokens": [ 51615, 6287, 25236, 49061, 6240, 11, 27761, 6236, 12744, 4511, 17174, 40741, 242, 11066, 10595, 1543, 51715 ], "temperature": 0, "avg_logprob": -0.1216681169316093, "compression_ratio": 1.3676470588235294, "no_speech_prob": 1.7090939774533354e-11, "source": "whisper" }, { "id": 80, "seek": 31260, "start": 339.6, "end": 340.6, "text": "大概意思呢,就是告訴系統。", "tokens": [ 51715, 32044, 16697, 6240, 11, 5620, 31080, 25368, 33725, 1543, 51765 ], "temperature": 0, "avg_logprob": -0.1216681169316093, "compression_ratio": 1.3676470588235294, "no_speech_prob": 1.7090939774533354e-11, "source": "whisper" }, { "id": 81, "seek": 34060, "start": 340.6, "end": 342.6, "text": "把這個模型交給引擎。", "tokens": [ 50365, 16075, 6287, 41908, 39823, 28455, 17798, 41301, 13167, 236, 1543, 50465 ], "temperature": 0, "avg_logprob": -0.06886414275772271, "compression_ratio": 1.322674418604651, "no_speech_prob": 1.824921810889002e-11, "source": "whisper" }, { "id": 82, "seek": 34060, "start": 342.6, "end": 345.6, "text": "而且盡量把模型層放進顯卡。", "tokens": [ 50465, 22942, 5419, 94, 26748, 16075, 41908, 39823, 9636, 97, 12744, 18214, 46605, 32681, 1543, 50615 ], "temperature": 0, "avg_logprob": -0.06886414275772271, "compression_ratio": 1.322674418604651, "no_speech_prob": 1.824921810889002e-11, "source": "whisper" }, { "id": 83, "seek": 34060, "start": 345.6, "end": 350.6, "text": "然後在本機的8080端口開一個接口,等著別的程序來調用它。", "tokens": [ 50615, 10213, 3581, 8802, 17543, 1546, 4702, 4702, 11957, 107, 18144, 8949, 8990, 14468, 18144, 11, 10187, 19382, 16158, 1546, 29649, 6346, 237, 3763, 32943, 9254, 11284, 1543, 50865 ], "temperature": 0, "avg_logprob": -0.06886414275772271, "compression_ratio": 1.322674418604651, "no_speech_prob": 1.824921810889002e-11, "source": "whisper" }, { "id": 84, "seek": 34060, "start": 350.6, "end": 352.6, "text": "回車之後呢,能看到它開始滾動了。", "tokens": [ 50865, 8350, 25941, 26362, 6240, 11, 8225, 18032, 11284, 21017, 15868, 122, 12572, 2289, 1543, 50965 ], "temperature": 0, "avg_logprob": -0.06886414275772271, "compression_ratio": 1.322674418604651, "no_speech_prob": 1.824921810889002e-11, "source": "whisper" }, { "id": 85, "seek": 34060, "start": 352.6, "end": 357.6, "text": "直到你能看到一行127打頭的地址,就表示已經啟動好了。", "tokens": [ 50965, 16186, 4511, 2166, 8225, 18032, 2257, 8082, 4762, 22, 12467, 19921, 1546, 10928, 14872, 222, 11, 3111, 40053, 25338, 3284, 253, 12572, 12621, 1543, 51215 ], "temperature": 0, "avg_logprob": -0.06886414275772271, "compression_ratio": 1.322674418604651, "no_speech_prob": 1.824921810889002e-11, "source": "whisper" }, { "id": 86, "seek": 34060, "start": 357.6, "end": 361.6, "text": "你可以按住鍵盤上的Ctrl鍵,點擊這個地址。", "tokens": [ 51215, 42766, 26613, 21632, 41668, 113, 5419, 97, 5708, 1546, 34, 28269, 41668, 113, 11, 8216, 37813, 6287, 10928, 14872, 222, 1543, 51415 ], "temperature": 0, "avg_logprob": -0.06886414275772271, "compression_ratio": 1.322674418604651, "no_speech_prob": 1.824921810889002e-11, "source": "whisper" }, { "id": 87, "seek": 34060, "start": 361.6, "end": 364.6, "text": "它就會自動的打開你的默認瀏覽器。", "tokens": [ 51415, 11284, 47778, 9722, 12572, 1546, 12467, 8949, 18961, 6173, 246, 22041, 163, 222, 237, 2888, 121, 34386, 1543, 51565 ], "temperature": 0, "avg_logprob": -0.06886414275772271, "compression_ratio": 1.322674418604651, "no_speech_prob": 1.824921810889002e-11, "source": "whisper" }, { "id": 88, "seek": 34060, "start": 364.6, "end": 369.6, "text": "輸入一個你好,如果說它能回覆的話,說明大模型已經啟動成功了。", "tokens": [ 51565, 12290, 116, 14028, 8990, 26410, 11, 13119, 4622, 11284, 8225, 8350, 2888, 228, 21358, 11, 4622, 11100, 3582, 41908, 39823, 25338, 3284, 253, 12572, 11336, 32311, 2289, 1543, 51815 ], "temperature": 0, "avg_logprob": -0.06886414275772271, "compression_ratio": 1.322674418604651, "no_speech_prob": 1.824921810889002e-11, "source": "whisper" }, { "id": 89, "seek": 36960, "start": 369.6, "end": 371.6, "text": "好了,到這兒啊,冰箱門都打開了。", "tokens": [ 50365, 12621, 11, 4511, 2664, 35125, 4905, 11, 5676, 108, 11249, 109, 37232, 7182, 12467, 8949, 2289, 1543, 50465 ], "temperature": 0, "avg_logprob": -0.08278969795473161, "compression_ratio": 1.3201320132013201, "no_speech_prob": 2.2476309008423456e-11, "source": "whisper" }, { "id": 90, "seek": 36960, "start": 371.6, "end": 374.6, "text": "最後一步,咱就是把大象放進去了。", "tokens": [ 50465, 20578, 2257, 31429, 11, 8975, 109, 5620, 16075, 3582, 45007, 12744, 18214, 45190, 1543, 50615 ], "temperature": 0, "avg_logprob": -0.08278969795473161, "compression_ratio": 1.3201320132013201, "no_speech_prob": 2.2476309008423456e-11, "source": "whisper" }, { "id": 91, "seek": 36960, "start": 374.6, "end": 377.6, "text": "注意哈,剛才那個終端啊,這個時候是不能關的。", "tokens": [ 50615, 40794, 10595, 11, 16940, 18888, 20754, 29371, 11957, 107, 4905, 11, 6287, 14010, 1541, 28590, 14899, 1546, 1543, 50765 ], "temperature": 0, "avg_logprob": -0.08278969795473161, "compression_ratio": 1.3201320132013201, "no_speech_prob": 2.2476309008423456e-11, "source": "whisper" }, { "id": 92, "seek": 36960, "start": 377.6, "end": 379.6, "text": "你關了,大模型的服務就停了哈。", "tokens": [ 50765, 2166, 14899, 2289, 11, 3582, 41908, 39823, 1546, 27408, 39517, 3111, 36135, 2289, 10595, 1543, 50865 ], "temperature": 0, "avg_logprob": -0.08278969795473161, "compression_ratio": 1.3201320132013201, "no_speech_prob": 2.2476309008423456e-11, "source": "whisper" }, { "id": 93, "seek": 36960, "start": 379.6, "end": 382.6, "text": "以後你重新要打開Harness的話呢,不需要重新安裝。", "tokens": [ 50865, 3588, 5661, 2166, 12624, 12560, 4275, 12467, 8949, 39, 16937, 21358, 6240, 11, 1960, 35748, 12624, 12560, 16206, 44453, 1543, 51015 ], "temperature": 0, "avg_logprob": -0.08278969795473161, "compression_ratio": 1.3201320132013201, "no_speech_prob": 2.2476309008423456e-11, "source": "whisper" }, { "id": 94, "seek": 36960, "start": 382.6, "end": 384.6, "text": "在終端裡頭,輸入這個命令。", "tokens": [ 51015, 3581, 29371, 11957, 107, 11066, 19921, 11, 12290, 116, 14028, 6287, 25236, 49061, 1543, 51115 ], "temperature": 0, "avg_logprob": -0.08278969795473161, "compression_ratio": 1.3201320132013201, "no_speech_prob": 2.2476309008423456e-11, "source": "whisper" }, { "id": 95, "seek": 36960, "start": 384.6, "end": 389.6, "text": "在Harness的頁面,咱們進入設置,模型,添加自定義提供方。", "tokens": [ 51115, 3581, 39, 16937, 1546, 8313, 223, 8833, 11, 8975, 109, 4623, 18214, 14028, 39035, 34719, 11, 41908, 39823, 11, 14176, 119, 9990, 9722, 12088, 37430, 20949, 3254, 249, 9249, 1543, 51365 ], "temperature": 0, "avg_logprob": -0.08278969795473161, "compression_ratio": 1.3201320132013201, "no_speech_prob": 2.2476309008423456e-11, "source": "whisper" }, { "id": 96, "seek": 36960, "start": 389.6, "end": 391.6, "text": "你可以照著我來填哈。", "tokens": [ 51365, 42766, 32150, 19382, 1654, 3763, 13331, 104, 10595, 1543, 51465 ], "temperature": 0, "avg_logprob": -0.08278969795473161, "compression_ratio": 1.3201320132013201, "no_speech_prob": 2.2476309008423456e-11, "source": "whisper" }, { "id": 97, "seek": 39160, "start": 391.6, "end": 393.6, "text": "第一個框呢,必須是小寫字母開頭。", "tokens": [ 50365, 40760, 21416, 228, 6240, 11, 28531, 8313, 230, 1541, 7322, 4510, 104, 22381, 35744, 8949, 19921, 1543, 50465 ], "temperature": 0, "avg_logprob": -0.12540497176948634, "compression_ratio": 1.2925373134328357, "no_speech_prob": 1.9909584397792557e-11, "source": "whisper" }, { "id": 98, "seek": 39160, "start": 393.6, "end": 396.6, "text": "顯示名稱,可以取一個你自己記得住的名字。", "tokens": [ 50465, 46605, 25696, 15940, 49606, 11, 6723, 29436, 8990, 2166, 17645, 30872, 21632, 1546, 15940, 22381, 1543, 50615 ], "temperature": 0, "avg_logprob": -0.12540497176948634, "compression_ratio": 1.2925373134328357, "no_speech_prob": 1.9909584397792557e-11, "source": "whisper" }, { "id": 99, "seek": 39160, "start": 396.6, "end": 400.6, "text": "API地址呢,就是剛才那個後綴是8080的那一段。", "tokens": [ 50615, 4715, 40, 10928, 14872, 222, 6240, 11, 5620, 16940, 18888, 20754, 5661, 9261, 112, 1541, 4702, 4702, 1546, 4184, 2257, 28427, 1543, 50815 ], "temperature": 0, "avg_logprob": -0.12540497176948634, "compression_ratio": 1.2925373134328357, "no_speech_prob": 1.9909584397792557e-11, "source": "whisper" }, { "id": 100, "seek": 39160, "start": 400.6, "end": 403.6, "text": "但是後面啊,一定要有一個斜槓V1。", "tokens": [ 50815, 11189, 5661, 8833, 4905, 11, 48161, 2412, 8990, 4307, 250, 24880, 241, 53, 16, 1543, 50965 ], "temperature": 0, "avg_logprob": -0.12540497176948634, "compression_ratio": 1.2925373134328357, "no_speech_prob": 1.9909584397792557e-11, "source": "whisper" }, { "id": 101, "seek": 39160, "start": 403.6, "end": 407.6, "text": "API協議保持不變,密要,由於我們是本地模型哈。", "tokens": [ 50965, 4715, 40, 5322, 242, 24686, 24302, 17694, 1960, 26327, 11, 47838, 4275, 11, 23786, 19488, 5884, 1541, 8802, 10928, 41908, 39823, 10595, 1543, 51165 ], "temperature": 0, "avg_logprob": -0.12540497176948634, "compression_ratio": 1.2925373134328357, "no_speech_prob": 1.9909584397792557e-11, "source": "whisper" }, { "id": 102, "seek": 39160, "start": 407.6, "end": 410.6, "text": "所以說就隨便填了,咱就敲了三個1。", "tokens": [ 51165, 7239, 4622, 3111, 48890, 27364, 13331, 104, 2289, 11, 8975, 109, 3111, 7017, 110, 2289, 10960, 3338, 16, 1543, 51315 ], "temperature": 0, "avg_logprob": -0.12540497176948634, "compression_ratio": 1.2925373134328357, "no_speech_prob": 1.9909584397792557e-11, "source": "whisper" }, { "id": 103, "seek": 39160, "start": 410.6, "end": 414.6, "text": "點一下獲取可用模型,就能看到咱們的千問3.8了。", "tokens": [ 51315, 8216, 8861, 29057, 110, 29436, 4429, 9254, 41908, 39823, 11, 3111, 8225, 18032, 8975, 109, 4623, 1546, 20787, 11361, 18, 13, 23, 2289, 1543, 51515 ], "temperature": 0, "avg_logprob": -0.12540497176948634, "compression_ratio": 1.2925373134328357, "no_speech_prob": 1.9909584397792557e-11, "source": "whisper" }, { "id": 104, "seek": 39160, "start": 414.6, "end": 418.6, "text": "點下面的創建提供方,這就添加成功了。", "tokens": [ 51515, 8216, 47150, 1546, 5935, 113, 34157, 20949, 3254, 249, 9249, 11, 2664, 3111, 14176, 119, 9990, 11336, 32311, 2289, 1543, 51715 ], "temperature": 0, "avg_logprob": -0.12540497176948634, "compression_ratio": 1.2925373134328357, "no_speech_prob": 1.9909584397792557e-11, "source": "whisper" }, { "id": 105, "seek": 41860, "start": 418.6, "end": 423.6, "text": "回到Harness主頁,這個時候呢,你還選不了模型,必須還有添加工作區。", "tokens": [ 50365, 8350, 4511, 39, 16937, 13557, 8313, 223, 11, 6287, 14010, 6240, 11, 2166, 7824, 21625, 47225, 41908, 39823, 11, 28531, 8313, 230, 15569, 14176, 119, 9990, 41315, 44526, 1543, 50615 ], "temperature": 0, "avg_logprob": -0.1389091444311675, "compression_ratio": 1.3444108761329305, "no_speech_prob": 1.9002806272983008e-11, "source": "whisper" }, { "id": 106, "seek": 41860, "start": 423.6, "end": 425.6, "text": "添加好了之後啊,就可以選擇模型了。", "tokens": [ 50615, 14176, 119, 9990, 12621, 26362, 4905, 11, 36781, 21625, 13167, 229, 41908, 39823, 2289, 1543, 50715 ], "temperature": 0, "avg_logprob": -0.1389091444311675, "compression_ratio": 1.3444108761329305, "no_speech_prob": 1.9002806272983008e-11, "source": "whisper" }, { "id": 107, "seek": 41860, "start": 425.6, "end": 428.6, "text": "趙莉,咱發一個你好,第一次可能想應慢一點。", "tokens": [ 50715, 9759, 247, 31127, 231, 11, 8975, 109, 14637, 8990, 26410, 11, 18049, 9487, 16657, 7093, 20481, 20645, 19202, 1543, 50865 ], "temperature": 0, "avg_logprob": -0.1389091444311675, "compression_ratio": 1.3444108761329305, "no_speech_prob": 1.9002806272983008e-11, "source": "whisper" }, { "id": 108, "seek": 41860, "start": 428.6, "end": 433.6, "text": "能看到它的回复,咱今天就算是全部的大功告成了。", "tokens": [ 50865, 8225, 18032, 45224, 8350, 1787, 235, 11, 8975, 109, 12074, 3111, 19497, 1541, 38714, 1546, 3582, 32311, 16846, 11336, 2289, 1543, 51115 ], "temperature": 0, "avg_logprob": -0.1389091444311675, "compression_ratio": 1.3444108761329305, "no_speech_prob": 1.9002806272983008e-11, "source": "whisper" }, { "id": 109, "seek": 41860, "start": 436.6, "end": 439.6, "text": "能回你好,不算本事啊,得看它能不能幹活。", "tokens": [ 51265, 8225, 8350, 26410, 11, 1960, 19497, 8802, 6973, 4905, 11, 5916, 4200, 11284, 8225, 28590, 29932, 25956, 1543, 51415 ], "temperature": 0, "avg_logprob": -0.1389091444311675, "compression_ratio": 1.3444108761329305, "no_speech_prob": 1.9002806272983008e-11, "source": "whisper" }, { "id": 110, "seek": 41860, "start": 439.6, "end": 441.6, "text": "我們先看一個最直觀的例子。", "tokens": [ 51415, 5884, 10108, 4200, 8990, 8661, 16186, 25179, 1546, 17797, 7626, 1543, 51515 ], "temperature": 0, "avg_logprob": -0.1389091444311675, "compression_ratio": 1.3444108761329305, "no_speech_prob": 1.9002806272983008e-11, "source": "whisper" }, { "id": 111, "seek": 41860, "start": 441.6, "end": 445.6, "text": "這個文件夾裡面有77個凌亂的文件,什麼格式都有。", "tokens": [ 51515, 6287, 17174, 20485, 1787, 122, 32399, 2412, 17512, 3338, 6336, 234, 1369, 224, 1546, 17174, 20485, 11, 7598, 30921, 27584, 48121, 1543, 51715 ], "temperature": 0, "avg_logprob": -0.1389091444311675, "compression_ratio": 1.3444108761329305, "no_speech_prob": 1.9002806272983008e-11, "source": "whisper" }, { "id": 112, "seek": 41860, "start": 445.6, "end": 446.6, "text": "文件名也很亂。", "tokens": [ 51715, 17174, 20485, 15940, 6404, 4563, 1369, 224, 1543, 51765 ], "temperature": 0, "avg_logprob": -0.1389091444311675, "compression_ratio": 1.3444108761329305, "no_speech_prob": 1.9002806272983008e-11, "source": "whisper" }, { "id": 113, "seek": 44660, "start": 446.6, "end": 449.6, "text": "如果你的文件夾也這樣,按摩走一波。", "tokens": [ 50365, 13119, 18961, 17174, 20485, 1787, 122, 6404, 8377, 11, 26613, 34783, 102, 9575, 2257, 30806, 1543, 50515 ], "temperature": 0, "avg_logprob": -0.14837904855714623, "compression_ratio": 1.3217993079584776, "no_speech_prob": 1.85865645790928e-11, "source": "whisper" }, { "id": 114, "seek": 44660, "start": 449.6, "end": 451.6, "text": "手動整理啊,當然很麻煩了。", "tokens": [ 50515, 11389, 12572, 27662, 13876, 4905, 11, 21707, 4563, 38999, 17867, 102, 2289, 1543, 50615 ], "temperature": 0, "avg_logprob": -0.14837904855714623, "compression_ratio": 1.3217993079584776, "no_speech_prob": 1.85865645790928e-11, "source": "whisper" }, { "id": 115, "seek": 44660, "start": 451.6, "end": 453.6, "text": "我在Harness裡面,按摩了這個文件夾。", "tokens": [ 50615, 40528, 39, 16937, 32399, 11, 26613, 34783, 102, 2289, 6287, 17174, 20485, 1787, 122, 1543, 50715 ], "temperature": 0, "avg_logprob": -0.14837904855714623, "compression_ratio": 1.3217993079584776, "no_speech_prob": 1.85865645790928e-11, "source": "whisper" }, { "id": 116, "seek": 44660, "start": 453.6, "end": 455.6, "text": "提示詞是這麼寫的。", "tokens": [ 50715, 20949, 25696, 6716, 252, 1541, 21269, 4510, 104, 1546, 1543, 50815 ], "temperature": 0, "avg_logprob": -0.14837904855714623, "compression_ratio": 1.3217993079584776, "no_speech_prob": 1.85865645790928e-11, "source": "whisper" }, { "id": 117, "seek": 44660, "start": 455.6, "end": 460.6, "text": "我送出命令之後啊,能看到它開始先列舉文件,統計文件數量。", "tokens": [ 50815, 1654, 29309, 7781, 25236, 49061, 26362, 4905, 11, 8225, 18032, 11284, 21017, 10108, 43338, 42828, 17174, 20485, 11, 33725, 30114, 17174, 20485, 30622, 26748, 1543, 51065 ], "temperature": 0, "avg_logprob": -0.14837904855714623, "compression_ratio": 1.3217993079584776, "no_speech_prob": 1.85865645790928e-11, "source": "whisper" }, { "id": 118, "seek": 44660, "start": 460.6, "end": 465.6, "text": "然後挨個的查看文件內容,匯報77個文件清理好了,準備分類。", "tokens": [ 51065, 10213, 8501, 101, 3338, 1546, 42623, 4200, 17174, 20485, 28472, 25750, 11, 9937, 107, 17803, 17512, 3338, 17174, 20485, 21784, 13876, 12621, 11, 36241, 6627, 40092, 1543, 51315 ], "temperature": 0, "avg_logprob": -0.14837904855714623, "compression_ratio": 1.3217993079584776, "no_speech_prob": 1.85865645790928e-11, "source": "whisper" }, { "id": 119, "seek": 44660, "start": 465.6, "end": 469.6, "text": "等到13分鐘的時候,終於看到幾個文件夾出現了。", "tokens": [ 51315, 10187, 4511, 7668, 32611, 20643, 11, 29371, 19488, 18032, 23575, 3338, 17174, 20485, 1787, 122, 7781, 9581, 2289, 1543, 51515 ], "temperature": 0, "avg_logprob": -0.14837904855714623, "compression_ratio": 1.3217993079584776, "no_speech_prob": 1.85865645790928e-11, "source": "whisper" }, { "id": 120, "seek": 46960, "start": 469.6, "end": 474.6, "text": "根下呢,還有一個report和復盤。看來根下兩個文件是臨時文件。", "tokens": [ 50365, 31337, 4438, 6240, 11, 15569, 8990, 265, 2707, 12565, 2172, 102, 5419, 97, 1543, 4200, 3763, 31337, 4438, 34623, 17174, 20485, 1541, 6784, 101, 6611, 17174, 20485, 1543, 50615 ], "temperature": 0, "avg_logprob": -0.14735259357680622, "compression_ratio": 1.2775665399239544, "no_speech_prob": 1.746314551298589e-11, "source": "whisper" }, { "id": 121, "seek": 46960, "start": 474.6, "end": 478.6, "text": "它又把它清理掉了。22分鐘左右,整理報告終於出來了。", "tokens": [ 50615, 11284, 17047, 42061, 21784, 13876, 29327, 2289, 1543, 7490, 32611, 29457, 11, 27662, 13876, 17803, 16846, 29371, 19488, 7781, 25364, 1543, 50815 ], "temperature": 0, "avg_logprob": -0.14735259357680622, "compression_ratio": 1.2775665399239544, "no_speech_prob": 1.746314551298589e-11, "source": "whisper" }, { "id": 122, "seek": 46960, "start": 478.6, "end": 480.6, "text": "你覺得這份報告寫的詳細嗎?", "tokens": [ 50815, 2166, 11274, 2664, 36266, 17803, 16846, 4510, 104, 1546, 6716, 111, 41588, 7434, 30, 50915 ], "temperature": 0, "avg_logprob": -0.14735259357680622, "compression_ratio": 1.2775665399239544, "no_speech_prob": 1.746314551298589e-11, "source": "whisper" }, { "id": 123, "seek": 46960, "start": 480.6, "end": 484.6, "text": "我們的這個任務一共花了20多分鐘。這個時間還是有點久。", "tokens": [ 50915, 33641, 6287, 26443, 39517, 2257, 15408, 20127, 2289, 2009, 6392, 32611, 1543, 6287, 20788, 25583, 42440, 25320, 1543, 51115 ], "temperature": 0, "avg_logprob": -0.14735259357680622, "compression_ratio": 1.2775665399239544, "no_speech_prob": 1.746314551298589e-11, "source": "whisper" }, { "id": 124, "seek": 46960, "start": 484.6, "end": 486.6, "text": "當然呢,這個只是參考。", "tokens": [ 51115, 21707, 6240, 11, 6287, 36859, 47375, 26504, 1543, 51215 ], "temperature": 0, "avg_logprob": -0.14735259357680622, "compression_ratio": 1.2775665399239544, "no_speech_prob": 1.746314551298589e-11, "source": "whisper" }, { "id": 125, "seek": 46960, "start": 486.6, "end": 488.6, "text": "畢竟呢,是它第一次跑任務。", "tokens": [ 51215, 6904, 95, 11957, 253, 6240, 11, 1541, 11284, 18049, 9487, 32585, 26443, 39517, 1543, 51315 ], "temperature": 0, "avg_logprob": -0.14735259357680622, "compression_ratio": 1.2775665399239544, "no_speech_prob": 1.746314551298589e-11, "source": "whisper" }, { "id": 126, "seek": 48860, "start": 488.6, "end": 490.6, "text": "可能啊,有些環境啊工具啊還不具備。", "tokens": [ 50365, 16657, 4905, 11, 2412, 13824, 40063, 108, 47885, 4905, 23323, 39806, 4905, 7824, 1960, 39806, 20854, 1543, 50465 ], "temperature": 0, "avg_logprob": -0.10449863372639538, "compression_ratio": 1.348901098901099, "no_speech_prob": 1.839139604498108e-11, "source": "whisper" }, { "id": 127, "seek": 48860, "start": 490.6, "end": 495.6, "text": "而且呢,我的後臺開著很多的agent,還有陸皮軟件啊這些,都會有一定的影響。", "tokens": [ 50465, 22942, 6240, 11, 14200, 5661, 6784, 118, 8949, 19382, 20778, 1546, 559, 317, 11, 15569, 8842, 116, 34582, 14454, 253, 20485, 4905, 29869, 11, 7182, 6236, 2412, 24272, 1546, 16820, 13665, 123, 1543, 50715 ], "temperature": 0, "avg_logprob": -0.10449863372639538, "compression_ratio": 1.348901098901099, "no_speech_prob": 1.839139604498108e-11, "source": "whisper" }, { "id": 128, "seek": 48860, "start": 495.6, "end": 497.6, "text": "都免費了,還要啥自行車呀?", "tokens": [ 50715, 7182, 2347, 235, 50071, 2289, 11, 7824, 4275, 3284, 98, 9722, 8082, 25941, 15348, 30, 50815 ], "temperature": 0, "avg_logprob": -0.10449863372639538, "compression_ratio": 1.348901098901099, "no_speech_prob": 1.839139604498108e-11, "source": "whisper" }, { "id": 129, "seek": 48860, "start": 497.6, "end": 500.6, "text": "你的硬件不同,任務不同,當然可以自己去測。", "tokens": [ 50815, 18961, 38114, 105, 20485, 47123, 11, 26443, 39517, 47123, 11, 21707, 6723, 17645, 6734, 9592, 105, 1543, 50965 ], "temperature": 0, "avg_logprob": -0.10449863372639538, "compression_ratio": 1.348901098901099, "no_speech_prob": 1.839139604498108e-11, "source": "whisper" }, { "id": 130, "seek": 48860, "start": 500.6, "end": 504.6, "text": "剛才呢,只是文件的整理。它能幹的事兒啊,遠遠不止這些。", "tokens": [ 50965, 16940, 18888, 6240, 11, 36859, 17174, 20485, 1546, 27662, 13876, 1543, 11284, 8225, 29932, 1546, 6973, 35125, 4905, 11, 34489, 34489, 1960, 30438, 29869, 1543, 51165 ], "temperature": 0, "avg_logprob": -0.10449863372639538, "compression_ratio": 1.348901098901099, "no_speech_prob": 1.839139604498108e-11, "source": "whisper" }, { "id": 131, "seek": 48860, "start": 504.6, "end": 507.6, "text": "通常呢,有幾個共同的特點。", "tokens": [ 51165, 19550, 11279, 6240, 11, 2412, 23575, 3338, 15408, 13089, 1546, 17682, 8216, 1543, 51315 ], "temperature": 0, "avg_logprob": -0.10449863372639538, "compression_ratio": 1.348901098901099, "no_speech_prob": 1.839139604498108e-11, "source": "whisper" }, { "id": 132, "seek": 48860, "start": 507.6, "end": 512.6, "text": "處理大量的本地文件,規則相對明確,反覆發聲,還有一定的隱私性。", "tokens": [ 51315, 39289, 13876, 3582, 26748, 1546, 8802, 10928, 17174, 20485, 11, 2888, 237, 46225, 15106, 2855, 11100, 24293, 11, 22138, 2888, 228, 14637, 29454, 11, 15569, 24272, 1546, 10673, 109, 20083, 21686, 1543, 51565 ], "temperature": 0, "avg_logprob": -0.10449863372639538, "compression_ratio": 1.348901098901099, "no_speech_prob": 1.839139604498108e-11, "source": "whisper" }, { "id": 133, "seek": 48860, "start": 512.6, "end": 515.6, "text": "我提煉了三大類,你可以來對號入座。", "tokens": [ 51565, 1654, 20949, 17867, 231, 2289, 10960, 3582, 40092, 11, 42766, 3763, 2855, 18616, 14028, 6346, 100, 1543, 51715 ], "temperature": 0, "avg_logprob": -0.10449863372639538, "compression_ratio": 1.348901098901099, "no_speech_prob": 1.839139604498108e-11, "source": "whisper" }, { "id": 134, "seek": 51560, "start": 515.6, "end": 520.6, "text": "第一類呢,是高頻任務,像什麼清理文件啊,給筆記打標圈啊,寫摘要啊這些。", "tokens": [ 50365, 18049, 40092, 6240, 11, 1541, 12979, 29940, 26443, 39517, 11, 12760, 7598, 21784, 13876, 17174, 20485, 4905, 11, 17798, 7973, 228, 16958, 12467, 46299, 2523, 230, 4905, 11, 4510, 104, 34783, 246, 4275, 4905, 29869, 1543, 50615 ], "temperature": 0, "avg_logprob": -0.10626641441794003, "compression_ratio": 1.4289473684210525, "no_speech_prob": 1.9795585309845265e-11, "source": "whisper" }, { "id": 135, "seek": 51560, "start": 520.6, "end": 522.6, "text": "第二類呢,隱私,敏感型的任務。", "tokens": [ 50615, 19693, 40092, 6240, 11, 10673, 109, 20083, 11, 7017, 237, 9709, 39823, 1546, 26443, 39517, 1543, 50715 ], "temperature": 0, "avg_logprob": -0.10626641441794003, "compression_ratio": 1.4289473684210525, "no_speech_prob": 1.9795585309845265e-11, "source": "whisper" }, { "id": 136, "seek": 51560, "start": 522.6, "end": 527.6, "text": "像是你的個人日記啊,商務文件啊,這些你當然不想上傳到雲端了。", "tokens": [ 50715, 12760, 1541, 18961, 40104, 6890, 16958, 4905, 11, 45581, 39517, 17174, 20485, 4905, 11, 29869, 2166, 21707, 1960, 7093, 5708, 40852, 4511, 6306, 110, 11957, 107, 2289, 1543, 50965 ], "temperature": 0, "avg_logprob": -0.10626641441794003, "compression_ratio": 1.4289473684210525, "no_speech_prob": 1.9795585309845265e-11, "source": "whisper" }, { "id": 137, "seek": 51560, "start": 527.6, "end": 529.6, "text": "還有就是,常駐後台型的任務。", "tokens": [ 50965, 15569, 5620, 11, 11279, 165, 39122, 5661, 15433, 39823, 1546, 26443, 39517, 1543, 51065 ], "temperature": 0, "avg_logprob": -0.10626641441794003, "compression_ratio": 1.4289473684210525, "no_speech_prob": 1.9795585309845265e-11, "source": "whisper" }, { "id": 138, "seek": 51560, "start": 529.6, "end": 534.6, "text": "比如說呢,你讓它監聽某一個文件家,一旦發生變化,就觸發任務。", "tokens": [ 51065, 36757, 4622, 6240, 11, 2166, 21195, 11284, 5419, 96, 21524, 17238, 238, 8990, 17174, 20485, 5155, 11, 2257, 4479, 99, 14637, 8244, 26327, 23756, 11, 3111, 6758, 116, 14637, 26443, 39517, 1543, 51315 ], "temperature": 0, "avg_logprob": -0.10626641441794003, "compression_ratio": 1.4289473684210525, "no_speech_prob": 1.9795585309845265e-11, "source": "whisper" }, { "id": 139, "seek": 51560, "start": 534.6, "end": 538.6, "text": "你可以不用每次都打開對話框,重新的下命令,它自己就能搞定了。", "tokens": [ 51315, 42766, 24384, 23664, 9487, 7182, 12467, 8949, 2855, 11103, 21416, 228, 11, 12624, 12560, 1546, 4438, 25236, 49061, 11, 11284, 17645, 3111, 8225, 41816, 12088, 2289, 1543, 51515 ], "temperature": 0, "avg_logprob": -0.10626641441794003, "compression_ratio": 1.4289473684210525, "no_speech_prob": 1.9795585309845265e-11, "source": "whisper" }, { "id": 140, "seek": 51560, "start": 538.6, "end": 544.6, "text": "感謝你能看到這裡啊,總的來說呢,只要你的硬件跑得動,這套模式呢,它是能幹活的。", "tokens": [ 51515, 40143, 2166, 8225, 18032, 18771, 4905, 11, 26575, 1546, 36979, 6240, 11, 14003, 4275, 18961, 38114, 105, 20485, 32585, 5916, 12572, 11, 2664, 1881, 245, 41908, 27584, 6240, 11, 11284, 1541, 8225, 29932, 25956, 1546, 1543, 51815 ], "temperature": 0, "avg_logprob": -0.10626641441794003, "compression_ratio": 1.4289473684210525, "no_speech_prob": 1.9795585309845265e-11, "source": "whisper" }, { "id": 141, "seek": 54460, "start": 544.6, "end": 547.6, "text": "但是本地大模型呢,它不是雲端Agent的平替。", "tokens": [ 50365, 11189, 8802, 10928, 3582, 41908, 39823, 6240, 11, 11284, 7296, 6306, 110, 11957, 107, 32, 6930, 1546, 16716, 9531, 123, 1543, 50515 ], "temperature": 0, "avg_logprob": -0.06918520957046415, "compression_ratio": 1.348432055749129, "no_speech_prob": 1.747977110277965e-11, "source": "whisper" }, { "id": 142, "seek": 54460, "start": 547.6, "end": 552.6, "text": "雲端模型呢,負責最難的判斷,本地模型呢,負責長期的執行。", "tokens": [ 50515, 6306, 110, 11957, 107, 41908, 39823, 6240, 11, 11561, 254, 11561, 105, 8661, 21192, 1546, 2437, 97, 4307, 115, 11, 8802, 10928, 41908, 39823, 6240, 11, 11561, 254, 11561, 105, 15353, 16786, 1546, 16262, 115, 8082, 1543, 50765 ], "temperature": 0, "avg_logprob": -0.06918520957046415, "compression_ratio": 1.348432055749129, "no_speech_prob": 1.747977110277965e-11, "source": "whisper" }, { "id": 143, "seek": 54460, "start": 552.6, "end": 553.6, "text": "兩邊都有用。", "tokens": [ 50765, 16313, 14901, 48121, 9254, 1543, 50815 ], "temperature": 0, "avg_logprob": -0.06918520957046415, "compression_ratio": 1.348432055749129, "no_speech_prob": 1.747977110277965e-11, "source": "whisper" }, { "id": 144, "seek": 54460, "start": 553.6, "end": 557.6, "text": "我們今天不僅是部署了一套模型,更是搭建了一套本地的AI系統。", "tokens": [ 50815, 5884, 12074, 1960, 9502, 227, 1541, 13470, 16469, 110, 2289, 2257, 1881, 245, 41908, 39823, 11, 19002, 1541, 22220, 255, 34157, 2289, 2257, 1881, 245, 8802, 10928, 1546, 48698, 25368, 33725, 1543, 51015 ], "temperature": 0, "avg_logprob": -0.06918520957046415, "compression_ratio": 1.348432055749129, "no_speech_prob": 1.747977110277965e-11, "source": "whisper" }, { "id": 145, "seek": 54460, "start": 557.6, "end": 562.6, "text": "以後啊,換掉簽文,換掉Harness,你的本地的上下文,永遠都在。", "tokens": [ 51015, 3588, 5661, 4905, 11, 36338, 29327, 24579, 121, 17174, 11, 36338, 29327, 39, 16937, 11, 18961, 8802, 10928, 1546, 5708, 4438, 17174, 11, 42503, 34489, 7182, 3581, 1543, 51265 ], "temperature": 0, "avg_logprob": -0.06918520957046415, "compression_ratio": 1.348432055749129, "no_speech_prob": 1.747977110277965e-11, "source": "whisper" }, { "id": 146, "seek": 54460, "start": 562.6, "end": 567.6, "text": "和往常一樣的,今天用到的全部的下載地址而運行命令。", "tokens": [ 51265, 12565, 29510, 11279, 22977, 1546, 11, 12074, 9254, 4511, 1546, 38714, 1546, 4438, 12290, 231, 10928, 14872, 222, 11070, 32772, 8082, 25236, 49061, 1543, 51515 ], "temperature": 0, "avg_logprob": -0.06918520957046415, "compression_ratio": 1.348432055749129, "no_speech_prob": 1.747977110277965e-11, "source": "whisper" }, { "id": 147, "seek": 56760, "start": 567.6, "end": 571.6, "text": "還有這次案例的完整提示詞,所有資料我也都打包好了。", "tokens": [ 50365, 15569, 2664, 9487, 28899, 17797, 1546, 14128, 27662, 20949, 25696, 6716, 252, 11, 39300, 35380, 33404, 27761, 7182, 12467, 23305, 12621, 1543, 50565 ], "temperature": 0, "avg_logprob": -0.17406143332427404, "compression_ratio": 1.055944055944056, "no_speech_prob": 2.0253654656188225e-11, "source": "whisper" }, { "id": 148, "seek": 56760, "start": 571.6, "end": 573.6, "text": "需要的同學,評論區提我。", "tokens": [ 50565, 35748, 1546, 13089, 21372, 11, 39115, 29340, 44526, 20949, 1654, 1543, 50665 ], "temperature": 0, "avg_logprob": -0.17406143332427404, "compression_ratio": 1.055944055944056, "no_speech_prob": 2.0253654656188225e-11, "source": "whisper" }, { "id": 149, "seek": 56760, "start": 573.6, "end": 576.6, "text": "我是船長,讓我們下期再見,拜拜。", "tokens": [ 50665, 15914, 10256, 117, 15353, 11, 21195, 5884, 4438, 16786, 30177, 11, 35105, 1543, 50815 ], "temperature": 0, "avg_logprob": -0.17406143332427404, "compression_ratio": 1.055944055944056, "no_speech_prob": 2.0253654656188225e-11, "source": "whisper" } ], "transcript_selection": { "schema": "videonote.transcript_selection.v1", "status": "SELECTED", "requested_language": "zh", "duration": 576.783688, "reference_path": null, "reference_kind": null, "reference_language": null, "selected_source": "whisper_segmented", "decision_reason": "source_unavailable_or_untrusted_whisper_passed", "whisper_rejected": false, "source_profile": { "segment_count": 0, "duration_coverage": 0.0, "usable_full": false, "usable_partial": false, "hallucination_region_count": 0, "hallucination_regions": [], "language": { "requested": "zh", "matched": false } }, "whisper_profile": { "segment_count": 150, "multilingual": false, "first_start": 0.0, "final_end": 576.6, "duration_coverage": 0.999682, "maximum_gap_seconds": 4.0, "inverted_count": 0, "language": { "requested": "zh", "matched": true, "latin": 295, "han": 2861, "kana": 0, "hangul": 0 }, "hallucination_region_count": 0, "hallucination_regions": [], "usable_full": true, "usable_partial": true }, "comparison": { "window_seconds": 30.0, "compared_window_count": 0, "median_score": 0.0, "divergent_window_count": 0, "divergent_ratio": 0.0, "divergent_windows": [] }, "timestamp_alignment": { "applied": false, "estimated_offset_seconds": 0.0, "matched_segment_count": 0, "match_scores": [] }, "caption_timing_repair": null, "filled_source_profile": null, "whisper_duration_guard": { "media_duration": 576.784, "rejected_segment_count": 0, "rejected_segments": [] } } }