{"text": "小快場 優優優化版來了,這是我們優化版的第二版。我們這幫抽稿技術的,心裏邊老缺一根弦。總覺得自己把圓碼都發布了,這下穩了,總不會有人部署不上了吧。但是,我們也沒想到,上一個視頻推廣的面那麼的廣,和之前的視頻不太一樣。來了好多好多的新人朋友們,不知道要怎麼自己去編譯引擎,甚至連怎麼用AI都不知道。這個,也不知道,模型部署之後,必須要調整一下參數來做本機適配。我看後台私信,各種情況都有,報险存的,速度慢的,還有部署失敗來罵我的。罵我沒事,別侮辱咱們的技術。我們這套方案裡面用的各種各樣的技術,如果寫到論文裡面,光引用,兩張紙都寫不完。都是各個大佬的偶心立穴的經驗的作品。我們等會給大家來展示一下,我們一共做過哪些調優的項目,非常的多,但能看到大家眼花撩亂的地步。只有這麼多的調優,才能保證我們的速度達到那麼的極致。先說一下,我們這個版本比我們兩天前的版本要進化了哪些,等等黨的勝利。首先是我們的速度又有了一定的提升。我們的急速檔的速度,達到了我們一開始預期的單流300加的一個目標。有關這個地方我們可以進行結案了。它終於達成了我們一開始所定的單流300的目標,作為一個稠米模型,跑出了MOE的速度。我這裡寫的甚至有點保守了,因為在我們一些比較特定的情況下,它能跑到350多,Token沒妙。我們找了一些志願者來幫我們測我們的引擎,我們的5090D的大哥能跑到500多。我看評論區也有一些大佬來自己做了一個適配。適配完了之後,它的5080能跑到400,摸到400的線了,還是非常非常厲害的。但是我給大家說一下,我們日常的工作,因為工作都是有綜合性的,裡面有文字有代碼或者其他的一些什麼東西。它的速度可能達不到這麼一個特定情況下的峰值。正常的話就200幾十左右,在我4080的顯卡上。而且散文是它的一個弱勢,散文的話只有100幾十的Token名妙。我們其實還有很多的加速方案沒有用上。我看社區裡面有很多人已經跑出了非常非常誇張的速度了,比我們速度還要快。我們也有很多很多的加速方案沒有去用上。是因為我們自己主動的選擇了放棄。比如說有一些方法,比如說早退,就模型那麼多的層級,我們不把它算完。我們算到60%,我們算到80%,我們就直接結束計算。這是一種方式,可以提高很高的速度。再比方說是融層,把不同層給它融起來。再比如說,我就給大家舉一個例子吧。我們的投機解碼的方案,投機頭一般會產出好幾個Token,給模型去認。模型如果不認可第一個Token的話,它會把後面所有的Token全部都否決掉。這就像老師給小明批卷子,看到小明卷子的第一個題做錯了。於是就把它整張卷子全都撕了,是一個道理的。但其實小明只是第一題錯了,他後面可能甚至全對。所以,我們清華大學有一個團隊自己做的一個技術。就是如果第一個Token,它在空間位置上和我們的模型承認的Token相差不大的話,那麼後面的幾個Token會被它進行一定程度的採用。不會導致後面的題明明做對了,但是被它撕了的情況。我們其實還測了一個超級超級急速的急速方案。那個數據測出來真的是駭人聽聞的一個速度。但是質量比較的差。基本上都跟那些MOE似的。所以在這些加速的技術當中,我們做出了一定的取捨。剛才給大家描述的這三種技術都被我們給否了。不然的話,它的速度會非常非常的嚇人。我們不希望模型是傻快。我們希望模型是聰明的快。有質量的快。所以大家注意一下,我們基本的最終的定檔的速度,就定在這麼一個檔位上。可以更快,但是沒有必要。那會付出一定的質量的代價。那麼還有一項進步呢,是我們prefail的速度。prefail的速度,今天我們對引擎的內核做了一個小手術。把它的速度提高了大約30%左右。這個急速檔它的prefail到了2800。均衡檔的話到了2600。但大家需要注意一點,給大家強調一下。這是在我這台4080的顯卡上跑出來的速度。如果你是別的顯卡,比方說我們跟我們測引擎的志願者大哥,它能跑到500度。如果你的顯卡比我差呢?那你肯定會比我的數據要稍微的低那麼一些。如果你拿一個4060或者3060的顯卡來講的話,你的速度可能只有一百幾。因為你的帶寬只有我的三分之一左右。這是顯卡導致你的性能的限制,不是我們這套方案的問題。所以在後台不要再私信罵我,說跑不到這個速度了。你那個老3060,在我們之前哪敢碰瓷R7B?大家說是吧?根據自己的顯卡的情況來。給大家說一下我們的下載內容。下載的鏈接已經放在我們的簡介裡邊了。我們一共有四個包,分別是急速檔、均衡檔,還有超低顯存檔,以及我們額外添加了一個最近很火的一個swift,一個微調檔。這個作者說能夠減少很大的思考量。於是我們把它也加入了我們Nifer的適配當中。大家按需可以自己下載一下。把它裝到Nifer當中看一看效果怎麼樣。我們沒有經過特別多的測試。只能說它確實在有些地方能夠減少思考。還是我們之前說的那個問題。思考量不是越少越好的。我們自己測的話,會有一點點的質量損失。大家自己測一測看看自己能不能接受。或者說是效果怎麼樣,也可能是我們自己測的有問題。接下來是我們今天要講的重點。講一講我們是怎麼來進行部署的。在這個過程當中,我們作為人類應該做什麼。交給AI之後,AI它會做什麼。我們大家了解一下AI的步驟,做到心裡邊有數。首先我們人類要做的事情非常的簡單。把包給下下來。然後把包的鏈接發給AI。這裡需要注意,我們這個地址必須要保證全英文的地址。不然的話它會報錯。把你的文章地址粘貼給你的AI。後面的工作,它會問你幾個問題。你把這幾個問題給它回答一下。選擇一下自己想要安裝的一個情況。這樣子的話,後面你就掛機就行了。基本上就不用管了。那麼我們來說一下,AI拿到這些文件之後,它會做什麼呢?首先,AI拿到之後,我們會強制它給你做一次電腦的一個體檢。檢查一下你的GPU,檢查一下你的環境的版本,檢查一下你的帶寬,檢查一下你的核心數,乱七八糟的。做完全套的體檢之後,它會根據你的體檢結果,在我們的整顆包裡邊,選擇相應的配件和模型製品出來,來進行整個引擎的搭建。第三步,它就會把你的引擎給它編譯出來,或者搭建出來,或者是修改出來,或者是簡單的調試出來。總之,它會把它給拉起來,先跑一次。跑完一次之後,接下來就是我們的重中之重,也是很多小白卡住的地方。顯卡性能明明還不錯,但是速度就是達不到它的預期,是因為你們沒有做好我們的參數條優。這個參數條優非常多項,如果你只是調了一項或兩項就跑了,那肯定是達不到我們的這麼一個極限的一個性能的。給大家看一看,簡單看一看,我們的參數條優都包含什麼東西?首先,這些項目就都是我們的參數條優的內容。大家往下翻看看,基本上都是我們一條一條,給大家調出來的。每一條基本上對應著一個大佬的一個,自己的先進技術,或者我們自研的一個技術。還沒到底,還往後內核也需要改。基本上就這些條優的項目,每一條都是大家需要進行條優的。有人說這也太麻煩了,大家別擔心。我們給大家準備了幾個默認參數的版本。在這個版本裡面,我們已經給大家調好一部分的參數了。大家只需要調整剛才那個表格當中的一部分的參數就行。這些參數呢,是因為不同的電腦,不同的顯卡,不同的環境,它必須要有靈活的調整,才能壓榨出最深的極限的性能來。所以如果你追求只是要用,那麼到這一步就可以停了。但如果你想達到咱剛才講過的那些參數,那些標準,那麼你必須把這些條優項目挨個走一遍。這也是之前很多人卡住或者性能不達標的地方。但是幸好現在是有AI的。這些活不用你來幹,AI自己會找到自己需要條優的位置在那。它都會幫大家一一調好。這個條優的過程大約在半個小時左右的時間。根據你的顯卡可能不太一樣。如果你的顯卡不要到老舊了,那這個條優的時間可能會更久一點。引擎要做一個比較完整的適配。如果你的AI卡住了怎麼辦?如果你的環境太刁鑽,或者你的AI走偏了,性能不是很達標,不是很聪明,走偏了,卡住了有點難題了。我們也給大家準備了排錯的手冊,以及相應的排錯的處方。我們總體的思想就是,讓AI嚴格的執行我們的部署的步驟,進行引擎的部署、編譯,以及最最重要的多項條優。我們還給你的Agent一定的自主選擇權。它可以根據你自己本機的環境,來進行自行的工作,不一定非得參考我們的這麼一個標準。在這兒,我們沒有辦法給大家承諾,所有人都能部署完成,都能獲得極致的條優屬性。你可能哪個地方被你的Agent給掠過了,或者哪個地方被你給打斷了,或者哪個地方你提前終止了,都是有可能的。希望大家能夠理解。我們整個的包裡面,還是包含了我們整個項目的所有的圓碼,我們整體的部署方案,我們的採坑方案,不需要大家加情去群,不需要大家去公共號。大家直接就可以在我們視頻下面的鏈接裡面,進行下載。完全的開源,完全的免費,什麼都不要,只要大家手裡邊一個三連不過分吧。最後給大家看一看我們的一個小彩蛋,我們的一個超級大寶貝。給大家看看我們的大寶貝。看一看,GPU佔了27G,內存佔了84G。給大家拜個年吧。萬事如意。哈哈。。", "segments": [{"id": 0, "seek": 0, "start": 0.0, "end": 4.12, "text": "小快場 優優優化版來了,這是我們優化版的第二版。", "tokens": [50365, 7322, 10251, 21446, 220, 12827, 103, 12827, 103, 12827, 103, 23756, 42096, 25364, 11, 16600, 5884, 12827, 103, 23756, 42096, 1546, 19693, 42096, 1543, 50571], "temperature": 0, "avg_logprob": -0.23737470699789745, "compression_ratio": 1.4005524861878453, "no_speech_prob": 8.707822657383346e-12}, {"id": 1, "seek": 0, "start": 4.12, "end": 7.28, "text": "我們這幫抽稿技術的,心裏邊老缺一根弦。", "tokens": [50571, 5884, 2664, 32187, 46022, 10415, 123, 32502, 9890, 241, 1546, 11, 7945, 8083, 237, 14901, 10439, 38109, 118, 2257, 31337, 5702, 99, 1543, 50729], "temperature": 0, "avg_logprob": -0.23737470699789745, "compression_ratio": 1.4005524861878453, "no_speech_prob": 8.707822657383346e-12}, {"id": 2, "seek": 0, "start": 7.28, "end": 11.4, "text": "總覺得自己把圓碼都發布了,這下穩了,總不會有人部署不上了吧。", "tokens": [50729, 26575, 11274, 17645, 16075, 2523, 241, 16337, 120, 7182, 14637, 34688, 2289, 11, 2664, 4438, 13740, 102, 2289, 11, 26575, 21121, 45820, 13470, 16469, 110, 1960, 5708, 37091, 1543, 50935], "temperature": 0, "avg_logprob": -0.23737470699789745, "compression_ratio": 1.4005524861878453, "no_speech_prob": 8.707822657383346e-12}, {"id": 3, "seek": 0, "start": 11.4, "end": 16.12, "text": "但是,我們也沒想到,上一個視頻推廣的面那麼的廣,和之前的視頻不太一樣。", "tokens": [50935, 11189, 11, 5884, 6404, 4913, 7093, 4511, 11, 5708, 8990, 27333, 29940, 33597, 17527, 96, 1546, 8833, 20504, 1546, 17527, 96, 11, 12565, 32442, 1546, 27333, 29940, 1960, 9455, 22977, 1543, 51171], "temperature": 0, "avg_logprob": -0.23737470699789745, "compression_ratio": 1.4005524861878453, "no_speech_prob": 8.707822657383346e-12}, {"id": 4, "seek": 0, "start": 16.12, "end": 21.48, "text": "來了好多好多的新人朋友們,不知道要怎麼自己去編譯引擎,甚至連怎麼用AI都不知道。", "tokens": [51171, 25364, 2131, 6392, 2131, 6392, 1546, 12560, 4035, 19828, 4623, 11, 17572, 4275, 11614, 17645, 6734, 12608, 101, 11823, 107, 41301, 13167, 236, 11, 17556, 20844, 36252, 11614, 9254, 48698, 7182, 17572, 1543, 51439], "temperature": 0, "avg_logprob": -0.23737470699789745, "compression_ratio": 1.4005524861878453, "no_speech_prob": 8.707822657383346e-12}, {"id": 5, "seek": 0, "start": 21.48, "end": 26.68, "text": "這個,也不知道,模型部署之後,必須要調整一下參數來做本機適配。", "tokens": [51439, 6287, 11, 6404, 17572, 11, 41908, 39823, 13470, 16469, 110, 26362, 11, 28531, 8313, 230, 4275, 32943, 27662, 8861, 47375, 30622, 3763, 10907, 8802, 17543, 3330, 102, 38846, 1543, 51699], "temperature": 0, "avg_logprob": -0.23737470699789745, "compression_ratio": 1.4005524861878453, "no_speech_prob": 8.707822657383346e-12}, {"id": 6, "seek": 2668, "start": 26.68, "end": 32.36, "text": "我看後台私信,各種情況都有,報险存的,速度慢的,還有部署失敗來罵我的。", "tokens": [50365, 1654, 4200, 5661, 15433, 20083, 17665, 11, 17516, 16516, 39391, 48121, 11, 17803, 8842, 102, 39781, 1546, 11, 31217, 13127, 20645, 1546, 11, 15569, 13470, 16469, 110, 28564, 7017, 245, 3763, 16469, 113, 14200, 1543, 50649], "temperature": 0, "avg_logprob": -0.17652618408203125, "compression_ratio": 1.4407582938388626, "no_speech_prob": 1.6713026795844854e-11}, {"id": 7, "seek": 2668, "start": 32.36, "end": 34.36, "text": "罵我沒事,別侮辱咱們的技術。", "tokens": [50649, 16469, 113, 1654, 37344, 11, 16158, 3254, 106, 9830, 109, 8975, 109, 4623, 1546, 32502, 9890, 241, 1543, 50749], "temperature": 0, "avg_logprob": -0.17652618408203125, "compression_ratio": 1.4407582938388626, "no_speech_prob": 1.6713026795844854e-11}, {"id": 8, "seek": 2668, "start": 34.36, "end": 39.56, "text": "我們這套方案裡面用的各種各樣的技術,如果寫到論文裡面,光引用,兩張紙都寫不完。", "tokens": [50749, 5884, 2664, 1881, 245, 9249, 28899, 32399, 9254, 1546, 17516, 16516, 17516, 6180, 1546, 32502, 9890, 241, 11, 13119, 4510, 104, 4511, 29340, 17174, 32399, 11, 20690, 41301, 9254, 11, 16313, 18889, 7732, 247, 7182, 4510, 104, 1960, 14128, 1543, 51009], "temperature": 0, "avg_logprob": -0.17652618408203125, "compression_ratio": 1.4407582938388626, "no_speech_prob": 1.6713026795844854e-11}, {"id": 9, "seek": 2668, "start": 39.56, "end": 42.36, "text": "都是各個大佬的偶心立穴的經驗的作品。", "tokens": [51009, 22796, 17516, 3338, 3582, 1593, 105, 1546, 7437, 114, 7945, 24409, 163, 2708, 1546, 15145, 24023, 245, 1546, 11914, 30246, 1543, 51149], "temperature": 0, "avg_logprob": -0.17652618408203125, "compression_ratio": 1.4407582938388626, "no_speech_prob": 1.6713026795844854e-11}, {"id": 10, "seek": 2668, "start": 42.36, "end": 47.760000000000005, "text": "我們等會給大家來展示一下,我們一共做過哪些調優的項目,非常的多,但能看到大家眼花撩亂的地步。", "tokens": [51149, 5884, 10187, 6236, 17798, 6868, 3763, 43491, 25696, 8861, 11, 5884, 2257, 15408, 10907, 8816, 17028, 13824, 32943, 12827, 103, 1546, 8313, 227, 11386, 11, 48263, 6392, 11, 8395, 8225, 18032, 6868, 25281, 20127, 20559, 102, 1369, 224, 1546, 10928, 31429, 1543, 51419], "temperature": 0, "avg_logprob": -0.17652618408203125, "compression_ratio": 1.4407582938388626, "no_speech_prob": 1.6713026795844854e-11}, {"id": 11, "seek": 2668, "start": 47.760000000000005, "end": 51.44, "text": "只有這麼多的調優,才能保證我們的速度達到那麼的極致。", "tokens": [51419, 35244, 21269, 6392, 1546, 32943, 12827, 103, 11, 18888, 8225, 24302, 11823, 231, 33641, 31217, 13127, 33086, 4511, 20504, 1546, 13387, 113, 6784, 112, 1543, 51603], "temperature": 0, "avg_logprob": -0.17652618408203125, "compression_ratio": 1.4407582938388626, "no_speech_prob": 1.6713026795844854e-11}, {"id": 12, "seek": 2668, "start": 51.44, "end": 56.56, "text": "先說一下,我們這個版本比我們兩天前的版本要進化了哪些,等等黨的勝利。", "tokens": [51603, 10108, 4622, 8861, 11, 5884, 6287, 42096, 8802, 11706, 5884, 16313, 6135, 8945, 1546, 42096, 8802, 4275, 18214, 23756, 2289, 17028, 13824, 11, 36000, 33175, 1546, 43434, 23700, 1543, 51859], "temperature": 0, "avg_logprob": -0.17652618408203125, "compression_ratio": 1.4407582938388626, "no_speech_prob": 1.6713026795844854e-11}, {"id": 13, "seek": 5668, "start": 56.68, "end": 59.64, "text": "首先是我們的速度又有了一定的提升。", "tokens": [50365, 36490, 1541, 33641, 31217, 13127, 17047, 2412, 2289, 24272, 1546, 20949, 41670, 1543, 50513], "temperature": 0, "avg_logprob": -0.14374143634727615, "compression_ratio": 1.475644699140401, "no_speech_prob": 1.7352303621764875e-11}, {"id": 14, "seek": 5668, "start": 59.64, "end": 64.36, "text": "我們的急速檔的速度,達到了我們一開始預期的單流300加的一個目標。", "tokens": [50513, 33641, 36379, 31217, 40741, 242, 1546, 31217, 13127, 11, 33086, 21381, 5884, 2257, 21017, 30156, 16786, 1546, 24227, 27854, 12566, 9990, 1546, 8990, 11386, 46299, 1543, 50749], "temperature": 0, "avg_logprob": -0.14374143634727615, "compression_ratio": 1.475644699140401, "no_speech_prob": 1.7352303621764875e-11}, {"id": 15, "seek": 5668, "start": 64.36, "end": 66.36, "text": "有關這個地方我們可以進行結案了。", "tokens": [50749, 2412, 14899, 6287, 30146, 5884, 6723, 18214, 8082, 17144, 28899, 2289, 1543, 50849], "temperature": 0, "avg_logprob": -0.14374143634727615, "compression_ratio": 1.475644699140401, "no_speech_prob": 1.7352303621764875e-11}, {"id": 16, "seek": 5668, "start": 66.36, "end": 72.68, "text": "它終於達成了我們一開始所定的單流300的目標,作為一個稠米模型,跑出了MOE的速度。", "tokens": [50849, 11284, 29371, 19488, 33086, 11336, 2289, 5884, 2257, 21017, 5966, 12088, 1546, 24227, 27854, 12566, 1546, 11386, 46299, 11, 11914, 6344, 8990, 10415, 254, 27742, 41908, 39823, 11, 32585, 7781, 2289, 18976, 36, 1546, 31217, 13127, 1543, 51165], "temperature": 0, "avg_logprob": -0.14374143634727615, "compression_ratio": 1.475644699140401, "no_speech_prob": 1.7352303621764875e-11}, {"id": 17, "seek": 5668, "start": 72.68, "end": 78.64, "text": "我這裡寫的甚至有點保守了,因為在我們一些比較特定的情況下,它能跑到350多,Token沒妙。", "tokens": [51165, 1654, 18771, 4510, 104, 1546, 17556, 20844, 42440, 24302, 48480, 2289, 11, 11471, 3581, 5884, 38515, 25174, 17682, 12088, 1546, 39391, 4438, 11, 11284, 8225, 32585, 4511, 36027, 6392, 11, 51, 8406, 4913, 5648, 247, 1543, 51463], "temperature": 0, "avg_logprob": -0.14374143634727615, "compression_ratio": 1.475644699140401, "no_speech_prob": 1.7352303621764875e-11}, {"id": 18, "seek": 5668, "start": 78.64, "end": 84.0, "text": "我們找了一些志願者來幫我們測我們的引擎,我們的5090D的大哥能跑到500多。", "tokens": [51463, 5884, 25085, 2289, 38515, 44700, 20692, 12444, 3763, 32187, 5884, 9592, 105, 33641, 41301, 13167, 236, 11, 33641, 2803, 7771, 35, 1546, 44093, 8225, 32585, 4511, 7526, 6392, 1543, 51731], "temperature": 0, "avg_logprob": -0.14374143634727615, "compression_ratio": 1.475644699140401, "no_speech_prob": 1.7352303621764875e-11}, {"id": 19, "seek": 8400, "start": 84.0, "end": 86.96, "text": "我看評論區也有一些大佬來自己做了一個適配。", "tokens": [50365, 1654, 4200, 39115, 29340, 44526, 6404, 32241, 13824, 3582, 1593, 105, 3763, 17645, 10907, 2289, 8990, 3330, 102, 38846, 1543, 50513], "temperature": 0, "avg_logprob": -0.16436196807631873, "compression_ratio": 1.320754716981132, "no_speech_prob": 1.8853259231566e-11}, {"id": 20, "seek": 8400, "start": 86.96, "end": 91.68, "text": "適配完了之後,它的5080能跑到400,摸到400的線了,還是非常非常厲害的。", "tokens": [50513, 3330, 102, 38846, 41665, 26362, 11, 45224, 2803, 4702, 8225, 32585, 4511, 13741, 11, 34783, 116, 4511, 13741, 1546, 31699, 2289, 11, 25583, 14392, 14392, 20939, 1546, 1543, 50749], "temperature": 0, "avg_logprob": -0.16436196807631873, "compression_ratio": 1.320754716981132, "no_speech_prob": 1.8853259231566e-11}, {"id": 21, "seek": 8400, "start": 91.68, "end": 98.48, "text": "但是我給大家說一下,我們日常的工作,因為工作都是有綜合性的,裡面有文字有代碼或者其他的一些什麼東西。", "tokens": [50749, 11189, 1654, 17798, 6868, 4622, 8861, 11, 5884, 6890, 11279, 1546, 41315, 11, 11471, 41315, 22796, 2412, 9261, 250, 14245, 21686, 1546, 11, 32399, 2412, 17174, 22381, 2412, 19105, 16337, 120, 31148, 9572, 31309, 38515, 7598, 26978, 1543, 51089], "temperature": 0, "avg_logprob": -0.16436196807631873, "compression_ratio": 1.320754716981132, "no_speech_prob": 1.8853259231566e-11}, {"id": 22, "seek": 8400, "start": 98.48, "end": 101.68, "text": "它的速度可能達不到這麼一個特定情況下的峰值。", "tokens": [51089, 45224, 31217, 13127, 16657, 33086, 35728, 21269, 8990, 17682, 12088, 39391, 4438, 1546, 26555, 108, 40242, 1543, 51249], "temperature": 0, "avg_logprob": -0.16436196807631873, "compression_ratio": 1.320754716981132, "no_speech_prob": 1.8853259231566e-11}, {"id": 23, "seek": 8400, "start": 101.68, "end": 105.68, "text": "正常的話就200幾十左右,在我4080的顯卡上。", "tokens": [51249, 15789, 11279, 21358, 3111, 7629, 23575, 20145, 29457, 11, 3581, 1654, 5254, 4702, 1546, 46605, 32681, 5708, 1543, 51449], "temperature": 0, "avg_logprob": -0.16436196807631873, "compression_ratio": 1.320754716981132, "no_speech_prob": 1.8853259231566e-11}, {"id": 24, "seek": 10568, "start": 105.68, "end": 110.64, "text": "而且散文是它的一個弱勢,散文的話只有100幾十的Token名妙。", "tokens": [50365, 22942, 7017, 96, 17174, 1541, 45224, 8990, 5702, 109, 7978, 95, 11, 7017, 96, 17174, 21358, 35244, 6879, 23575, 20145, 1546, 51, 8406, 15940, 5648, 247, 1543, 50613], "temperature": 0, "avg_logprob": -0.17931898140612942, "compression_ratio": 1.4820359281437125, "no_speech_prob": 1.8396941955933777e-11}, {"id": 25, "seek": 10568, "start": 110.64, "end": 113.36000000000001, "text": "我們其實還有很多的加速方案沒有用上。", "tokens": [50613, 5884, 14139, 15569, 20778, 1546, 9990, 31217, 9249, 28899, 6963, 9254, 5708, 1543, 50749], "temperature": 0, "avg_logprob": -0.17931898140612942, "compression_ratio": 1.4820359281437125, "no_speech_prob": 1.8396941955933777e-11}, {"id": 26, "seek": 10568, "start": 113.36000000000001, "end": 117.36000000000001, "text": "我看社區裡面有很多人已經跑出了非常非常誇張的速度了,比我們速度還要快。", "tokens": [50749, 1654, 4200, 27658, 44526, 32399, 2412, 20778, 4035, 25338, 32585, 7781, 2289, 14392, 14392, 3549, 229, 18889, 1546, 31217, 13127, 2289, 11, 11706, 5884, 31217, 13127, 7824, 4275, 10251, 1543, 50949], "temperature": 0, "avg_logprob": -0.17931898140612942, "compression_ratio": 1.4820359281437125, "no_speech_prob": 1.8396941955933777e-11}, {"id": 27, "seek": 10568, "start": 117.36000000000001, "end": 120.80000000000001, "text": "我們也有很多很多的加速方案沒有去用上。", "tokens": [50949, 5884, 6404, 2412, 20778, 20778, 1546, 9990, 31217, 9249, 28899, 6963, 6734, 9254, 5708, 1543, 51121], "temperature": 0, "avg_logprob": -0.17931898140612942, "compression_ratio": 1.4820359281437125, "no_speech_prob": 1.8396941955933777e-11}, {"id": 28, "seek": 10568, "start": 120.80000000000001, "end": 122.80000000000001, "text": "是因為我們自己主動的選擇了放棄。", "tokens": [51121, 1541, 11471, 5884, 17645, 13557, 12572, 1546, 21625, 13167, 229, 2289, 12744, 16407, 226, 1543, 51221], "temperature": 0, "avg_logprob": -0.17931898140612942, "compression_ratio": 1.4820359281437125, "no_speech_prob": 1.8396941955933777e-11}, {"id": 29, "seek": 10568, "start": 122.80000000000001, "end": 127.36000000000001, "text": "比如說有一些方法,比如說早退,就模型那麼多的層級,我們不把它算完。", "tokens": [51221, 36757, 4622, 32241, 13824, 9249, 11148, 11, 36757, 4622, 21176, 46361, 11, 3111, 41908, 39823, 20504, 6392, 1546, 9636, 97, 35315, 11, 5884, 1960, 42061, 19497, 14128, 1543, 51449], "temperature": 0, "avg_logprob": -0.17931898140612942, "compression_ratio": 1.4820359281437125, "no_speech_prob": 1.8396941955933777e-11}, {"id": 30, "seek": 10568, "start": 127.36000000000001, "end": 131.36, "text": "我們算到60%,我們算到80%,我們就直接結束計算。", "tokens": [51449, 5884, 19497, 4511, 4550, 8923, 5884, 19497, 4511, 4702, 8923, 5884, 3111, 43297, 17144, 44320, 30114, 19497, 1543, 51649], "temperature": 0, "avg_logprob": -0.17931898140612942, "compression_ratio": 1.4820359281437125, "no_speech_prob": 1.8396941955933777e-11}, {"id": 31, "seek": 13136, "start": 131.36, "end": 134.88000000000002, "text": "這是一種方式,可以提高很高的速度。", "tokens": [50365, 16600, 2257, 16516, 9249, 27584, 11, 6723, 20949, 12979, 4563, 12979, 1546, 31217, 13127, 1543, 50541], "temperature": 0, "avg_logprob": -0.16810582546477623, "compression_ratio": 1.4358288770053476, "no_speech_prob": 1.7350870740173718e-11}, {"id": 32, "seek": 13136, "start": 134.88000000000002, "end": 137.60000000000002, "text": "再比方說是融層,把不同層給它融起來。", "tokens": [50541, 8623, 11706, 9249, 4622, 1541, 43772, 235, 9636, 97, 11, 16075, 47123, 9636, 97, 17798, 11284, 43772, 235, 21670, 1543, 50677], "temperature": 0, "avg_logprob": -0.16810582546477623, "compression_ratio": 1.4358288770053476, "no_speech_prob": 1.7350870740173718e-11}, {"id": 33, "seek": 13136, "start": 137.60000000000002, "end": 140.4, "text": "再比如說,我就給大家舉一個例子吧。", "tokens": [50677, 8623, 36757, 4622, 11, 22020, 17798, 6868, 42828, 8990, 17797, 7626, 6062, 1543, 50817], "temperature": 0, "avg_logprob": -0.16810582546477623, "compression_ratio": 1.4358288770053476, "no_speech_prob": 1.7350870740173718e-11}, {"id": 34, "seek": 13136, "start": 140.4, "end": 145.84, "text": "我們的投機解碼的方案,投機頭一般會產出好幾個Token,給模型去認。", "tokens": [50817, 33641, 37094, 17543, 17278, 16337, 120, 1546, 9249, 28899, 11, 37094, 17543, 19921, 2257, 49640, 6236, 33299, 7781, 2131, 23575, 3338, 51, 8406, 11, 17798, 41908, 39823, 6734, 22041, 1543, 51089], "temperature": 0, "avg_logprob": -0.16810582546477623, "compression_ratio": 1.4358288770053476, "no_speech_prob": 1.7350870740173718e-11}, {"id": 35, "seek": 13136, "start": 145.84, "end": 149.84, "text": "模型如果不認可第一個Token的話,它會把後面所有的Token全部都否決掉。", "tokens": [51089, 41908, 39823, 13119, 1960, 22041, 4429, 40760, 51, 8406, 21358, 11, 11284, 6236, 16075, 5661, 8833, 39300, 1546, 51, 8406, 38714, 7182, 45334, 33540, 29327, 1543, 51289], "temperature": 0, "avg_logprob": -0.16810582546477623, "compression_ratio": 1.4358288770053476, "no_speech_prob": 1.7350870740173718e-11}, {"id": 36, "seek": 13136, "start": 149.84, "end": 154.32000000000002, "text": "這就像老師給小明批卷子,看到小明卷子的第一個題做錯了。", "tokens": [51289, 2664, 3111, 12760, 23907, 17798, 7322, 11100, 3416, 117, 5322, 115, 7626, 11, 18032, 7322, 11100, 5322, 115, 7626, 1546, 40760, 14475, 10907, 13133, 2289, 1543, 51513], "temperature": 0, "avg_logprob": -0.16810582546477623, "compression_ratio": 1.4358288770053476, "no_speech_prob": 1.7350870740173718e-11}, {"id": 37, "seek": 13136, "start": 154.32000000000002, "end": 157.32000000000002, "text": "於是就把它整張卷子全都撕了,是一個道理的。", "tokens": [51513, 19488, 1541, 3111, 42061, 27662, 18889, 5322, 115, 7626, 11319, 7182, 20559, 243, 2289, 11, 1541, 8990, 6025, 13876, 1546, 1543, 51663], "temperature": 0, "avg_logprob": -0.16810582546477623, "compression_ratio": 1.4358288770053476, "no_speech_prob": 1.7350870740173718e-11}, {"id": 38, "seek": 13136, "start": 157.32000000000002, "end": 160.32000000000002, "text": "但其實小明只是第一題錯了,他後面可能甚至全對。", "tokens": [51663, 8395, 14139, 7322, 11100, 36859, 18049, 14475, 13133, 2289, 11, 5000, 5661, 8833, 16657, 17556, 20844, 11319, 2855, 1543, 51813], "temperature": 0, "avg_logprob": -0.16810582546477623, "compression_ratio": 1.4358288770053476, "no_speech_prob": 1.7350870740173718e-11}, {"id": 39, "seek": 16032, "start": 160.32, "end": 164.72, "text": "所以,我們清華大學有一個團隊自己做的一個技術。", "tokens": [50365, 7239, 11, 5884, 21784, 30927, 3582, 21372, 2412, 8990, 37766, 33929, 17645, 10907, 1546, 8990, 32502, 9890, 241, 1543, 50585], "temperature": 0, "avg_logprob": -0.2037398083375232, "compression_ratio": 1.2386831275720165, "no_speech_prob": 1.7975338231779325e-11}, {"id": 40, "seek": 16032, "start": 164.72, "end": 173.2, "text": "就是如果第一個Token,它在空間位置上和我們的模型承認的Token相差不大的話,", "tokens": [50585, 5620, 13119, 40760, 51, 8406, 11, 11284, 3581, 23322, 11016, 11160, 34719, 5708, 12565, 33641, 41908, 39823, 3416, 123, 22041, 1546, 51, 8406, 15106, 21679, 1960, 3582, 21358, 11, 51009], "temperature": 0, "avg_logprob": -0.2037398083375232, "compression_ratio": 1.2386831275720165, "no_speech_prob": 1.7975338231779325e-11}, {"id": 41, "seek": 16032, "start": 173.2, "end": 176.56, "text": "那麼後面的幾個Token會被它進行一定程度的採用。", "tokens": [51009, 20504, 5661, 8833, 1546, 23575, 3338, 51, 8406, 6236, 23238, 11284, 18214, 8082, 24272, 29649, 13127, 1546, 6900, 94, 9254, 1543, 51177], "temperature": 0, "avg_logprob": -0.2037398083375232, "compression_ratio": 1.2386831275720165, "no_speech_prob": 1.7975338231779325e-11}, {"id": 42, "seek": 16032, "start": 176.56, "end": 179.6, "text": "不會導致後面的題明明做對了,但是被它撕了的情況。", "tokens": [51177, 21121, 25647, 6784, 112, 5661, 8833, 1546, 14475, 11100, 11100, 10907, 45839, 11, 11189, 23238, 11284, 20559, 243, 2289, 1546, 39391, 1543, 51329], "temperature": 0, "avg_logprob": -0.2037398083375232, "compression_ratio": 1.2386831275720165, "no_speech_prob": 1.7975338231779325e-11}, {"id": 43, "seek": 17960, "start": 179.6, "end": 184.0, "text": "我們其實還測了一個超級超級急速的急速方案。", "tokens": [50365, 5884, 14139, 7824, 9592, 105, 2289, 8990, 19869, 35315, 19869, 35315, 36379, 31217, 1546, 36379, 31217, 9249, 28899, 1543, 50585], "temperature": 0, "avg_logprob": -0.15652992850855776, "compression_ratio": 1.300411522633745, "no_speech_prob": 2.086324342454038e-11}, {"id": 44, "seek": 17960, "start": 184.0, "end": 186.79999999999998, "text": "那個數據測出來真的是駭人聽聞的一個速度。", "tokens": [50585, 20754, 30622, 36841, 9592, 105, 29741, 45698, 165, 100, 255, 4035, 21524, 25468, 1546, 8990, 31217, 13127, 1543, 50725], "temperature": 0, "avg_logprob": -0.15652992850855776, "compression_ratio": 1.300411522633745, "no_speech_prob": 2.086324342454038e-11}, {"id": 45, "seek": 17960, "start": 186.79999999999998, "end": 189.12, "text": "但是質量比較的差。", "tokens": [50725, 11189, 43450, 26748, 25174, 1546, 21679, 1543, 50841], "temperature": 0, "avg_logprob": -0.15652992850855776, "compression_ratio": 1.300411522633745, "no_speech_prob": 2.086324342454038e-11}, {"id": 46, "seek": 17960, "start": 189.12, "end": 190.88, "text": "基本上都跟那些MOE似的。", "tokens": [50841, 37946, 5708, 7182, 9678, 4184, 13824, 18976, 36, 7384, 120, 1546, 1543, 50929], "temperature": 0, "avg_logprob": -0.15652992850855776, "compression_ratio": 1.300411522633745, "no_speech_prob": 2.086324342454038e-11}, {"id": 47, "seek": 17960, "start": 190.88, "end": 194.32, "text": "所以在這些加速的技術當中,我們做出了一定的取捨。", "tokens": [50929, 7239, 3581, 29869, 9990, 31217, 1546, 32502, 9890, 241, 13118, 5975, 11, 5884, 10907, 7781, 2289, 24272, 1546, 29436, 162, 18304, 1543, 51101], "temperature": 0, "avg_logprob": -0.15652992850855776, "compression_ratio": 1.300411522633745, "no_speech_prob": 2.086324342454038e-11}, {"id": 48, "seek": 17960, "start": 194.32, "end": 197.12, "text": "剛才給大家描述的這三種技術都被我們給否了。", "tokens": [51101, 16940, 18888, 17798, 6868, 11673, 237, 3316, 108, 1546, 2664, 10960, 16516, 32502, 9890, 241, 7182, 23238, 5884, 17798, 45334, 2289, 1543, 51241], "temperature": 0, "avg_logprob": -0.15652992850855776, "compression_ratio": 1.300411522633745, "no_speech_prob": 2.086324342454038e-11}, {"id": 49, "seek": 19712, "start": 197.12, "end": 199.12, "text": "不然的話,它的速度會非常非常的嚇人。", "tokens": [50365, 1960, 5823, 21358, 11, 45224, 31217, 13127, 6236, 14392, 48263, 29593, 229, 4035, 1543, 50465], "temperature": 0, "avg_logprob": -0.2135567327942511, "compression_ratio": 1.4972677595628416, "no_speech_prob": 1.8549748542762146e-11}, {"id": 50, "seek": 19712, "start": 199.12, "end": 201.12, "text": "我們不希望模型是傻快。", "tokens": [50465, 5884, 1960, 29955, 41908, 39823, 1541, 11518, 119, 10251, 1543, 50565], "temperature": 0, "avg_logprob": -0.2135567327942511, "compression_ratio": 1.4972677595628416, "no_speech_prob": 1.8549748542762146e-11}, {"id": 51, "seek": 19712, "start": 201.12, "end": 202.72, "text": "我們希望模型是聰明的快。", "tokens": [50565, 5884, 29955, 41908, 39823, 1541, 8171, 108, 11100, 1546, 10251, 1543, 50645], "temperature": 0, "avg_logprob": -0.2135567327942511, "compression_ratio": 1.4972677595628416, "no_speech_prob": 1.8549748542762146e-11}, {"id": 52, "seek": 19712, "start": 202.72, "end": 203.6, "text": "有質量的快。", "tokens": [50645, 2412, 43450, 26748, 1546, 10251, 1543, 50689], "temperature": 0, "avg_logprob": -0.2135567327942511, "compression_ratio": 1.4972677595628416, "no_speech_prob": 1.8549748542762146e-11}, {"id": 53, "seek": 19712, "start": 203.6, "end": 206.4, "text": "所以大家注意一下,我們基本的最終的定檔的速度,", "tokens": [50689, 7239, 6868, 40794, 8861, 11, 5884, 37946, 1546, 8661, 29371, 1546, 12088, 40741, 242, 1546, 31217, 13127, 11, 50829], "temperature": 0, "avg_logprob": -0.2135567327942511, "compression_ratio": 1.4972677595628416, "no_speech_prob": 1.8549748542762146e-11}, {"id": 54, "seek": 19712, "start": 206.4, "end": 207.84, "text": "就定在這麼一個檔位上。", "tokens": [50829, 3111, 12088, 3581, 21269, 8990, 40741, 242, 11160, 5708, 1543, 50901], "temperature": 0, "avg_logprob": -0.2135567327942511, "compression_ratio": 1.4972677595628416, "no_speech_prob": 1.8549748542762146e-11}, {"id": 55, "seek": 19712, "start": 207.84, "end": 209.84, "text": "可以更快,但是沒有必要。", "tokens": [50901, 6723, 19002, 10251, 11, 11189, 6963, 28531, 4275, 1543, 51001], "temperature": 0, "avg_logprob": -0.2135567327942511, "compression_ratio": 1.4972677595628416, "no_speech_prob": 1.8549748542762146e-11}, {"id": 56, "seek": 19712, "start": 209.84, "end": 211.6, "text": "那會付出一定的質量的代價。", "tokens": [51001, 4184, 6236, 41469, 7781, 24272, 1546, 43450, 26748, 1546, 19105, 45441, 1543, 51089], "temperature": 0, "avg_logprob": -0.2135567327942511, "compression_ratio": 1.4972677595628416, "no_speech_prob": 1.8549748542762146e-11}, {"id": 57, "seek": 19712, "start": 211.6, "end": 214.4, "text": "那麼還有一項進步呢,是我們prefail的速度。", "tokens": [51089, 20504, 15569, 2257, 8313, 227, 18214, 31429, 6240, 11, 1541, 5884, 3712, 69, 864, 1546, 31217, 13127, 1543, 51229], "temperature": 0, "avg_logprob": -0.2135567327942511, "compression_ratio": 1.4972677595628416, "no_speech_prob": 1.8549748542762146e-11}, {"id": 58, "seek": 19712, "start": 214.4, "end": 218.8, "text": "prefail的速度,今天我們對引擎的內核做了一個小手術。", "tokens": [51229, 3712, 69, 864, 1546, 31217, 13127, 11, 12074, 5884, 2855, 41301, 13167, 236, 1546, 28472, 8987, 116, 10907, 2289, 8990, 7322, 11389, 9890, 241, 1543, 51449], "temperature": 0, "avg_logprob": -0.2135567327942511, "compression_ratio": 1.4972677595628416, "no_speech_prob": 1.8549748542762146e-11}, {"id": 59, "seek": 19712, "start": 218.8, "end": 221.04000000000002, "text": "把它的速度提高了大約30%左右。", "tokens": [51449, 42061, 1546, 31217, 13127, 20949, 12979, 2289, 3582, 30889, 3446, 4, 29457, 1543, 51561], "temperature": 0, "avg_logprob": -0.2135567327942511, "compression_ratio": 1.4972677595628416, "no_speech_prob": 1.8549748542762146e-11}, {"id": 60, "seek": 19712, "start": 221.04000000000002, "end": 223.6, "text": "這個急速檔它的prefail到了2800。", "tokens": [51561, 6287, 36379, 31217, 40741, 242, 45224, 3712, 69, 864, 21381, 11205, 628, 1543, 51689], "temperature": 0, "avg_logprob": -0.2135567327942511, "compression_ratio": 1.4972677595628416, "no_speech_prob": 1.8549748542762146e-11}, {"id": 61, "seek": 19712, "start": 223.6, "end": 225.44, "text": "均衡檔的話到了2600。", "tokens": [51689, 14872, 229, 9890, 94, 40741, 242, 21358, 21381, 10880, 628, 1543, 51781], "temperature": 0, "avg_logprob": -0.2135567327942511, "compression_ratio": 1.4972677595628416, "no_speech_prob": 1.8549748542762146e-11}, {"id": 62, "seek": 22544, "start": 225.44, "end": 228.24, "text": "但大家需要注意一點,給大家強調一下。", "tokens": [50365, 8395, 6868, 35748, 40794, 19202, 11, 17798, 6868, 22752, 32943, 8861, 1543, 50505], "temperature": 0, "avg_logprob": -0.23290237115353954, "compression_ratio": 1.5064935064935066, "no_speech_prob": 1.449897146788004e-11}, {"id": 63, "seek": 22544, "start": 228.24, "end": 231.2, "text": "這是在我這台4080的顯卡上跑出來的速度。", "tokens": [50505, 16600, 3581, 1654, 2664, 15433, 5254, 4702, 1546, 46605, 32681, 5708, 32585, 29741, 1546, 31217, 13127, 1543, 50653], "temperature": 0, "avg_logprob": -0.23290237115353954, "compression_ratio": 1.5064935064935066, "no_speech_prob": 1.449897146788004e-11}, {"id": 64, "seek": 22544, "start": 231.2, "end": 232.64, "text": "如果你是別的顯卡,", "tokens": [50653, 13119, 32526, 16158, 1546, 46605, 32681, 11, 50725], "temperature": 0, "avg_logprob": -0.23290237115353954, "compression_ratio": 1.5064935064935066, "no_speech_prob": 1.449897146788004e-11}, {"id": 65, "seek": 22544, "start": 232.64, "end": 235.12, "text": "比方說我們跟我們測引擎的志願者大哥,", "tokens": [50725, 11706, 9249, 4622, 5884, 9678, 5884, 9592, 105, 41301, 13167, 236, 1546, 44700, 20692, 12444, 44093, 11, 50849], "temperature": 0, "avg_logprob": -0.23290237115353954, "compression_ratio": 1.5064935064935066, "no_speech_prob": 1.449897146788004e-11}, {"id": 66, "seek": 22544, "start": 235.12, "end": 236.0, "text": "它能跑到500度。", "tokens": [50849, 11284, 8225, 32585, 4511, 7526, 13127, 1543, 50893], "temperature": 0, "avg_logprob": -0.23290237115353954, "compression_ratio": 1.5064935064935066, "no_speech_prob": 1.449897146788004e-11}, {"id": 67, "seek": 22544, "start": 236.0, "end": 238.48, "text": "如果你的顯卡比我差呢?", "tokens": [50893, 13119, 18961, 46605, 32681, 11706, 1654, 21679, 6240, 30, 51017], "temperature": 0, "avg_logprob": -0.23290237115353954, "compression_ratio": 1.5064935064935066, "no_speech_prob": 1.449897146788004e-11}, {"id": 68, "seek": 22544, "start": 238.48, "end": 241.76, "text": "那你肯定會比我的數據要稍微的低那麼一些。", "tokens": [51017, 4184, 2166, 14356, 107, 12088, 6236, 11706, 14200, 30622, 36841, 4275, 10415, 235, 39152, 1546, 41377, 20504, 38515, 1543, 51181], "temperature": 0, "avg_logprob": -0.23290237115353954, "compression_ratio": 1.5064935064935066, "no_speech_prob": 1.449897146788004e-11}, {"id": 69, "seek": 22544, "start": 241.76, "end": 245.2, "text": "如果你拿一個4060或者3060的顯卡來講的話,", "tokens": [51181, 45669, 24351, 8990, 5254, 4550, 31148, 3446, 4550, 1546, 46605, 32681, 3763, 11932, 21358, 11, 51353], "temperature": 0, "avg_logprob": -0.23290237115353954, "compression_ratio": 1.5064935064935066, "no_speech_prob": 1.449897146788004e-11}, {"id": 70, "seek": 22544, "start": 245.2, "end": 246.4, "text": "你的速度可能只有一百幾。", "tokens": [51353, 18961, 31217, 13127, 16657, 14003, 32241, 31906, 23575, 1543, 51413], "temperature": 0, "avg_logprob": -0.23290237115353954, "compression_ratio": 1.5064935064935066, "no_speech_prob": 1.449897146788004e-11}, {"id": 71, "seek": 22544, "start": 246.4, "end": 248.24, "text": "因為你的帶寬只有我的三分之一左右。", "tokens": [51413, 11471, 18961, 32379, 4510, 105, 35244, 14200, 10960, 6627, 9574, 2257, 29457, 1543, 51505], "temperature": 0, "avg_logprob": -0.23290237115353954, "compression_ratio": 1.5064935064935066, "no_speech_prob": 1.449897146788004e-11}, {"id": 72, "seek": 22544, "start": 248.24, "end": 250.88, "text": "這是顯卡導致你的性能的限制,", "tokens": [51505, 16600, 46605, 32681, 25647, 6784, 112, 18961, 21686, 8225, 1546, 43446, 25491, 11, 51637], "temperature": 0, "avg_logprob": -0.23290237115353954, "compression_ratio": 1.5064935064935066, "no_speech_prob": 1.449897146788004e-11}, {"id": 73, "seek": 22544, "start": 250.88, "end": 252.24, "text": "不是我們這套方案的問題。", "tokens": [51637, 7296, 5884, 2664, 1881, 245, 9249, 28899, 1546, 17197, 1543, 51705], "temperature": 0, "avg_logprob": -0.23290237115353954, "compression_ratio": 1.5064935064935066, "no_speech_prob": 1.449897146788004e-11}, {"id": 74, "seek": 22544, "start": 252.24, "end": 254.88, "text": "所以在後台不要再私信罵我,說跑不到這個速度了。", "tokens": [51705, 7239, 3581, 5661, 15433, 11962, 8623, 20083, 17665, 16469, 113, 1654, 11, 4622, 32585, 35728, 6287, 31217, 13127, 2289, 1543, 51837], "temperature": 0, "avg_logprob": -0.23290237115353954, "compression_ratio": 1.5064935064935066, "no_speech_prob": 1.449897146788004e-11}, {"id": 75, "seek": 25488, "start": 254.88, "end": 256.48, "text": "你那個老3060,", "tokens": [50365, 2166, 20754, 10439, 3446, 4550, 11, 50445], "temperature": 0, "avg_logprob": -0.25800419453554935, "compression_ratio": 1.2820512820512822, "no_speech_prob": 1.7852899714121406e-11}, {"id": 76, "seek": 25488, "start": 256.48, "end": 258.32, "text": "在我們之前哪敢碰瓷R7B?", "tokens": [50445, 3581, 5884, 32442, 17028, 40205, 16337, 108, 163, 241, 115, 49, 22, 33, 30, 50537], "temperature": 0, "avg_logprob": -0.25800419453554935, "compression_ratio": 1.2820512820512822, "no_speech_prob": 1.7852899714121406e-11}, {"id": 77, "seek": 25488, "start": 258.32, "end": 259.28, "text": "大家說是吧?", "tokens": [50537, 6868, 4622, 1541, 6062, 30, 50585], "temperature": 0, "avg_logprob": -0.25800419453554935, "compression_ratio": 1.2820512820512822, "no_speech_prob": 1.7852899714121406e-11}, {"id": 78, "seek": 25488, "start": 259.28, "end": 261.36, "text": "根據自己的顯卡的情況來。", "tokens": [50585, 31337, 36841, 17645, 1546, 46605, 32681, 1546, 39391, 3763, 1543, 50689], "temperature": 0, "avg_logprob": -0.25800419453554935, "compression_ratio": 1.2820512820512822, "no_speech_prob": 1.7852899714121406e-11}, {"id": 79, "seek": 25488, "start": 261.36, "end": 262.96, "text": "給大家說一下我們的下載內容。", "tokens": [50689, 17798, 6868, 4622, 8861, 33641, 4438, 12290, 231, 28472, 25750, 1543, 50769], "temperature": 0, "avg_logprob": -0.25800419453554935, "compression_ratio": 1.2820512820512822, "no_speech_prob": 1.7852899714121406e-11}, {"id": 80, "seek": 25488, "start": 262.96, "end": 265.28, "text": "下載的鏈接已經放在我們的簡介裡邊了。", "tokens": [50769, 4438, 12290, 231, 1546, 46241, 230, 14468, 25338, 12744, 3581, 33641, 26612, 30312, 11066, 14901, 2289, 1543, 50885], "temperature": 0, "avg_logprob": -0.25800419453554935, "compression_ratio": 1.2820512820512822, "no_speech_prob": 1.7852899714121406e-11}, {"id": 81, "seek": 25488, "start": 265.28, "end": 268.0, "text": "我們一共有四個包,", "tokens": [50885, 5884, 2257, 15408, 2412, 19425, 3338, 23305, 11, 51021], "temperature": 0, "avg_logprob": -0.25800419453554935, "compression_ratio": 1.2820512820512822, "no_speech_prob": 1.7852899714121406e-11}, {"id": 82, "seek": 25488, "start": 268.0, "end": 269.6, "text": "分別是急速檔、均衡檔,", "tokens": [51021, 6627, 16158, 1541, 36379, 31217, 40741, 242, 1231, 14872, 229, 9890, 94, 40741, 242, 11, 51101], "temperature": 0, "avg_logprob": -0.25800419453554935, "compression_ratio": 1.2820512820512822, "no_speech_prob": 1.7852899714121406e-11}, {"id": 83, "seek": 25488, "start": 269.6, "end": 270.64, "text": "還有超低顯存檔,", "tokens": [51101, 15569, 19869, 41377, 46605, 39781, 40741, 242, 11, 51153], "temperature": 0, "avg_logprob": -0.25800419453554935, "compression_ratio": 1.2820512820512822, "no_speech_prob": 1.7852899714121406e-11}, {"id": 84, "seek": 25488, "start": 270.64, "end": 272.8, "text": "以及我們額外添加了一個最近很火的", "tokens": [51153, 40282, 5884, 10178, 235, 12022, 14176, 119, 9990, 2289, 8990, 46777, 4563, 26171, 1546, 51261], "temperature": 0, "avg_logprob": -0.25800419453554935, "compression_ratio": 1.2820512820512822, "no_speech_prob": 1.7852899714121406e-11}, {"id": 85, "seek": 25488, "start": 272.8, "end": 274.71999999999997, "text": "一個swift,一個微調檔。", "tokens": [51261, 8990, 25884, 2008, 11, 8990, 39152, 32943, 40741, 242, 1543, 51357], "temperature": 0, "avg_logprob": -0.25800419453554935, "compression_ratio": 1.2820512820512822, "no_speech_prob": 1.7852899714121406e-11}, {"id": 86, "seek": 25488, "start": 274.71999999999997, "end": 277.68, "text": "這個作者說能夠減少很大的思考量。", "tokens": [51357, 6287, 11914, 12444, 4622, 8225, 31649, 9592, 249, 15686, 4563, 39156, 8870, 26504, 26748, 1543, 51505], "temperature": 0, "avg_logprob": -0.25800419453554935, "compression_ratio": 1.2820512820512822, "no_speech_prob": 1.7852899714121406e-11}, {"id": 87, "seek": 27768, "start": 277.68, "end": 280.8, "text": "於是我們把它也加入了我們Nifer的適配當中。", "tokens": [50365, 19488, 1541, 5884, 42061, 6404, 43878, 2289, 5884, 45, 9361, 1546, 3330, 102, 38846, 13118, 5975, 1543, 50521], "temperature": 0, "avg_logprob": -0.19225736919202302, "compression_ratio": 1.5483870967741935, "no_speech_prob": 1.8137010990293412e-11}, {"id": 88, "seek": 27768, "start": 280.8, "end": 282.96, "text": "大家按需可以自己下載一下。", "tokens": [50521, 6868, 26613, 32535, 6723, 17645, 4438, 12290, 231, 8861, 1543, 50629], "temperature": 0, "avg_logprob": -0.19225736919202302, "compression_ratio": 1.5483870967741935, "no_speech_prob": 1.8137010990293412e-11}, {"id": 89, "seek": 27768, "start": 282.96, "end": 285.12, "text": "把它裝到Nifer當中看一看效果怎麼樣。", "tokens": [50629, 42061, 44453, 4511, 45, 9361, 13118, 5975, 4200, 2257, 4200, 43076, 9319, 34253, 1543, 50737], "temperature": 0, "avg_logprob": -0.19225736919202302, "compression_ratio": 1.5483870967741935, "no_speech_prob": 1.8137010990293412e-11}, {"id": 90, "seek": 27768, "start": 285.12, "end": 286.8, "text": "我們沒有經過特別多的測試。", "tokens": [50737, 5884, 6963, 15145, 8816, 38446, 6392, 1546, 9592, 105, 22099, 1543, 50821], "temperature": 0, "avg_logprob": -0.19225736919202302, "compression_ratio": 1.5483870967741935, "no_speech_prob": 1.8137010990293412e-11}, {"id": 91, "seek": 27768, "start": 286.8, "end": 289.76, "text": "只能說它確實在有些地方能夠減少思考。", "tokens": [50821, 14003, 8225, 4622, 11284, 24293, 10376, 3581, 2412, 13824, 30146, 8225, 31649, 9592, 249, 15686, 8870, 26504, 1543, 50969], "temperature": 0, "avg_logprob": -0.19225736919202302, "compression_ratio": 1.5483870967741935, "no_speech_prob": 1.8137010990293412e-11}, {"id": 92, "seek": 27768, "start": 289.76, "end": 291.28000000000003, "text": "還是我們之前說的那個問題。", "tokens": [50969, 25583, 5884, 32442, 4622, 1546, 20754, 17197, 1543, 51045], "temperature": 0, "avg_logprob": -0.19225736919202302, "compression_ratio": 1.5483870967741935, "no_speech_prob": 1.8137010990293412e-11}, {"id": 93, "seek": 27768, "start": 291.28000000000003, "end": 293.52, "text": "思考量不是越少越好的。", "tokens": [51045, 8870, 26504, 26748, 7296, 25761, 15686, 25761, 20715, 1543, 51157], "temperature": 0, "avg_logprob": -0.19225736919202302, "compression_ratio": 1.5483870967741935, "no_speech_prob": 1.8137010990293412e-11}, {"id": 94, "seek": 27768, "start": 293.52, "end": 295.28000000000003, "text": "我們自己測的話,", "tokens": [51157, 5884, 17645, 9592, 105, 21358, 11, 51245], "temperature": 0, "avg_logprob": -0.19225736919202302, "compression_ratio": 1.5483870967741935, "no_speech_prob": 1.8137010990293412e-11}, {"id": 95, "seek": 27768, "start": 295.28000000000003, "end": 296.8, "text": "會有一點點的質量損失。", "tokens": [51245, 6236, 2412, 19202, 8216, 1546, 43450, 26748, 22220, 235, 28564, 1543, 51321], "temperature": 0, "avg_logprob": -0.19225736919202302, "compression_ratio": 1.5483870967741935, "no_speech_prob": 1.8137010990293412e-11}, {"id": 96, "seek": 27768, "start": 296.8, "end": 299.12, "text": "大家自己測一測看看自己能不能接受。", "tokens": [51321, 6868, 17645, 9592, 105, 2257, 9592, 105, 22884, 17645, 8225, 28590, 14468, 23151, 1543, 51437], "temperature": 0, "avg_logprob": -0.19225736919202302, "compression_ratio": 1.5483870967741935, "no_speech_prob": 1.8137010990293412e-11}, {"id": 97, "seek": 27768, "start": 299.12, "end": 300.16, "text": "或者說是效果怎麼樣,", "tokens": [51437, 31148, 4622, 1541, 43076, 9319, 34253, 11, 51489], "temperature": 0, "avg_logprob": -0.19225736919202302, "compression_ratio": 1.5483870967741935, "no_speech_prob": 1.8137010990293412e-11}, {"id": 98, "seek": 27768, "start": 300.16, "end": 301.44, "text": "也可能是我們自己測的有問題。", "tokens": [51489, 6404, 16657, 1541, 5884, 17645, 9592, 105, 1546, 2412, 17197, 1543, 51553], "temperature": 0, "avg_logprob": -0.19225736919202302, "compression_ratio": 1.5483870967741935, "no_speech_prob": 1.8137010990293412e-11}, {"id": 99, "seek": 27768, "start": 301.44, "end": 303.36, "text": "接下來是我們今天要講的重點。", "tokens": [51553, 40012, 1541, 5884, 12074, 4275, 11932, 1546, 12624, 8216, 1543, 51649], "temperature": 0, "avg_logprob": -0.19225736919202302, "compression_ratio": 1.5483870967741935, "no_speech_prob": 1.8137010990293412e-11}, {"id": 100, "seek": 27768, "start": 303.36, "end": 305.12, "text": "講一講我們是怎麼來進行部署的。", "tokens": [51649, 11932, 2257, 11932, 5884, 1541, 11614, 3763, 18214, 8082, 13470, 16469, 110, 1546, 1543, 51737], "temperature": 0, "avg_logprob": -0.19225736919202302, "compression_ratio": 1.5483870967741935, "no_speech_prob": 1.8137010990293412e-11}, {"id": 101, "seek": 30512, "start": 305.12, "end": 307.52, "text": "在這個過程當中,我們作為人類應該做什麼。", "tokens": [50365, 3581, 6287, 8816, 29649, 13118, 5975, 11, 5884, 11914, 6344, 4035, 40092, 26087, 10907, 7598, 1543, 50485], "temperature": 0, "avg_logprob": -0.2077333927154541, "compression_ratio": 1.494818652849741, "no_speech_prob": 1.7510453156899253e-11}, {"id": 102, "seek": 30512, "start": 307.52, "end": 309.52, "text": "交給AI之後,AI它會做什麼。", "tokens": [50485, 28455, 17798, 48698, 26362, 11, 48698, 11284, 6236, 10907, 7598, 1543, 50585], "temperature": 0, "avg_logprob": -0.2077333927154541, "compression_ratio": 1.494818652849741, "no_speech_prob": 1.7510453156899253e-11}, {"id": 103, "seek": 30512, "start": 309.52, "end": 311.12, "text": "我們大家了解一下AI的步驟,", "tokens": [50585, 5884, 6868, 2289, 17278, 8861, 48698, 1546, 31429, 24023, 253, 11, 50665], "temperature": 0, "avg_logprob": -0.2077333927154541, "compression_ratio": 1.494818652849741, "no_speech_prob": 1.7510453156899253e-11}, {"id": 104, "seek": 30512, "start": 311.12, "end": 312.24, "text": "做到心裡邊有數。", "tokens": [50665, 10907, 4511, 7945, 11066, 14901, 2412, 30622, 1543, 50721], "temperature": 0, "avg_logprob": -0.2077333927154541, "compression_ratio": 1.494818652849741, "no_speech_prob": 1.7510453156899253e-11}, {"id": 105, "seek": 30512, "start": 312.24, "end": 314.4, "text": "首先我們人類要做的事情非常的簡單。", "tokens": [50721, 36490, 5884, 4035, 40092, 4275, 10907, 1546, 24675, 48263, 31995, 1543, 50829], "temperature": 0, "avg_logprob": -0.2077333927154541, "compression_ratio": 1.494818652849741, "no_speech_prob": 1.7510453156899253e-11}, {"id": 106, "seek": 30512, "start": 314.4, "end": 315.52, "text": "把包給下下來。", "tokens": [50829, 16075, 23305, 17798, 4438, 27769, 1543, 50885], "temperature": 0, "avg_logprob": -0.2077333927154541, "compression_ratio": 1.494818652849741, "no_speech_prob": 1.7510453156899253e-11}, {"id": 107, "seek": 30512, "start": 315.52, "end": 319.04, "text": "然後把包的鏈接發給AI。", "tokens": [50885, 10213, 16075, 23305, 1546, 46241, 230, 14468, 14637, 17798, 48698, 1543, 51061], "temperature": 0, "avg_logprob": -0.2077333927154541, "compression_ratio": 1.494818652849741, "no_speech_prob": 1.7510453156899253e-11}, {"id": 108, "seek": 30512, "start": 319.04, "end": 319.76, "text": "這裡需要注意,", "tokens": [51061, 18771, 35748, 40794, 11, 51097], "temperature": 0, "avg_logprob": -0.2077333927154541, "compression_ratio": 1.494818652849741, "no_speech_prob": 1.7510453156899253e-11}, {"id": 109, "seek": 30512, "start": 319.76, "end": 322.08, "text": "我們這個地址必須要保證全英文的地址。", "tokens": [51097, 5884, 6287, 10928, 14872, 222, 28531, 8313, 230, 4275, 24302, 11823, 231, 11319, 27869, 17174, 1546, 10928, 14872, 222, 1543, 51213], "temperature": 0, "avg_logprob": -0.2077333927154541, "compression_ratio": 1.494818652849741, "no_speech_prob": 1.7510453156899253e-11}, {"id": 110, "seek": 30512, "start": 322.08, "end": 323.36, "text": "不然的話它會報錯。", "tokens": [51213, 1960, 5823, 21358, 11284, 6236, 17803, 13133, 1543, 51277], "temperature": 0, "avg_logprob": -0.2077333927154541, "compression_ratio": 1.494818652849741, "no_speech_prob": 1.7510453156899253e-11}, {"id": 111, "seek": 30512, "start": 324.16, "end": 326.4, "text": "把你的文章地址粘貼給你的AI。", "tokens": [51317, 16075, 18961, 17174, 11957, 254, 10928, 14872, 222, 18393, 246, 11561, 120, 17798, 18961, 48698, 1543, 51429], "temperature": 0, "avg_logprob": -0.2077333927154541, "compression_ratio": 1.494818652849741, "no_speech_prob": 1.7510453156899253e-11}, {"id": 112, "seek": 30512, "start": 326.4, "end": 327.36, "text": "後面的工作,", "tokens": [51429, 5661, 8833, 1546, 41315, 11, 51477], "temperature": 0, "avg_logprob": -0.2077333927154541, "compression_ratio": 1.494818652849741, "no_speech_prob": 1.7510453156899253e-11}, {"id": 113, "seek": 30512, "start": 327.36, "end": 328.8, "text": "它會問你幾個問題。", "tokens": [51477, 11284, 6236, 11361, 2166, 23575, 3338, 17197, 1543, 51549], "temperature": 0, "avg_logprob": -0.2077333927154541, "compression_ratio": 1.494818652849741, "no_speech_prob": 1.7510453156899253e-11}, {"id": 114, "seek": 30512, "start": 328.8, "end": 330.08, "text": "你把這幾個問題給它回答一下。", "tokens": [51549, 2166, 16075, 2664, 23575, 3338, 17197, 17798, 11284, 8350, 28223, 8861, 1543, 51613], "temperature": 0, "avg_logprob": -0.2077333927154541, "compression_ratio": 1.494818652849741, "no_speech_prob": 1.7510453156899253e-11}, {"id": 115, "seek": 30512, "start": 330.08, "end": 332.08, "text": "選擇一下自己想要安裝的一個情況。", "tokens": [51613, 21625, 13167, 229, 8861, 17645, 7093, 4275, 16206, 44453, 1546, 8990, 39391, 1543, 51713], "temperature": 0, "avg_logprob": -0.2077333927154541, "compression_ratio": 1.494818652849741, "no_speech_prob": 1.7510453156899253e-11}, {"id": 116, "seek": 30512, "start": 332.08, "end": 332.96, "text": "這樣子的話,", "tokens": [51713, 24842, 21358, 11, 51757], "temperature": 0, "avg_logprob": -0.2077333927154541, "compression_ratio": 1.494818652849741, "no_speech_prob": 1.7510453156899253e-11}, {"id": 117, "seek": 30512, "start": 332.96, "end": 334.24, "text": "後面你就掛機就行了。", "tokens": [51757, 5661, 8833, 41045, 6900, 249, 17543, 3111, 46606, 1543, 51821], "temperature": 0, "avg_logprob": -0.2077333927154541, "compression_ratio": 1.494818652849741, "no_speech_prob": 1.7510453156899253e-11}, {"id": 118, "seek": 33424, "start": 334.24, "end": 335.44, "text": "基本上就不用管了。", "tokens": [50365, 37946, 5708, 3111, 24384, 23131, 2289, 1543, 50425], "temperature": 0, "avg_logprob": -0.2124348406521779, "compression_ratio": 1.5028901734104045, "no_speech_prob": 1.6247947431935472e-11}, {"id": 119, "seek": 33424, "start": 335.44, "end": 336.56, "text": "那麼我們來說一下,", "tokens": [50425, 20504, 5884, 36979, 8861, 11, 50481], "temperature": 0, "avg_logprob": -0.2124348406521779, "compression_ratio": 1.5028901734104045, "no_speech_prob": 1.6247947431935472e-11}, {"id": 120, "seek": 33424, "start": 336.56, "end": 337.6, "text": "AI拿到這些文件之後,", "tokens": [50481, 48698, 24351, 4511, 29869, 17174, 20485, 26362, 11, 50533], "temperature": 0, "avg_logprob": -0.2124348406521779, "compression_ratio": 1.5028901734104045, "no_speech_prob": 1.6247947431935472e-11}, {"id": 121, "seek": 33424, "start": 337.6, "end": 338.40000000000003, "text": "它會做什麼呢?", "tokens": [50533, 11284, 6236, 10907, 7598, 6240, 30, 50573], "temperature": 0, "avg_logprob": -0.2124348406521779, "compression_ratio": 1.5028901734104045, "no_speech_prob": 1.6247947431935472e-11}, {"id": 122, "seek": 33424, "start": 338.40000000000003, "end": 339.68, "text": "首先,AI拿到之後,", "tokens": [50573, 36490, 11, 48698, 24351, 4511, 26362, 11, 50637], "temperature": 0, "avg_logprob": -0.2124348406521779, "compression_ratio": 1.5028901734104045, "no_speech_prob": 1.6247947431935472e-11}, {"id": 123, "seek": 33424, "start": 339.68, "end": 342.88, "text": "我們會強制它給你做一次電腦的一個體檢。", "tokens": [50637, 5884, 6236, 22752, 25491, 11284, 17798, 2166, 10907, 27505, 20545, 21184, 99, 1546, 8990, 23987, 40741, 95, 1543, 50797], "temperature": 0, "avg_logprob": -0.2124348406521779, "compression_ratio": 1.5028901734104045, "no_speech_prob": 1.6247947431935472e-11}, {"id": 124, "seek": 33424, "start": 342.88, "end": 344.16, "text": "檢查一下你的GPU,", "tokens": [50797, 40741, 95, 42623, 8861, 18961, 38, 8115, 11, 50861], "temperature": 0, "avg_logprob": -0.2124348406521779, "compression_ratio": 1.5028901734104045, "no_speech_prob": 1.6247947431935472e-11}, {"id": 125, "seek": 33424, "start": 344.16, "end": 345.68, "text": "檢查一下你的環境的版本,", "tokens": [50861, 40741, 95, 42623, 8861, 18961, 40063, 108, 47885, 1546, 42096, 8802, 11, 50937], "temperature": 0, "avg_logprob": -0.2124348406521779, "compression_ratio": 1.5028901734104045, "no_speech_prob": 1.6247947431935472e-11}, {"id": 126, "seek": 33424, "start": 345.68, "end": 347.28000000000003, "text": "檢查一下你的帶寬,", "tokens": [50937, 40741, 95, 42623, 8861, 18961, 32379, 4510, 105, 11, 51017], "temperature": 0, "avg_logprob": -0.2124348406521779, "compression_ratio": 1.5028901734104045, "no_speech_prob": 1.6247947431935472e-11}, {"id": 127, "seek": 33424, "start": 347.28000000000003, "end": 348.48, "text": "檢查一下你的核心數,", "tokens": [51017, 40741, 95, 42623, 8861, 18961, 8987, 116, 7945, 30622, 11, 51077], "temperature": 0, "avg_logprob": -0.2124348406521779, "compression_ratio": 1.5028901734104045, "no_speech_prob": 1.6247947431935472e-11}, {"id": 128, "seek": 33424, "start": 348.48, "end": 349.28000000000003, "text": "乱七八糟的。", "tokens": [51077, 2930, 109, 29920, 33453, 15239, 253, 1546, 1543, 51117], "temperature": 0, "avg_logprob": -0.2124348406521779, "compression_ratio": 1.5028901734104045, "no_speech_prob": 1.6247947431935472e-11}, {"id": 129, "seek": 33424, "start": 349.28000000000003, "end": 351.76, "text": "做完全套的體檢之後,", "tokens": [51117, 10907, 14128, 11319, 1881, 245, 1546, 23987, 40741, 95, 26362, 11, 51241], "temperature": 0, "avg_logprob": -0.2124348406521779, "compression_ratio": 1.5028901734104045, "no_speech_prob": 1.6247947431935472e-11}, {"id": 130, "seek": 33424, "start": 351.76, "end": 353.76, "text": "它會根據你的體檢結果,", "tokens": [51241, 11284, 6236, 31337, 36841, 18961, 23987, 40741, 95, 35181, 11, 51341], "temperature": 0, "avg_logprob": -0.2124348406521779, "compression_ratio": 1.5028901734104045, "no_speech_prob": 1.6247947431935472e-11}, {"id": 131, "seek": 33424, "start": 353.76, "end": 355.44, "text": "在我們的整顆包裡邊,", "tokens": [51341, 3581, 33641, 27662, 43954, 23305, 11066, 14901, 11, 51425], "temperature": 0, "avg_logprob": -0.2124348406521779, "compression_ratio": 1.5028901734104045, "no_speech_prob": 1.6247947431935472e-11}, {"id": 132, "seek": 33424, "start": 355.44, "end": 358.16, "text": "選擇相應的配件和模型製品出來,", "tokens": [51425, 21625, 13167, 229, 15106, 20481, 1546, 38846, 20485, 12565, 41908, 39823, 8083, 121, 30246, 29741, 11, 51561], "temperature": 0, "avg_logprob": -0.2124348406521779, "compression_ratio": 1.5028901734104045, "no_speech_prob": 1.6247947431935472e-11}, {"id": 133, "seek": 33424, "start": 358.16, "end": 360.16, "text": "來進行整個引擎的搭建。", "tokens": [51561, 3763, 18214, 8082, 27662, 3338, 41301, 13167, 236, 1546, 22220, 255, 34157, 1543, 51661], "temperature": 0, "avg_logprob": -0.2124348406521779, "compression_ratio": 1.5028901734104045, "no_speech_prob": 1.6247947431935472e-11}, {"id": 134, "seek": 33424, "start": 360.16, "end": 361.04, "text": "第三步,", "tokens": [51661, 35878, 31429, 11, 51705], "temperature": 0, "avg_logprob": -0.2124348406521779, "compression_ratio": 1.5028901734104045, "no_speech_prob": 1.6247947431935472e-11}, {"id": 135, "seek": 33424, "start": 361.04, "end": 363.6, "text": "它就會把你的引擎給它編譯出來,", "tokens": [51705, 11284, 47778, 16075, 18961, 41301, 13167, 236, 17798, 11284, 12608, 101, 11823, 107, 29741, 11, 51833], "temperature": 0, "avg_logprob": -0.2124348406521779, "compression_ratio": 1.5028901734104045, "no_speech_prob": 1.6247947431935472e-11}, {"id": 136, "seek": 36360, "start": 363.6, "end": 364.32000000000005, "text": "或者搭建出來,", "tokens": [50365, 31148, 22220, 255, 34157, 29741, 11, 50401], "temperature": 0, "avg_logprob": -0.2293380583175505, "compression_ratio": 1.5359116022099448, "no_speech_prob": 1.5417441628917672e-11}, {"id": 137, "seek": 36360, "start": 364.32000000000005, "end": 365.08000000000004, "text": "或者是修改出來,", "tokens": [50401, 31148, 1541, 7792, 106, 34490, 29741, 11, 50439], "temperature": 0, "avg_logprob": -0.2293380583175505, "compression_ratio": 1.5359116022099448, "no_speech_prob": 1.5417441628917672e-11}, {"id": 138, "seek": 36360, "start": 365.08000000000004, "end": 366.68, "text": "或者是簡單的調試出來。", "tokens": [50439, 31148, 1541, 31995, 1546, 32943, 22099, 29741, 1543, 50519], "temperature": 0, "avg_logprob": -0.2293380583175505, "compression_ratio": 1.5359116022099448, "no_speech_prob": 1.5417441628917672e-11}, {"id": 139, "seek": 36360, "start": 366.68, "end": 367.12, "text": "總之,", "tokens": [50519, 26575, 9574, 11, 50541], "temperature": 0, "avg_logprob": -0.2293380583175505, "compression_ratio": 1.5359116022099448, "no_speech_prob": 1.5417441628917672e-11}, {"id": 140, "seek": 36360, "start": 367.12, "end": 368.40000000000003, "text": "它會把它給拉起來,", "tokens": [50541, 11284, 6236, 42061, 17798, 29717, 21670, 11, 50605], "temperature": 0, "avg_logprob": -0.2293380583175505, "compression_ratio": 1.5359116022099448, "no_speech_prob": 1.5417441628917672e-11}, {"id": 141, "seek": 36360, "start": 368.40000000000003, "end": 369.20000000000005, "text": "先跑一次。", "tokens": [50605, 10108, 32585, 27505, 1543, 50645], "temperature": 0, "avg_logprob": -0.2293380583175505, "compression_ratio": 1.5359116022099448, "no_speech_prob": 1.5417441628917672e-11}, {"id": 142, "seek": 36360, "start": 369.20000000000005, "end": 370.96000000000004, "text": "跑完一次之後,", "tokens": [50645, 32585, 14128, 27505, 26362, 11, 50733], "temperature": 0, "avg_logprob": -0.2293380583175505, "compression_ratio": 1.5359116022099448, "no_speech_prob": 1.5417441628917672e-11}, {"id": 143, "seek": 36360, "start": 370.96000000000004, "end": 373.44, "text": "接下來就是我們的重中之重,", "tokens": [50733, 40012, 5620, 33641, 12624, 5975, 9574, 12624, 11, 50857], "temperature": 0, "avg_logprob": -0.2293380583175505, "compression_ratio": 1.5359116022099448, "no_speech_prob": 1.5417441628917672e-11}, {"id": 144, "seek": 36360, "start": 373.44, "end": 375.36, "text": "也是很多小白卡住的地方。", "tokens": [50857, 22021, 20778, 7322, 13558, 32681, 21632, 1546, 30146, 1543, 50953], "temperature": 0, "avg_logprob": -0.2293380583175505, "compression_ratio": 1.5359116022099448, "no_speech_prob": 1.5417441628917672e-11}, {"id": 145, "seek": 36360, "start": 375.36, "end": 376.72, "text": "顯卡性能明明還不錯,", "tokens": [50953, 46605, 32681, 21686, 8225, 11100, 11100, 7824, 30967, 11, 51021], "temperature": 0, "avg_logprob": -0.2293380583175505, "compression_ratio": 1.5359116022099448, "no_speech_prob": 1.5417441628917672e-11}, {"id": 146, "seek": 36360, "start": 376.72, "end": 378.72, "text": "但是速度就是達不到它的預期,", "tokens": [51021, 11189, 31217, 13127, 5620, 33086, 35728, 45224, 30156, 16786, 11, 51121], "temperature": 0, "avg_logprob": -0.2293380583175505, "compression_ratio": 1.5359116022099448, "no_speech_prob": 1.5417441628917672e-11}, {"id": 147, "seek": 36360, "start": 378.72, "end": 381.68, "text": "是因為你們沒有做好我們的參數條優。", "tokens": [51121, 1541, 11471, 19891, 6963, 10907, 2131, 33641, 47375, 30622, 31106, 12827, 103, 1543, 51269], "temperature": 0, "avg_logprob": -0.2293380583175505, "compression_ratio": 1.5359116022099448, "no_speech_prob": 1.5417441628917672e-11}, {"id": 148, "seek": 36360, "start": 381.68, "end": 384.56, "text": "這個參數條優非常多項,", "tokens": [51269, 6287, 47375, 30622, 31106, 12827, 103, 14392, 6392, 8313, 227, 11, 51413], "temperature": 0, "avg_logprob": -0.2293380583175505, "compression_ratio": 1.5359116022099448, "no_speech_prob": 1.5417441628917672e-11}, {"id": 149, "seek": 36360, "start": 384.56, "end": 386.88, "text": "如果你只是調了一項或兩項就跑了,", "tokens": [51413, 45669, 36859, 32943, 2289, 2257, 8313, 227, 19780, 16313, 8313, 227, 3111, 32585, 2289, 11, 51529], "temperature": 0, "avg_logprob": -0.2293380583175505, "compression_ratio": 1.5359116022099448, "no_speech_prob": 1.5417441628917672e-11}, {"id": 150, "seek": 36360, "start": 386.88, "end": 388.40000000000003, "text": "那肯定是達不到我們的", "tokens": [51529, 4184, 14356, 107, 12088, 1541, 33086, 35728, 33641, 51605], "temperature": 0, "avg_logprob": -0.2293380583175505, "compression_ratio": 1.5359116022099448, "no_speech_prob": 1.5417441628917672e-11}, {"id": 151, "seek": 36360, "start": 388.40000000000003, "end": 389.84000000000003, "text": "這麼一個極限的一個性能的。", "tokens": [51605, 21269, 8990, 13387, 113, 43446, 1546, 8990, 21686, 8225, 1546, 1543, 51677], "temperature": 0, "avg_logprob": -0.2293380583175505, "compression_ratio": 1.5359116022099448, "no_speech_prob": 1.5417441628917672e-11}, {"id": 152, "seek": 36360, "start": 389.84000000000003, "end": 390.88, "text": "給大家看一看,", "tokens": [51677, 17798, 6868, 4200, 2257, 4200, 11, 51729], "temperature": 0, "avg_logprob": -0.2293380583175505, "compression_ratio": 1.5359116022099448, "no_speech_prob": 1.5417441628917672e-11}, {"id": 153, "seek": 36360, "start": 390.88, "end": 391.52000000000004, "text": "簡單看一看,", "tokens": [51729, 31995, 4200, 2257, 4200, 11, 51761], "temperature": 0, "avg_logprob": -0.2293380583175505, "compression_ratio": 1.5359116022099448, "no_speech_prob": 1.5417441628917672e-11}, {"id": 154, "seek": 36360, "start": 391.52000000000004, "end": 393.28000000000003, "text": "我們的參數條優都包含什麼東西?", "tokens": [51761, 33641, 47375, 30622, 31106, 12827, 103, 7182, 23305, 2392, 104, 7598, 26978, 30, 51849], "temperature": 0, "avg_logprob": -0.2293380583175505, "compression_ratio": 1.5359116022099448, "no_speech_prob": 1.5417441628917672e-11}, {"id": 155, "seek": 39328, "start": 393.28, "end": 394.55999999999995, "text": "首先,", "tokens": [50365, 36490, 11, 50429], "temperature": 0, "avg_logprob": -0.24431793599189083, "compression_ratio": 1.546468401486989, "no_speech_prob": 2.1580702502799198e-11}, {"id": 156, "seek": 39328, "start": 394.55999999999995, "end": 396.88, "text": "這些項目就都是我們的參數條優的內容。", "tokens": [50429, 29869, 8313, 227, 11386, 3111, 22796, 33641, 47375, 30622, 31106, 12827, 103, 1546, 28472, 25750, 1543, 50545], "temperature": 0, "avg_logprob": -0.24431793599189083, "compression_ratio": 1.546468401486989, "no_speech_prob": 2.1580702502799198e-11}, {"id": 157, "seek": 39328, "start": 396.88, "end": 398.55999999999995, "text": "大家往下翻看看,", "tokens": [50545, 6868, 29510, 4438, 42716, 22884, 11, 50629], "temperature": 0, "avg_logprob": -0.24431793599189083, "compression_ratio": 1.546468401486989, "no_speech_prob": 2.1580702502799198e-11}, {"id": 158, "seek": 39328, "start": 398.55999999999995, "end": 400.0, "text": "基本上都是我們一條一條,", "tokens": [50629, 37946, 5708, 22796, 5884, 2257, 31106, 2257, 31106, 11, 50701], "temperature": 0, "avg_logprob": -0.24431793599189083, "compression_ratio": 1.546468401486989, "no_speech_prob": 2.1580702502799198e-11}, {"id": 159, "seek": 39328, "start": 400.0, "end": 401.35999999999996, "text": "給大家調出來的。", "tokens": [50701, 17798, 6868, 32943, 29741, 1546, 1543, 50769], "temperature": 0, "avg_logprob": -0.24431793599189083, "compression_ratio": 1.546468401486989, "no_speech_prob": 2.1580702502799198e-11}, {"id": 160, "seek": 39328, "start": 401.35999999999996, "end": 403.67999999999995, "text": "每一條基本上對應著一個大佬的一個,", "tokens": [50769, 23664, 2257, 31106, 37946, 5708, 2855, 20481, 19382, 8990, 3582, 1593, 105, 1546, 8990, 11, 50885], "temperature": 0, "avg_logprob": -0.24431793599189083, "compression_ratio": 1.546468401486989, "no_speech_prob": 2.1580702502799198e-11}, {"id": 161, "seek": 39328, "start": 403.67999999999995, "end": 404.88, "text": "自己的先進技術,", "tokens": [50885, 17645, 1546, 10108, 18214, 32502, 9890, 241, 11, 50945], "temperature": 0, "avg_logprob": -0.24431793599189083, "compression_ratio": 1.546468401486989, "no_speech_prob": 2.1580702502799198e-11}, {"id": 162, "seek": 39328, "start": 404.88, "end": 406.0, "text": "或者我們自研的一個技術。", "tokens": [50945, 31148, 5884, 9722, 23230, 242, 1546, 8990, 32502, 9890, 241, 1543, 51001], "temperature": 0, "avg_logprob": -0.24431793599189083, "compression_ratio": 1.546468401486989, "no_speech_prob": 2.1580702502799198e-11}, {"id": 163, "seek": 39328, "start": 406.0, "end": 408.0, "text": "還沒到底,", "tokens": [51001, 7824, 4913, 33883, 11, 51101], "temperature": 0, "avg_logprob": -0.24431793599189083, "compression_ratio": 1.546468401486989, "no_speech_prob": 2.1580702502799198e-11}, {"id": 164, "seek": 39328, "start": 408.0, "end": 409.35999999999996, "text": "還往後內核也需要改。", "tokens": [51101, 7824, 29510, 5661, 28472, 8987, 116, 6404, 35748, 34490, 1543, 51169], "temperature": 0, "avg_logprob": -0.24431793599189083, "compression_ratio": 1.546468401486989, "no_speech_prob": 2.1580702502799198e-11}, {"id": 165, "seek": 39328, "start": 409.35999999999996, "end": 413.44, "text": "基本上就這些條優的項目,", "tokens": [51169, 37946, 5708, 3111, 29869, 31106, 12827, 103, 1546, 8313, 227, 11386, 11, 51373], "temperature": 0, "avg_logprob": -0.24431793599189083, "compression_ratio": 1.546468401486989, "no_speech_prob": 2.1580702502799198e-11}, {"id": 166, "seek": 39328, "start": 413.44, "end": 416.0, "text": "每一條都是大家需要進行條優的。", "tokens": [51373, 23664, 2257, 31106, 22796, 6868, 35748, 18214, 8082, 31106, 12827, 103, 1546, 1543, 51501], "temperature": 0, "avg_logprob": -0.24431793599189083, "compression_ratio": 1.546468401486989, "no_speech_prob": 2.1580702502799198e-11}, {"id": 167, "seek": 39328, "start": 416.0, "end": 416.96, "text": "有人說這也太麻煩了,", "tokens": [51501, 45820, 4622, 2664, 6404, 9455, 38999, 17867, 102, 2289, 11, 51549], "temperature": 0, "avg_logprob": -0.24431793599189083, "compression_ratio": 1.546468401486989, "no_speech_prob": 2.1580702502799198e-11}, {"id": 168, "seek": 39328, "start": 416.96, "end": 417.76, "text": "大家別擔心。", "tokens": [51549, 6868, 16158, 13167, 242, 7945, 1543, 51589], "temperature": 0, "avg_logprob": -0.24431793599189083, "compression_ratio": 1.546468401486989, "no_speech_prob": 2.1580702502799198e-11}, {"id": 169, "seek": 41776, "start": 417.76, "end": 421.36, "text": "我們給大家準備了幾個默認參數的版本。", "tokens": [50365, 5884, 17798, 6868, 36241, 2289, 23575, 3338, 6173, 246, 22041, 47375, 30622, 1546, 42096, 8802, 1543, 50545], "temperature": 0, "avg_logprob": -0.16151419552889737, "compression_ratio": 1.2625, "no_speech_prob": 2.019371822536975e-11}, {"id": 170, "seek": 41776, "start": 421.36, "end": 422.32, "text": "在這個版本裡面,", "tokens": [50545, 3581, 6287, 42096, 8802, 32399, 11, 50593], "temperature": 0, "avg_logprob": -0.16151419552889737, "compression_ratio": 1.2625, "no_speech_prob": 2.019371822536975e-11}, {"id": 171, "seek": 41776, "start": 422.32, "end": 424.48, "text": "我們已經給大家調好一部分的參數了。", "tokens": [50593, 5884, 25338, 17798, 6868, 32943, 2131, 2257, 32174, 1546, 47375, 30622, 2289, 1543, 50701], "temperature": 0, "avg_logprob": -0.16151419552889737, "compression_ratio": 1.2625, "no_speech_prob": 2.019371822536975e-11}, {"id": 172, "seek": 41776, "start": 424.48, "end": 428.48, "text": "大家只需要調整剛才那個表格當中的一部分的參數就行。", "tokens": [50701, 6868, 14003, 35748, 32943, 27662, 16940, 18888, 20754, 17571, 30921, 13118, 5975, 1546, 2257, 32174, 1546, 47375, 30622, 3111, 8082, 1543, 50901], "temperature": 0, "avg_logprob": -0.16151419552889737, "compression_ratio": 1.2625, "no_speech_prob": 2.019371822536975e-11}, {"id": 173, "seek": 42848, "start": 428.48, "end": 429.76, "text": "這些參數呢,", "tokens": [50365, 29869, 47375, 30622, 6240, 11, 50429], "temperature": 0, "avg_logprob": -0.18436267833017933, "compression_ratio": 1.4273743016759777, "no_speech_prob": 1.5507909192913338e-11}, {"id": 174, "seek": 42848, "start": 429.76, "end": 430.88, "text": "是因為不同的電腦,", "tokens": [50429, 1541, 11471, 47123, 1546, 20545, 21184, 99, 11, 50485], "temperature": 0, "avg_logprob": -0.18436267833017933, "compression_ratio": 1.4273743016759777, "no_speech_prob": 1.5507909192913338e-11}, {"id": 175, "seek": 42848, "start": 430.88, "end": 431.52000000000004, "text": "不同的顯卡,", "tokens": [50485, 47123, 1546, 46605, 32681, 11, 50517], "temperature": 0, "avg_logprob": -0.18436267833017933, "compression_ratio": 1.4273743016759777, "no_speech_prob": 1.5507909192913338e-11}, {"id": 176, "seek": 42848, "start": 431.52000000000004, "end": 432.64000000000004, "text": "不同的環境,", "tokens": [50517, 47123, 1546, 40063, 108, 47885, 11, 50573], "temperature": 0, "avg_logprob": -0.18436267833017933, "compression_ratio": 1.4273743016759777, "no_speech_prob": 1.5507909192913338e-11}, {"id": 177, "seek": 42848, "start": 432.64000000000004, "end": 434.8, "text": "它必須要有靈活的調整,", "tokens": [50573, 11284, 28531, 8313, 230, 4275, 2412, 5363, 230, 25956, 1546, 32943, 27662, 11, 50681], "temperature": 0, "avg_logprob": -0.18436267833017933, "compression_ratio": 1.4273743016759777, "no_speech_prob": 1.5507909192913338e-11}, {"id": 178, "seek": 42848, "start": 434.8, "end": 437.20000000000005, "text": "才能壓榨出最深的極限的性能來。", "tokens": [50681, 18888, 8225, 45964, 22989, 101, 7781, 8661, 24043, 1546, 13387, 113, 43446, 1546, 21686, 8225, 3763, 1543, 50801], "temperature": 0, "avg_logprob": -0.18436267833017933, "compression_ratio": 1.4273743016759777, "no_speech_prob": 1.5507909192913338e-11}, {"id": 179, "seek": 42848, "start": 437.20000000000005, "end": 439.6, "text": "所以如果你追求只是要用,", "tokens": [50801, 7239, 45669, 39947, 32718, 36859, 4275, 9254, 11, 50921], "temperature": 0, "avg_logprob": -0.18436267833017933, "compression_ratio": 1.4273743016759777, "no_speech_prob": 1.5507909192913338e-11}, {"id": 180, "seek": 42848, "start": 439.6, "end": 440.96000000000004, "text": "那麼到這一步就可以停了。", "tokens": [50921, 20504, 4511, 32260, 31429, 36781, 36135, 2289, 1543, 50989], "temperature": 0, "avg_logprob": -0.18436267833017933, "compression_ratio": 1.4273743016759777, "no_speech_prob": 1.5507909192913338e-11}, {"id": 181, "seek": 42848, "start": 440.96000000000004, "end": 443.04, "text": "但如果你想達到咱剛才講過的那些參數,", "tokens": [50989, 8395, 13119, 38386, 33086, 4511, 8975, 109, 16940, 18888, 11932, 8816, 1546, 4184, 13824, 47375, 30622, 11, 51093], "temperature": 0, "avg_logprob": -0.18436267833017933, "compression_ratio": 1.4273743016759777, "no_speech_prob": 1.5507909192913338e-11}, {"id": 182, "seek": 42848, "start": 443.04, "end": 443.84000000000003, "text": "那些標準,", "tokens": [51093, 4184, 13824, 46299, 28220, 11, 51133], "temperature": 0, "avg_logprob": -0.18436267833017933, "compression_ratio": 1.4273743016759777, "no_speech_prob": 1.5507909192913338e-11}, {"id": 183, "seek": 42848, "start": 443.84000000000003, "end": 446.8, "text": "那麼你必須把這些條優項目挨個走一遍。", "tokens": [51133, 20504, 2166, 28531, 8313, 230, 16075, 29869, 31106, 12827, 103, 8313, 227, 11386, 8501, 101, 3338, 9575, 2257, 3330, 235, 1543, 51281], "temperature": 0, "avg_logprob": -0.18436267833017933, "compression_ratio": 1.4273743016759777, "no_speech_prob": 1.5507909192913338e-11}, {"id": 184, "seek": 42848, "start": 446.8, "end": 450.08000000000004, "text": "這也是之前很多人卡住或者性能不達標的地方。", "tokens": [51281, 2664, 22021, 32442, 20778, 4035, 32681, 21632, 31148, 21686, 8225, 1960, 33086, 46299, 1546, 30146, 1543, 51445], "temperature": 0, "avg_logprob": -0.18436267833017933, "compression_ratio": 1.4273743016759777, "no_speech_prob": 1.5507909192913338e-11}, {"id": 185, "seek": 42848, "start": 450.08000000000004, "end": 452.64000000000004, "text": "但是幸好現在是有AI的。", "tokens": [51445, 11189, 36482, 2131, 12648, 1541, 2412, 48698, 1546, 1543, 51573], "temperature": 0, "avg_logprob": -0.18436267833017933, "compression_ratio": 1.4273743016759777, "no_speech_prob": 1.5507909192913338e-11}, {"id": 186, "seek": 42848, "start": 452.64000000000004, "end": 454.64000000000004, "text": "這些活不用你來幹,", "tokens": [51573, 29869, 25956, 24384, 2166, 3763, 29932, 11, 51673], "temperature": 0, "avg_logprob": -0.18436267833017933, "compression_ratio": 1.4273743016759777, "no_speech_prob": 1.5507909192913338e-11}, {"id": 187, "seek": 42848, "start": 454.64000000000004, "end": 457.68, "text": "AI自己會找到自己需要條優的位置在那。", "tokens": [51673, 48698, 17645, 6236, 25085, 4511, 17645, 35748, 31106, 12827, 103, 1546, 11160, 34719, 3581, 4184, 1543, 51825], "temperature": 0, "avg_logprob": -0.18436267833017933, "compression_ratio": 1.4273743016759777, "no_speech_prob": 1.5507909192913338e-11}, {"id": 188, "seek": 45768, "start": 457.68, "end": 459.12, "text": "它都會幫大家一一調好。", "tokens": [50365, 11284, 7182, 6236, 32187, 6868, 2257, 2257, 32943, 2131, 1543, 50437], "temperature": 0, "avg_logprob": -0.20051178842220665, "compression_ratio": 1.518716577540107, "no_speech_prob": 1.6256827481408997e-11}, {"id": 189, "seek": 45768, "start": 459.12, "end": 461.84000000000003, "text": "這個條優的過程大約在半個小時左右的時間。", "tokens": [50437, 6287, 31106, 12827, 103, 1546, 8816, 29649, 3582, 30889, 3581, 30018, 3338, 46997, 29457, 1546, 20788, 1543, 50573], "temperature": 0, "avg_logprob": -0.20051178842220665, "compression_ratio": 1.518716577540107, "no_speech_prob": 1.6256827481408997e-11}, {"id": 190, "seek": 45768, "start": 461.84000000000003, "end": 463.36, "text": "根據你的顯卡可能不太一樣。", "tokens": [50573, 31337, 36841, 18961, 46605, 32681, 16657, 1960, 9455, 22977, 1543, 50649], "temperature": 0, "avg_logprob": -0.20051178842220665, "compression_ratio": 1.518716577540107, "no_speech_prob": 1.6256827481408997e-11}, {"id": 191, "seek": 45768, "start": 463.36, "end": 464.8, "text": "如果你的顯卡不要到老舊了,", "tokens": [50649, 13119, 18961, 46605, 32681, 11962, 4511, 10439, 10256, 232, 2289, 11, 50721], "temperature": 0, "avg_logprob": -0.20051178842220665, "compression_ratio": 1.518716577540107, "no_speech_prob": 1.6256827481408997e-11}, {"id": 192, "seek": 45768, "start": 464.8, "end": 466.40000000000003, "text": "那這個條優的時間可能會更久一點。", "tokens": [50721, 4184, 6287, 31106, 12827, 103, 1546, 20788, 16657, 6236, 19002, 25320, 19202, 1543, 50801], "temperature": 0, "avg_logprob": -0.20051178842220665, "compression_ratio": 1.518716577540107, "no_speech_prob": 1.6256827481408997e-11}, {"id": 193, "seek": 45768, "start": 466.40000000000003, "end": 468.64, "text": "引擎要做一個比較完整的適配。", "tokens": [50801, 41301, 13167, 236, 4275, 10907, 8990, 25174, 14128, 27662, 1546, 3330, 102, 38846, 1543, 50913], "temperature": 0, "avg_logprob": -0.20051178842220665, "compression_ratio": 1.518716577540107, "no_speech_prob": 1.6256827481408997e-11}, {"id": 194, "seek": 45768, "start": 468.64, "end": 470.96000000000004, "text": "如果你的AI卡住了怎麼辦?", "tokens": [50913, 13119, 18961, 48698, 32681, 21632, 2289, 42511, 30, 51029], "temperature": 0, "avg_logprob": -0.20051178842220665, "compression_ratio": 1.518716577540107, "no_speech_prob": 1.6256827481408997e-11}, {"id": 195, "seek": 45768, "start": 470.96000000000004, "end": 472.08, "text": "如果你的環境太刁鑽,", "tokens": [51029, 13119, 18961, 40063, 108, 47885, 9455, 2437, 223, 165, 239, 121, 11, 51085], "temperature": 0, "avg_logprob": -0.20051178842220665, "compression_ratio": 1.518716577540107, "no_speech_prob": 1.6256827481408997e-11}, {"id": 196, "seek": 45768, "start": 472.08, "end": 473.2, "text": "或者你的AI走偏了,", "tokens": [51085, 31148, 18961, 48698, 9575, 7437, 237, 2289, 11, 51141], "temperature": 0, "avg_logprob": -0.20051178842220665, "compression_ratio": 1.518716577540107, "no_speech_prob": 1.6256827481408997e-11}, {"id": 197, "seek": 45768, "start": 473.2, "end": 474.08, "text": "性能不是很達標,", "tokens": [51141, 21686, 8225, 7296, 4563, 33086, 46299, 11, 51185], "temperature": 0, "avg_logprob": -0.20051178842220665, "compression_ratio": 1.518716577540107, "no_speech_prob": 1.6256827481408997e-11}, {"id": 198, "seek": 45768, "start": 474.08, "end": 475.04, "text": "不是很聪明,走偏了,", "tokens": [51185, 7296, 4563, 8171, 103, 11100, 11, 9575, 7437, 237, 2289, 11, 51233], "temperature": 0, "avg_logprob": -0.20051178842220665, "compression_ratio": 1.518716577540107, "no_speech_prob": 1.6256827481408997e-11}, {"id": 199, "seek": 45768, "start": 475.04, "end": 476.32, "text": "卡住了有點難題了。", "tokens": [51233, 32681, 21632, 2289, 42440, 21192, 14475, 2289, 1543, 51297], "temperature": 0, "avg_logprob": -0.20051178842220665, "compression_ratio": 1.518716577540107, "no_speech_prob": 1.6256827481408997e-11}, {"id": 200, "seek": 45768, "start": 476.32, "end": 479.12, "text": "我們也給大家準備了排錯的手冊,", "tokens": [51297, 5884, 6404, 17798, 6868, 36241, 2289, 44647, 13133, 1546, 11389, 5676, 232, 11, 51437], "temperature": 0, "avg_logprob": -0.20051178842220665, "compression_ratio": 1.518716577540107, "no_speech_prob": 1.6256827481408997e-11}, {"id": 201, "seek": 45768, "start": 479.12, "end": 481.04, "text": "以及相應的排錯的處方。", "tokens": [51437, 40282, 15106, 20481, 1546, 44647, 13133, 1546, 39289, 9249, 1543, 51533], "temperature": 0, "avg_logprob": -0.20051178842220665, "compression_ratio": 1.518716577540107, "no_speech_prob": 1.6256827481408997e-11}, {"id": 202, "seek": 45768, "start": 481.04, "end": 483.04, "text": "我們總體的思想就是,", "tokens": [51533, 5884, 26575, 23987, 1546, 8870, 7093, 5620, 11, 51633], "temperature": 0, "avg_logprob": -0.20051178842220665, "compression_ratio": 1.518716577540107, "no_speech_prob": 1.6256827481408997e-11}, {"id": 203, "seek": 45768, "start": 483.04, "end": 486.4, "text": "讓AI嚴格的執行我們的部署的步驟,", "tokens": [51633, 21195, 48698, 29593, 112, 30921, 1546, 16262, 115, 8082, 33641, 13470, 16469, 110, 1546, 31429, 24023, 253, 11, 51801], "temperature": 0, "avg_logprob": -0.20051178842220665, "compression_ratio": 1.518716577540107, "no_speech_prob": 1.6256827481408997e-11}, {"id": 204, "seek": 48640, "start": 486.4, "end": 488.96, "text": "進行引擎的部署、編譯,", "tokens": [50365, 18214, 8082, 41301, 13167, 236, 1546, 13470, 16469, 110, 1231, 12608, 101, 11823, 107, 11, 50493], "temperature": 0, "avg_logprob": -0.19080403510560381, "compression_ratio": 1.423529411764706, "no_speech_prob": 1.6375222358644415e-11}, {"id": 205, "seek": 48640, "start": 488.96, "end": 491.67999999999995, "text": "以及最最重要的多項條優。", "tokens": [50493, 40282, 8661, 8661, 24928, 1546, 6392, 8313, 227, 31106, 12827, 103, 1543, 50629], "temperature": 0, "avg_logprob": -0.19080403510560381, "compression_ratio": 1.423529411764706, "no_speech_prob": 1.6375222358644415e-11}, {"id": 206, "seek": 48640, "start": 491.67999999999995, "end": 494.0, "text": "我們還給你的Agent一定的自主選擇權。", "tokens": [50629, 5884, 7824, 17798, 18961, 32, 6930, 24272, 1546, 9722, 13557, 21625, 13167, 229, 40212, 1543, 50745], "temperature": 0, "avg_logprob": -0.19080403510560381, "compression_ratio": 1.423529411764706, "no_speech_prob": 1.6375222358644415e-11}, {"id": 207, "seek": 48640, "start": 494.0, "end": 496.23999999999995, "text": "它可以根據你自己本機的環境,", "tokens": [50745, 11284, 6723, 31337, 36841, 2166, 17645, 8802, 17543, 1546, 40063, 108, 47885, 11, 50857], "temperature": 0, "avg_logprob": -0.19080403510560381, "compression_ratio": 1.423529411764706, "no_speech_prob": 1.6375222358644415e-11}, {"id": 208, "seek": 48640, "start": 496.23999999999995, "end": 497.44, "text": "來進行自行的工作,", "tokens": [50857, 3763, 18214, 8082, 9722, 8082, 1546, 41315, 11, 50917], "temperature": 0, "avg_logprob": -0.19080403510560381, "compression_ratio": 1.423529411764706, "no_speech_prob": 1.6375222358644415e-11}, {"id": 209, "seek": 48640, "start": 497.44, "end": 499.76, "text": "不一定非得參考我們的這麼一個標準。", "tokens": [50917, 1960, 24272, 12107, 5916, 47375, 26504, 33641, 21269, 8990, 46299, 28220, 1543, 51033], "temperature": 0, "avg_logprob": -0.19080403510560381, "compression_ratio": 1.423529411764706, "no_speech_prob": 1.6375222358644415e-11}, {"id": 210, "seek": 48640, "start": 499.76, "end": 500.4, "text": "在這兒,", "tokens": [51033, 3581, 2664, 35125, 11, 51065], "temperature": 0, "avg_logprob": -0.19080403510560381, "compression_ratio": 1.423529411764706, "no_speech_prob": 1.6375222358644415e-11}, {"id": 211, "seek": 48640, "start": 500.4, "end": 501.59999999999997, "text": "我們沒有辦法給大家承諾,", "tokens": [51065, 5884, 6963, 40072, 17798, 6868, 3416, 123, 11067, 122, 11, 51125], "temperature": 0, "avg_logprob": -0.19080403510560381, "compression_ratio": 1.423529411764706, "no_speech_prob": 1.6375222358644415e-11}, {"id": 212, "seek": 48640, "start": 501.59999999999997, "end": 502.88, "text": "所有人都能部署完成,", "tokens": [51125, 39300, 4035, 7182, 8225, 13470, 16469, 110, 41509, 11, 51189], "temperature": 0, "avg_logprob": -0.19080403510560381, "compression_ratio": 1.423529411764706, "no_speech_prob": 1.6375222358644415e-11}, {"id": 213, "seek": 48640, "start": 502.88, "end": 505.12, "text": "都能獲得極致的條優屬性。", "tokens": [51189, 7182, 8225, 29057, 110, 5916, 13387, 113, 6784, 112, 1546, 31106, 12827, 103, 9636, 105, 21686, 1543, 51301], "temperature": 0, "avg_logprob": -0.19080403510560381, "compression_ratio": 1.423529411764706, "no_speech_prob": 1.6375222358644415e-11}, {"id": 214, "seek": 48640, "start": 505.12, "end": 507.2, "text": "你可能哪個地方被你的Agent給掠過了,", "tokens": [51301, 2166, 16657, 17028, 3338, 30146, 23238, 18961, 32, 6930, 17798, 6900, 254, 8816, 2289, 11, 51405], "temperature": 0, "avg_logprob": -0.19080403510560381, "compression_ratio": 1.423529411764706, "no_speech_prob": 1.6375222358644415e-11}, {"id": 215, "seek": 48640, "start": 507.2, "end": 508.96, "text": "或者哪個地方被你給打斷了,", "tokens": [51405, 31148, 17028, 3338, 30146, 23238, 2166, 17798, 12467, 4307, 115, 2289, 11, 51493], "temperature": 0, "avg_logprob": -0.19080403510560381, "compression_ratio": 1.423529411764706, "no_speech_prob": 1.6375222358644415e-11}, {"id": 216, "seek": 48640, "start": 508.96, "end": 510.64, "text": "或者哪個地方你提前終止了,", "tokens": [51493, 31148, 17028, 3338, 30146, 2166, 20949, 8945, 29371, 30438, 2289, 11, 51577], "temperature": 0, "avg_logprob": -0.19080403510560381, "compression_ratio": 1.423529411764706, "no_speech_prob": 1.6375222358644415e-11}, {"id": 217, "seek": 48640, "start": 510.64, "end": 511.84, "text": "都是有可能的。", "tokens": [51577, 22796, 2412, 16657, 1546, 1543, 51637], "temperature": 0, "avg_logprob": -0.19080403510560381, "compression_ratio": 1.423529411764706, "no_speech_prob": 1.6375222358644415e-11}, {"id": 218, "seek": 51184, "start": 511.84, "end": 513.52, "text": "希望大家能夠理解。", "tokens": [50365, 29955, 6868, 8225, 31649, 13876, 17278, 1543, 50449], "temperature": 0, "avg_logprob": -0.20759535944739052, "compression_ratio": 1.528052805280528, "no_speech_prob": 1.6185400242285652e-11}, {"id": 219, "seek": 51184, "start": 513.52, "end": 515.12, "text": "我們整個的包裡面,", "tokens": [50449, 5884, 27662, 3338, 1546, 23305, 32399, 11, 50529], "temperature": 0, "avg_logprob": -0.20759535944739052, "compression_ratio": 1.528052805280528, "no_speech_prob": 1.6185400242285652e-11}, {"id": 220, "seek": 51184, "start": 515.12, "end": 517.12, "text": "還是包含了我們整個項目的所有的圓碼,", "tokens": [50529, 25583, 23305, 2392, 104, 2289, 5884, 27662, 3338, 8313, 227, 11386, 1546, 39300, 1546, 2523, 241, 16337, 120, 11, 50629], "temperature": 0, "avg_logprob": -0.20759535944739052, "compression_ratio": 1.528052805280528, "no_speech_prob": 1.6185400242285652e-11}, {"id": 221, "seek": 51184, "start": 517.12, "end": 518.0, "text": "我們整體的部署方案,", "tokens": [50629, 5884, 27662, 23987, 1546, 13470, 16469, 110, 9249, 28899, 11, 50673], "temperature": 0, "avg_logprob": -0.20759535944739052, "compression_ratio": 1.528052805280528, "no_speech_prob": 1.6185400242285652e-11}, {"id": 222, "seek": 51184, "start": 518.0, "end": 518.88, "text": "我們的採坑方案,", "tokens": [50673, 33641, 6900, 94, 14872, 239, 9249, 28899, 11, 50717], "temperature": 0, "avg_logprob": -0.20759535944739052, "compression_ratio": 1.528052805280528, "no_speech_prob": 1.6185400242285652e-11}, {"id": 223, "seek": 51184, "start": 518.88, "end": 520.16, "text": "不需要大家加情去群,", "tokens": [50717, 1960, 35748, 6868, 9990, 10570, 6734, 7248, 97, 11, 50781], "temperature": 0, "avg_logprob": -0.20759535944739052, "compression_ratio": 1.528052805280528, "no_speech_prob": 1.6185400242285652e-11}, {"id": 224, "seek": 51184, "start": 520.16, "end": 522.24, "text": "不需要大家去公共號。", "tokens": [50781, 1960, 35748, 6868, 6734, 13545, 15408, 18616, 1543, 50885], "temperature": 0, "avg_logprob": -0.20759535944739052, "compression_ratio": 1.528052805280528, "no_speech_prob": 1.6185400242285652e-11}, {"id": 225, "seek": 51184, "start": 522.24, "end": 525.28, "text": "大家直接就可以在我們視頻下面的鏈接裡面,", "tokens": [50885, 6868, 43297, 36781, 3581, 5884, 27333, 29940, 47150, 1546, 46241, 230, 14468, 32399, 11, 51037], "temperature": 0, "avg_logprob": -0.20759535944739052, "compression_ratio": 1.528052805280528, "no_speech_prob": 1.6185400242285652e-11}, {"id": 226, "seek": 51184, "start": 525.28, "end": 526.24, "text": "進行下載。", "tokens": [51037, 18214, 8082, 4438, 12290, 231, 1543, 51085], "temperature": 0, "avg_logprob": -0.20759535944739052, "compression_ratio": 1.528052805280528, "no_speech_prob": 1.6185400242285652e-11}, {"id": 227, "seek": 51184, "start": 526.24, "end": 527.68, "text": "完全的開源,", "tokens": [51085, 37100, 1546, 8949, 47402, 11, 51157], "temperature": 0, "avg_logprob": -0.20759535944739052, "compression_ratio": 1.528052805280528, "no_speech_prob": 1.6185400242285652e-11}, {"id": 228, "seek": 51184, "start": 527.68, "end": 528.8, "text": "完全的免費,", "tokens": [51157, 37100, 1546, 2347, 235, 50071, 11, 51213], "temperature": 0, "avg_logprob": -0.20759535944739052, "compression_ratio": 1.528052805280528, "no_speech_prob": 1.6185400242285652e-11}, {"id": 229, "seek": 51184, "start": 528.8, "end": 529.92, "text": "什麼都不要,", "tokens": [51213, 7598, 7182, 11962, 11, 51269], "temperature": 0, "avg_logprob": -0.20759535944739052, "compression_ratio": 1.528052805280528, "no_speech_prob": 1.6185400242285652e-11}, {"id": 230, "seek": 51184, "start": 529.92, "end": 532.72, "text": "只要大家手裡邊一個三連不過分吧。", "tokens": [51269, 14003, 4275, 6868, 11389, 11066, 14901, 8990, 10960, 36252, 1960, 8816, 6627, 6062, 1543, 51409], "temperature": 0, "avg_logprob": -0.20759535944739052, "compression_ratio": 1.528052805280528, "no_speech_prob": 1.6185400242285652e-11}, {"id": 231, "seek": 51184, "start": 532.72, "end": 535.1999999999999, "text": "最後給大家看一看我們的一個小彩蛋,", "tokens": [51409, 20578, 17798, 6868, 4200, 2257, 4200, 33641, 8990, 7322, 7391, 102, 35081, 11, 51533], "temperature": 0, "avg_logprob": -0.20759535944739052, "compression_ratio": 1.528052805280528, "no_speech_prob": 1.6185400242285652e-11}, {"id": 232, "seek": 51184, "start": 535.1999999999999, "end": 537.76, "text": "我們的一個超級大寶貝。", "tokens": [51533, 33641, 8990, 19869, 35315, 3582, 4510, 114, 11561, 251, 1543, 51661], "temperature": 0, "avg_logprob": -0.20759535944739052, "compression_ratio": 1.528052805280528, "no_speech_prob": 1.6185400242285652e-11}, {"id": 233, "seek": 53776, "start": 537.76, "end": 542.16, "text": "給大家看看我們的大寶貝。", "tokens": [50365, 17798, 6868, 22884, 33641, 3582, 4510, 114, 11561, 251, 1543, 50585], "temperature": 0, "avg_logprob": -0.40897839864095054, "compression_ratio": 1.0775862068965518, "no_speech_prob": 1.9888255972655422e-11}, {"id": 234, "seek": 53776, "start": 542.16, "end": 543.12, "text": "看一看,", "tokens": [50585, 4200, 2257, 4200, 11, 50633], "temperature": 0, "avg_logprob": -0.40897839864095054, "compression_ratio": 1.0775862068965518, "no_speech_prob": 1.9888255972655422e-11}, {"id": 235, "seek": 53776, "start": 543.12, "end": 545.28, "text": "GPU佔了27G,", "tokens": [50633, 38, 8115, 1593, 242, 2289, 10076, 38, 11, 50741], "temperature": 0, "avg_logprob": -0.40897839864095054, "compression_ratio": 1.0775862068965518, "no_speech_prob": 1.9888255972655422e-11}, {"id": 236, "seek": 53776, "start": 545.28, "end": 549.28, "text": "內存佔了84G。", "tokens": [50741, 28472, 39781, 1593, 242, 2289, 25494, 38, 1543, 50941], "temperature": 0, "avg_logprob": -0.40897839864095054, "compression_ratio": 1.0775862068965518, "no_speech_prob": 1.9888255972655422e-11}, {"id": 237, "seek": 53776, "start": 549.28, "end": 554.88, "text": "給大家拜個年吧。", "tokens": [50941, 17798, 6868, 16714, 3338, 5157, 6062, 1543, 51221], "temperature": 0, "avg_logprob": -0.40897839864095054, "compression_ratio": 1.0775862068965518, "no_speech_prob": 1.9888255972655422e-11}, {"id": 238, "seek": 53776, "start": 554.88, "end": 557.04, "text": "萬事如意。", "tokens": [51221, 14099, 6973, 8238, 9042, 1543, 51329], "temperature": 0, "avg_logprob": -0.40897839864095054, "compression_ratio": 1.0775862068965518, "no_speech_prob": 1.9888255972655422e-11}, {"id": 239, "seek": 53776, "start": 557.04, "end": 558.48, "text": "哈哈。", "tokens": [51329, 15964, 1543, 51401], "temperature": 0, "avg_logprob": -0.40897839864095054, "compression_ratio": 1.0775862068965518, "no_speech_prob": 1.9888255972655422e-11}, {"id": 240, "seek": 55848, "start": 558.48, "end": 560.48, "text": "。", "tokens": [50365, 1543, 50465], "temperature": 0, "avg_logprob": -1.2412945674015925, "compression_ratio": 0.9230769230769231, "no_speech_prob": 2.2184422354687428e-10}, {"id": 241, "seek": 55848, "start": 560.48, "end": 560.48, "text": "", "tokens": [], "temperature": 0, "avg_logprob": -1.2412945674015925, "compression_ratio": 0.9230769230769231, "no_speech_prob": 2.2184422354687428e-10, "words": []}, {"id": 242, "seek": 55848, "start": 560.48, "end": 560.48, "text": "", "tokens": [], "temperature": 0, "avg_logprob": -1.2412945674015925, "compression_ratio": 0.9230769230769231, "no_speech_prob": 2.2184422354687428e-10, "words": []}, {"id": 243, "seek": 55848, "start": 560.48, "end": 560.48, "text": "", "tokens": [], "temperature": 0, "avg_logprob": -1.2412945674015925, "compression_ratio": 0.9230769230769231, "no_speech_prob": 2.2184422354687428e-10, "words": []}], "language": "zh"}