产品随想 | 周刊第82期：Let's think step by step

Products

VideoChat with MOSS https://github.com/OpenGVLab/Ask-Anything/tree/main/video_chat_with_MOSS
VideoChat is a multifunctional video question answering tool that combines the functions of Action Recognition, Visual Captioning and StableLM. Our solution generates dense, descriptive captions for any object and action in a video, offering a range of language styles to suit different user preferences. It supports users to have conversations in different lengths, emotions, authenticity of language.
让AI看懂视频，适用长视频场景，决策是否值得投入时间看
ChatGLM-6B https://github.com/THUDM/ChatGLM-6B
ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型
还有130B，它最強的點，倒是底層的跨GPU平臺運行的能力（當然，情感上我個人還是傾向於歐美GPU，當然Fuck Nvidia是需要堅持的）
GLM-130B：开源的双语预训练模型：https://keg.cs.tsinghua.edu.cn/glm-130b/zh/posts/glm-130b/
Knowledge Engineering Group (KEG) & Data Mining at Tsinghua University
在消費級別PC上能RUN，是個必然的趨勢，期待
MiniGPT-4 https://github.com/Vision-CAIR/MiniGPT-4
Enhancing Vision-language Understanding with Advanced Large Language Models
增強視覺理解，官方的一個Demo是根據視頻中的圖片，描述出對應的文本信息
MiniGPT-4 可以生成準確的圖像描述，根據圖像編寫文本，為圖片描述的問題提供解決方案，甚至可以根據照片教用戶如何做某些事情。（也就是GPT-4在Demo中呈現過的能力）
gpt4free https://github.com/xtekky/gpt4free
收到OpenAI律師函的項目，必然有可取之處
GPT-3 Demo https://gpt3demo.com/map
Real-time Market Map
基於GPT能力在應用層做嘗試的APP們
Advancing AGI for humanity https://thegenerality.com/agi/blog.html
裏面的論文值得讀讀
ControlNet https://github.com/lllyasviel/ControlNet
ControlNet is a neural network structure to control diffusion models by adding extra conditions.
可以將這個技術理解成是illustrator中的錨點
TaskMatrix https://github.com/microsoft/TaskMatrix
TaskMatrix connects ChatGPT and a series of Visual Foundation Models to enable sending and receiving images during chatting.
與多模態LLM有本質上的差別

Ideas

智慧信息的压缩：模型智能的涌现之道 https://mp.weixin.qq.com/s/hQmvltuMlClBonM6UJmtLg
OpenAI 不需要 langchain：
从传统产业链逻辑来说，OpenAI 提供基础模型能力，langchain 提供开发工具，这原本是没有太大冲突的，但是从获取更多含有人类智慧数据目标的角度，langchain 的存在会让“开发者是如何构建某种应用”这样一份极具价值的“有效数据”脱离 OpenAI 的控制范围。
——這裏非常有insight，值得關注
“对于以 AGI 为目标的 OpenAI 来说，所有的应用似乎只是下一阶段 AGI 能力的“有效数据”的免费提供者。”
這個邏輯在世界層面上，會造就模型集中，寡頭，在中國，可能也會聚攏到1-2家
投身LLM，要从本质上想明白的三个问题 https://zhuanlan.zhihu.com/p/618902095
牢記表層的知識、事實，會最先被淘汰、替換，最深層的思考認知，纔是最關鍵、不可替換的
Compression for AGI https://mp.weixin.qq.com/s/G613tUo4TzjddaysGs26AQ
找到解决感知问题的最小描述长度
這個思路和張小龍做微信的思路，也很一致，即找到原子化的組件，讓組件去流動、流通，核心思路也是找到解決問題的最小化、最優雅的方案
解读 ChatGPT 背后的技术重点：RLHF、IFT、CoT、红蓝对抗 https://zhuanlan.zhihu.com/p/602458131
Toolformer: Language Models Can Teach Themselves to Use Tools https://arxiv.org/abs/2302.04761
里程碑式的能力
https://kikaben.com/toolformer-2023/ 這篇文章，配合Yann LeCun的Twitter，對Toolformer的理解能更深
“The limits of my language means the limits of my world. ” ——
Despite this, one still needs to approximate closer and closer to the truth through probabilistic truth. The representations of language are inherently wrong but it is very useful, it enables humans to convey propositions of the world and gain a deeper understanding and interaction with reality. This ability enables us to gain insight into the nature of consciousness and the human condition, an experience that is uniquely human.
突然開始理解，當年Silas拼命讓我們寫好Leads的原因.....因爲寫那些Description的過程，就是讓自己對世界產生更深認知的過程
OpenAI正式推出多模态GPT-4 https://mp.weixin.qq.com/s/iw0wESsyP8nkPuFkj_EkOg
当任务的复杂性达到足够的阈值时，区别就出来了，GPT-4比GPT-3.5更可靠，更有创造力，能够处理更细微的指令。
开源OpenAI Evals,用于创建和运行评估GPT-4等模型的基准，同时逐个样本检查其性能。

Steve Jobs at 44, By Michael Krantz, 1999

Differences and Similarities Between Apple and Pixar Apple turns out many products--a dozen a year; if you count all the minor ones, probably a hundred. Pixar is striving to turn out one a year. But the converse of that is that Pixar's products will still be used fifty years from now, whereas I don't think you'll be using any product Apple brings to market this year fifty years from now. Pixar is making art for the ages. Kids will be watching Toy Story in the future. And Apple is much more of a constant race to continually improve things and stay ahead of the competition. His Role At Pixar At Pixar my job is to help build the studio and recruit people and help create a situation where they can do the best work of their lives. And to some degree it's the same at Apple. But at Pixar, I don't direct the movies, whereas at Apple probably, if I had to pick a role out of a film production, I'd be the director. So it...

阅读全文

《Becoming Steve Jobs》Chapter 12 Two Decisions

Jim Collins, the bestselling author of the management classics Built to Last: Successful Habits of Visionary Companies and Good to Great: Why Some Companies Make the Leap … and Others Don’t, has a wonderful phrase to describe an essential characteristic of great leaders: deep restlessness. Collins applies the phrase to Steve, one of the two great leaders who inspire him the most (the other is Winston Churchill, the great English politician who was prime minister during most of World War II, from 1940 to 1945, and again from 1951 to 1955). Collins believes this restlessness is far more important and powerful than simple ambition or raw intelligence. It is the foundation of resilience, and self-motivation. It is fueled by curiosity, the ache to build something meaningful, and a sense of purpose to make the most of one’s entire life. 自己何其有幸，在不到30的年纪，就能感受到乔布斯的心境 “The things he was trying to do,” says Collins, “were always hard. Sometimes those things beat him up. But the response to fighti...

阅读全文

《Becoming Steve Jobs》Chapter 15 The Whole Widget

What the world did see was an effective and visionary leader at the height of his powers. These were complicated years for Apple, but Steve handled almost every challenge in exactly the manner he wanted. He had fallen into leadership at such a young age, but he was comfortable in that role now, and justifiably sure of his capacity to guide Apple’s tens of thousands of employees to the goals he set for them. During these years, he would ensure the company’s continued success in personal computers by engineering a deft switch to a new kind of microprocessor; ruthlessly and successfully managing some major transitions in his executive team; and optimizing and building upon the efficiency and ambition of the company’s product development “treadmill,” as Tim Cook describes it. This is also when he delivered what is likely to be remembered as the most notable product of his life, the iPhone, and then improved even that by pivoting once again into a strategy he personally had not wanted to pu...

阅读全文

产品随想 | 陪读《Make Something Wonderful：Steve Jobs in his own words》1976-1996

There’s lots of ways to be, as a person. And some people express their deep appreciation in different ways. But one of the ways that I believe people express their appreciation to the rest of humanity is to make something wonderful and put it out there. And you never meet the people. You never shake their hands. You never hear their story or tell yours. But somehow, in the act of making something with a great deal of care and love, something’s transmitted there. And it’s a way of expressing to the rest of our species our deep appreciation. So we need to be true to who we are and remember what’s really important to us. ──Steve, 2007 Introduction by Laurene Powell Jobs Much of what’s in these pages reflects guiding themes of Steve’s life: his sense of the worlds that would emerge from marrying the arts and technology; his unbelievable rigor, which he imposed first and most strenuously on himself; his tenacity in pursuit of assembling and leading great teams; and perhaps, above all,...

阅读全文

360T7 刷机步骤及固件

https://cmi.hanwckf.top/p/360t7-firmware/ 360T7的固件支持由immortalwrt-mt798x项目提供支持，请参考： https://cmi.hanwckf.top/p/immortalwrt-mt798x https://github.com/hanwckf/immortalwrt-mt798x 刷机步骤参考此处的办法开启原厂固件的UART和telnet功能在以下链接下载360T7测试固件（纯净版，无任何插件） https://wwd.lanzout.com/b0bt9idwd 密码:ezex （此固件已过时，请选择其它更新的固件）接下来将刷入修改版uboot。修改版uboot的优点有：固件分区可达108MB，原厂uboot只能使用36M 自带一个简单的webui恢复页面到以下仓库的Release页面下载uboot，目前暂时仅支持360T7，后续将支持更多mt798x路由器。推荐使用 mt7981_360t7-fip-fixed-parts.bin ， fixed-parts 代表uboot分区表在编译期间固定，不会随着uboot环境变量变化。 https://github.com/hanwckf/bl-mt798x/releases/latest 将 mt7981_360t7-fip-fixed-parts.bin 通过HFS等方式上传到路由器，使用以下命令刷入uboot mtd write mt7981_360t7-fip-fixed-parts.bin fip 确认刷入完毕后，拔掉路由器电源。然后将电脑的IP地址设置为固定的 192.168.1.2 ，接着按住路由器的RESET按钮后通电开机，等待8s后用浏览器进入 192.168.1.1 在uboot恢复页面选择要刷入的固件。immortalwrt-mt798x目前编译两个版本的360T7固件。建议修改版uboot直接使用 immortalwrt-mediatek-mt7981-mt7981-360-t7-108M-squashfs-factory.bin ，两种固件区别如下： mt7981-360-t7-108M 为108M固件分区，原厂uboot不可启动，需要修改版u...

阅读全文

ISSUU使用指南--木喵

作者：木喵出处： Wonderworks 问：issuu是什么？答：Issuu是国外的一个在线文档共享网站，它是你的PDF文档发布专家。它类似于我们熟悉的youtube，但它共享的是文档、杂志之类的文本。简而言之、同志们想看国外的各种杂志？想找国外的汇报文本么？想借鉴国外学生的作品集么？那么你就要用到它啦~ 今天主要和大家讲两个方面一、如何在pc端使用和下载issuu上的pdf文档首先我们打开issuu的网址 https://issuu.com/ 我们可以很清楚的看到网页上呢都是国外的杂志以及一些作者自己制作的pdf文档首先我们点击右上角的 sign up 然后填写相关信息注册一个账户：注册完成之后我们就可以搜索我们想要找的资料：比如说，我想找一些分析图的资料，我们就搜索： architecture diagram 然后我们就可以看到相关的文档了：点击你所选择的文档，好了问题来了： sorry，this publication is not available 这个时候！就需要在用pc端的我们做一件必不可少的事：翻墙然后我们就能将页面刷新粗来了好、接下来是非常有建设性意义的一步怎样把我们网页上的文件下载下来呢？截图？ no~no~no~ 接下来，让木喵告诉你怎么下载：首先你需要复制上面的网址然后将 https://wenfan.hk/issuu/index_link.php 在另一个网址中打开将你之前复制的pdf的网址粘贴在下面的对话框中点击 I‘m not a robot 再点击 get it 然后会出现一堆网址代码我们全选打开你的迅雷点击新建将你之前的复制粘贴到下载链接里然后呢~我们就全都下载成功啦~ 然后我们回到之前的网页向下看我们可以看到有上传文档的作者（记得要关注哟）然后还有 info share stack ❤ 如果...

阅读全文

Foobar2000 组件安装教程

原作者博客地址汉化作者 Asion博客关于foobar 2000的一些资源前言 foobar2000 由于其软件架构特点以及开放的姿态，使得第三方很容易开发组件（component）来拓展它的功能。由于在官网下载的默认安装文件只带了少量几个默认的组件，满足不了使用的需求，例如：默认不带 ape，tta，tak 等音频文件格式的解码器，很多无损压缩格式音乐没法播放。所以自己下载安装组件是必备的基本技能。 foobar2000 的中文汉化版（Asion 汉化）为了方便使用，集成了无损压缩文件解码器以及一些其它有用的插件，安装时选上即可，不喜欢折腾的建议使用汉化版。这里组件指的是 foobar2000 标准组件（*.dll 文件），而非 vst 插件等其它插件，姑且把组件分为两类：官方组件：英文版安装包自带，安装时可选择；第三方组件：非官方自带的组件除了 foo_input_std.dll 和 foo_ui_std.dll 这两个组件是必须的外，其它的所有组件都非必需的，可以随需要增删。第三方组件可以去官网、官方论坛或者官方 wiki 去找，也可以去贴吧等地逛逛。下载还是要强调一下，这里说的是 foobar2000 component ，不是中文网上通常说的 vst 插件。下载好的组件包一般是 xxx.zip 或 xxx.fb2k-component 格式的文件，也有用 7z 打包的。前两种都是 zip 压缩（只要把 fb2k-component 改成 zip 文件就变成了 zip：包）。标准状况下压缩包里的内容结构应该是 xxx.zip yyy.dll README.txt (可能没有) LICENCE.txt (可能没有) (其它杂七杂八）除少数外一般只有一个 xxx.dll 文件.一定要注意压缩包结构不能是: xxx.zip yy folder (文件夹） zzz.dll … 否则要解压缩，提取那个 dll 文件。安装方法一（推荐）打开 foobar2000 的菜单文件 > 首选项(file >preferences) 的组件(components...

阅读全文

巴菲特致股东信-1976年

笔记：为什么选择轻资产行业：当竞争疯狂时，不会强迫加入降价大战最终选择了费雪的思想，选择能理解的优秀企业，以合理的价格买入并长期拥有翻译：雪球：https://xueqiu.com/6217262310/131440258 备份：https://archive.ph/XLK0S 原文： To the Stockholders of Berkshire Hathaway Inc, After two dismal years, operating results in 1976 improved significantly. Last year we said the degree of progress in insurance underwriting would determine whether our gain in earnings would be "moderate" or "major." As it turned out, earnings exceeded even the high end of our expectations. In large part, this was due to the outstanding efforts of Phil Liesche's managerial group at National Indemnity Company. In dollar terms, operating earnings came to $16,073,000, or $16.47 per share. While this is a record figure, we consider return on shareholders' equity to be a much more significant yardstick of economic performance. Here our result was 17.3%, moderately above our long-term average and even further above the average o...

阅读全文

《Becoming Steve Jobs》Chapter 11 Do Your Level Best

As a mass-market consumer electronics device, the iPod would eventually be sold, of course, all the usual places: Best Buy, Circuit City, big-box department stores, and even the computer retailers like CompUSA. Steve disdained all these outlets. His obsession with his products continued well after they’d been manufactured. The tacky, low-margin hustle of these chains ran completely against the minimalist aesthetic of his products and the clean exuberance of his marketing. There was only one place where he really enjoyed seeing his products sold to the public: his own Apple stores, which had debuted four months ahead of the iPod. 觉得那些喧嚣、嘈杂的零售渠道，配不上自己极美的产品 Going back as far as the debut of the Mac, Steve had always groused about the way Apple computers were sold in its resellers’ stores. The way his computers were displayed and sold represented the very worst of what could go wrong when things weren’t done his way. The salespeople, always interested in quick turnover, seemed to make litt...

阅读全文

《Becoming Steve Jobs》Chapter 16 Blind Spots, Grudges, and Sharp Elbows

Steve could be pretty thin-skinned when someone prominent criticized the aesthetics of his products. He took great umbrage that Neil would, as Steve put it, “pop off in public like that without coming to talk to us about his technical concerns first.” From that point on he had rebuffed all of Neil’s attempts to smoke the peace pipe. 有趣 He had blind spots, grating behavioral habits, and a tendency to give in to emotional impulse that persisted his entire life. These characteristics are often used to make the case that Steve was an “asshole” or a “jerk,” or perhaps simply “binary”—that odd adjective often used to convey the sense that he was half asshole/half genius from birth to death. These aren’t useful, interesting, or enlightening descriptions. What’s more illuminating is to take a look at the specific ways in which Steve failed to do an effective job of tempering some of his weaknesses and antisocial traits, and to consider how, when, and why some of them continued to flare up even...

阅读全文

产品随想的博客

搜索此博客