简要回顾 PyTorch 中关于 Tensor 形状变换的 API（如 view, reshape, unsqueeze, squeeze）以及 Einops 库中 rearrange, reduce, repeat 的用法。

This blog revisits the underlying principles of the Vision Transformer (ViT) and proposes explorations on extending the Transformer architecture to other modalities. For instance, in tasks such as "Weight2Weight," prior approaches have often simply flattened weights into one-dimensional tensors, without leveraging positional encodings.

1. 梯度范数 (Gradient Norm)在深度学习中,梯度是一个向量,表示损失函数相对于模型参数的偏导数。对于具有 n 个参数的模型,梯度可以表示为: $$\nabla L = (\frac{\partial L}{\par

In summary, this post covered my process of learning about process management through analyzing example process data, inspecting detailed process information, understanding basic process monitoring tools and models like SSH, and methods for checking concurrent account usage.

Summary of experience in hard disk mounting and permission management under Linux system

File-System Read-Only. Reboot and enter recovery mode to make it Write/Read.

Some notes about architect of UniDiffuser and Stable Diffusion. YueGangAo AI Algorithm Competition.

Learning Notes of Diffusers Course by HuggingFace. About how to create a pipeline of diffusion model from zero.

科学上网101：如何在国内使用 VPN 或代理服务器访问被墙的网站，从修改 Hosts 文件到使用 DNS 服务器

彼得林奇投资经典著作的key points，包括长期投资策略、股票类型鉴别和财务指标分析等。

Tricks to enhance your search experience using search engines.

课程笔记

课程笔记

课程笔记

课程笔记

课程笔记

课程笔记

飞书 ×（GPT-3.5 + DALL·E + Whisper） 🚀 Feishu OpenAI 🚀 👻 机器人功能🗣 语音交流：私人直接与机器人畅所欲言 💬 多话题对话：支持私人和群聊多话题讨论，高效连贯