<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Machine Learning</title><link>https://blog.ast.moe/en/tags/machine-learning/</link><description>Recent posts: Gorimuchu</description><generator>Hugo</generator><item><title>It's not about generating text. What kind of AI is Jev?</title><link>https://blog.ast.moe/en/blog/2026-10-01/</link><pubDate>Thu, 01 Oct 2026 11:33:14 +0900</pubDate><guid>https://blog.ast.moe/en/blog/2026-10-01/</guid><description>&lt;h2 id="overview"&gt;Overview&lt;/h2&gt;
&lt;p&gt;Even if you encounter the name “Jev,” it’s not immediately clear whether it’s an AI that answers questions in chat, a search model, or a scaled‑down version of an existing large language model. I myself built a MCP server that uses Jev, but knowing how to call its API and understanding its return values are separate issues.&lt;/p&gt;
&lt;p&gt;
&lt;span&gt;
&lt;a target="_blank" href="https://docs.typesafe.ai/introduction"&gt;
Jev from TypeSafe AI
&lt;/a&gt;
&lt;img class="external-link-icon" src="https://blog.ast.moe/images/outer-link.png" width="12" height="12" alt="" aria-hidden="true" loading="lazy"&gt;
&lt;/span&gt;
is a model that, given input information, returns a judgment on predefined questions. Rather than producing free‑form explanatory text, it returns values suitable for programmatic handling—such as the probability of a “yes” answer, probabilities for each candidate, tiered ratings, and so on. For example, you feed it a query text and have it evaluate whether it concerns an invoice inquiry, a shipping inquiry, or whether it needs to be routed to a specific person. Rather than reading the answer and continuing the conversation, the usage is that the code receiving the answer decides the next action to take.&lt;/p&gt;</description></item><item><title>Evaluation of FP6 Quantization in Small-Scale Image Super‑Resolution DNNs: Condition Exploration and Comparison of Residual and Direct Generation Architectures</title><link>https://blog.ast.moe/en/blog/2026-09-24-2/</link><pubDate>Thu, 24 Sep 2026 22:07:00 +0900</pubDate><guid>https://blog.ast.moe/en/blog/2026-09-24-2/</guid><description>&lt;h2 id="overview"&gt;Overview&lt;/h2&gt;
&lt;p&gt;We compared image quality and file size when using a small image‑upscaling DNN with FP16 weights converted to FP6. In the search for optimal quantization settings, the PSNR improved on four validation images but decreased on another set of four images. Afterwards, we evaluated using 174 images divided into five groups by acquisition series, as well as 12 images that had not been used until the FP16 baseline was fixed. Even with roughly the same number of parameters, the degradation caused by uniform conversion to FP6 differed markedly between residual‑type and direct‑generation‑type models. The comparison of the 12 final FP6 images was added after viewing the FP16 results, so it does not constitute a new blind evaluation.&lt;/p&gt;</description></item><item><title>LLM Quantization from the Perspective of FP6: Where to Allocate Limited Bits</title><link>https://blog.ast.moe/en/blog/2026-09-24/</link><pubDate>Thu, 24 Sep 2026 13:43:00 +0900</pubDate><guid>https://blog.ast.moe/en/blog/2026-09-24/</guid><description>&lt;p&gt;While researching quantization for LLMs, I found myself wondering in what situations FP8 would actually be useful. Further investigation revealed that FP6 and FP4 also exist. I became curious about how to store values in a 6‑bit format—an oddly sized width—and how much precision a floating‑point number with so few bits could actually represent.&lt;/p&gt;
&lt;p&gt;When you list the values representable by FP6, the spacing between adjacent numbers becomes clearly visible—a detail that is usually overlooked with the floating‑point formats we use daily. Even with the same 6 bits, the spacing changes depending on how the bits are allocated between the exponent and the mantissa. That raises the question: could we choose the representation to match the distribution of the weights?&lt;/p&gt;</description></item><item><title>Designing a circuit to attempt machine learning with analog electronics</title><link>https://blog.ast.moe/en/blog/2026-08-13/</link><pubDate>Thu, 13 Aug 2026 20:59:43 +0900</pubDate><guid>https://blog.ast.moe/en/blog/2026-08-13/</guid><description>&lt;p&gt;Last time we discussed how combining multiplication based on Ohm’s law with addition based on Kirchhoff’s current law could enable us to represent the neural network’s multiply‑accumulate operation in a physical circuit.&lt;/p&gt;
&lt;p&gt;This time, assuming we will eventually build an actual hardware circuit, we first consider the minimal circuit configuration.&lt;/p&gt;
&lt;p&gt;In this simulator we will keep the resistor values fixed and dynamically vary the voltage output from the microcontroller.&lt;/p&gt;
&lt;p&gt;With this setup, the weight updates and multiplications are performed on the microcontroller side, while the analog circuit handles voltage summation and inversion. We’re not trying to implement all of machine learning with an analog circuit, but this level of setup should be sufficient for first confirming the correspondence between the equations and the circuit.&lt;/p&gt;</description></item><item><title>Can machine learning be implemented with analog circuits?</title><link>https://blog.ast.moe/en/blog/2026-08-12-2/</link><pubDate>Wed, 12 Aug 2026 21:01:23 +0900</pubDate><guid>https://blog.ast.moe/en/blog/2026-08-12-2/</guid><description>&lt;h2 id="wouldnt-it-be-interesting-to-do-machine-learning-with-analog-circuits"&gt;Wouldn&amp;rsquo;t it be interesting to do machine learning with analog circuits?&lt;/h2&gt;
&lt;p&gt;Lately, large language models have become popular, but they require a lot of GPUs, money, and electricity. I thought it would be fascinating to try doing this with analog circuits.&lt;/p&gt;
&lt;p&gt;The calculations performed by neural networks are essentially multiplication and addition.&lt;/p&gt;
&lt;p&gt;So, this time I’ll give a rough overview starting from the basic theory.&lt;/p&gt;
&lt;h2 id="what-is-analog-computation"&gt;What is analog computation?&lt;/h2&gt;
&lt;p&gt;In digital computers, numbers are represented as combinations of 0s and 1s. Even if the voltage changes slightly during a calculation, the original information can be recovered as long as the change stays within the range where 0 and 1 can still be distinguished.&lt;/p&gt;</description></item></channel></rss>