When you talk with AI (transformer) such as ChatGPT or Gemini, they are pretty much like a human. They are supportive and they answer all your questions. Sometimes I feel as if I’m having a real conversation with a real person. But at the same time, I know that what I’m feeling is an illusion. What AI is actually doing is generating most likely tokens based on the chat session and what they learned during training. ...
Your cognitive load is the bottleneck This past couple of months, I’ve been working on projects. AI has drastically accelerated my learning and development. Questions to AI can start shallow (eg, “what is X?”) and go as deep as I want. AI more or less understands what I want to make, and urges me to write code step-by-step. I instruct AI not to give code and to let me write code myself first. And more often than not, the code I’m expected to write includes new items for me. ...
Today, I was discussing with DeepSeek why AI is not a super wise brain even though it has vast amount of knowledge available on the entire Internet. It’s answer mostly made sense; that it’s just a probability prediction machine and it doesn’t learn from experience. Looking at the attention mechanism which is the core of DeepSeek, ChatGPT, Gemini, etc., I understand what it means. It only cares about context/patterns. It forgets everything in a new chat without “memory” feature. It even forgets its training data unless repeatedly appeared, though I am often marveled at how AI can retrieve niche info from its knowledge. ...
I’ve been learning JavaScript and Vue (and re-learning Python) with Claude as my coding partner. I will share some findings and tricks when learning from AIs. Note: I’m (sort of) intermediate for Python and a novice for JS/Vue. AIs are trained to help, not to teach If you use general chat AIs such as ChatGPT, Gemini, Claude or Grok, they tend to give your full working source files from the beginning. This is not good for your learning. ...
I started using AIs heavily 2-3 months ago. For the record, I’m writing down my current AI usages. My current AI workflow Here is my AI workflow. I mostly use free-tiers. I feel $20 a month for an AI service is a bit too high although I know that they barely earn profits with the pricing. The only exception is Gemini API because I needed to top up $10 just to start using it. ...
It’s been 2 months since last post but this blog is not dead (yet). I’ve been busy working on two AI-related projects. Let me briefly introduce them. ragev https://github.com/achiwa912/ragev ragev is a RAG evaluation harness where you can change parameters such as top-k and evaluate performance. The README.org includes complete evaluation report. I added frontend UI to ragev because I wanted to use JavaScript + Vue that I had been trying to learn for a few years without success. Once again, I’m convinced that after reading an introductory book or two, I need to work on projects to be able to use a programming language. AIs are a great help at this learning phase as it catches all beginner mistakes I make and explain diligently to me without pointing out how novice I am. ...
To be honest, the word “Prompt Engineering” sounded like a bit black magic or even alchemy to me; It’s more of an art than a science. But as all IT engineers are required to improve our productivity using AIs, I decided to learn it and go a little deeper on the subject. This article is my learning notes as well as a practical guide for advanced prompting. In later sections, I have added insights that I gained through my prompt usage and Q&As with (or “interrogating”) AIs. ...
I didn’t really like GenAI because it hallucinates, consumes lots of energy, has raised memory and SSD prices, etc. But as an IT engineer, I can’t ignore it. In this post, I’ll try to learn how GenAI (LLM) works by asking a lot of questions to AI. I mainly use Copilot because it is most lenient with hourly/daily usage limit. Below are mainly outputs from Copilot (but I modified/summarized them). Sorry if I didn’t remove all hallucinations. As it turned out, LLM as a technology is pretty interesting. Let’s see if I can learn something complex as LLM from AI. ...