FiX: fine-grained forgetting in softmax attention
Yongduck Kim examines FiX’s feature-wise gates, numerical implementation and paged cache, distinguishing reported gains from unresolved limitations.
Read articleAnalysis of IP practice, AI technology and international protection, alongside news from IPLEX. Explore the articles in English.
336 articles and updates
62 articles
Yongduck Kim examines FiX’s feature-wise gates, numerical implementation and paged cache, distinguishing reported gains from unresolved limitations.
Read articleYongduck Kim examines Multi-Head Attention Residuals: depth routing, reported training results, implementation costs and the relationship between technical features and effects.
Read articleWriting for AI Times, IPLEX Managing Partner Yongduck Kim examines the training data behind computer-operating AI agents through U.S. Patent No. 12,585,862.
Read articleExplore how IPLEX combines AI and software expertise with a practical understanding of business strategy. The interview discusses education for founders, mentoring and communication with clients.
Read articleThis guide explains the issues to consider and the materials to prepare when seeking patent protection for AI technology.
Read articleAI Times, a Korean AI publication, has published Managing Partner Yongduck Kim's column on artificial intelligence patents.
Read articleWe advise on applications and patent strategy for AI, generative AI and LLMs, machine learning, deep learning and software.
Read articleReward-based reinforcement learning is increasingly used to improve the reasoning capabilities of large language models. PPO-style policy optimization is a common approach. Methods such as GRPO, Dr.GRPO, GSPO and REINFORCE++ modify advantage estimation or normalization while seeking to avoid excessive policy changes in a single update...
Read articleThe term AI agent is used widely, but its meaning varies. It may describe a chatbot with search capabilities or a system that plans tasks and operates external tools. Recent research explores these distinctions...
Read articleConversational AI can lose track of requirements as a discussion grows longer. A model may repeat a corrected mistake or continue relying on an earlier assumption even though the conversation remains in its context...
Read articleAI Times, a Korean AI publication, has published Managing Partner Yongduck Kim's column on generative AI patents.
Read articleAn AI agent asked to navigate a website, find information and recover from a failed action faces a different task from simply answering a question. It must coordinate a sequence of actions, observations and decisions, including correcting errors along the way...
Read article