Microsoft has unveiled Mu, a compact language model designed for Copilot+ PCs. This AI model is built to provide fast and private AI interactions directly on the device.
Mu operates on the Neural Processing Unit (NPU), ensuring high-speed performance without cloud reliance. It powers the new Settings agent, allowing users to adjust system settings through natural language.
Mu features a transformer-based encoder-decoder structure with only 330 million parameters. This design enables quicker responses and lower memory demands. Testing shows significant speed improvements, generating over 100 tokens per second.
The model supports hundreds of system settings, blending AI intelligence with traditional search results. This aligns with Microsoft's broader AI integration efforts, including the development of other AI models.