New Delhi, June 26 -- Microsoft has rolled out a small AI model called Mu that runs locally on Copilot+ PCs. It is designed to give users fast and accurate help by using the device's Neural Processing Unit instead of relying on cloud servers. Mu already supports the Windows Settings app for users in the Windows Insider Dev Channel. You can type natural language queries like "turn on night light," and Mu understands and responds in real time.

The model has 330 million parameters and uses a Transformer encoder-decoder setup. This allows it to process input and output separately, which leads to better speed and lower delay. Microsoft claims that Mu generates more than 100 tokens per second and has much lower latency than other models of its...