AI・機械学習
Mac M4 CoreMLオフラインでのLaya (OS Jev) (毎秒45回の決定)
Laya (OS Jev) on Mac M4 CoreML Offline (45 decisions per second) (gist.github.com)
要約
Mac M4 CoreMLオフライン環境で、毎秒45回の推論処理が可能なLaya（OS Jev）のデモが紹介されています。GitHub Gistでコードが公開されており、ローカル環境でのAIモデル実行の可能性を示唆しています。
全文翻訳
fordnox/laya.sh
| mkdir test-laya | |
| cd test-laya | |
| uv init | |
| uv add 'laya-coreml[demo]' | |
| hf download aac6fef/laya-multilingual-coreml-ane --local-dir models/snake | |
| uv run laya-coreml-snake --model models/snake |
Copy link Copy Markdown
Author
testing https://github.com/mizorewww/laya-coreml
LAYA-CORE-ML.mov [［動画］]
［画像: Screenshot 2026-09-20 at 19 02 52］
Memory usage
Analysis of sampling python (pid 26208) every 1 millisecond
Process: python3.12 [26208]
Path: /Users/USER/*/python3.12
Load Address: 0x10017c000
Identifier: python3.12
Version: ???
Code Type: ARM64
Platform: macOS
Parent Process: uv [26207]
Target Type: live task (Roots Present)
Date/Time: 2026-09-20 23:05:12.300 +0300
Launch Time: 2026-09-20 23:03:49.632 +0300
OS Version: macOS 27.0 (26A428)
Report Version: 7
Analysis Tool: /usr/bin/sample
Physical footprint: 560.4M
Physical footprint (peak): 778.0M
Idle exit: untracked
Copy link Copy Markdown
Nice! I just wanted to see what Laya does and put it behind Cloudflare's typesafe/jev API:
curl https://laya.inference.zaitlabs.com/ai/run \
-H "Content-Type: application/json" \
-d '{
"state": "Help! My payouts have been failing for 3 days.",
"questions": {
"is_urgent": {"type": "noul", "instructions": "Does this convey urgency?"}
}
}'
{"answers":{"is_urgent":{"type":"noul","noul":0.7894}}}
https://laya.inference.zaitlabs.com/terms
Copy link Copy Markdown
can i use it on windows?
Copy link Copy Markdown
can i use it on windows?
This, model is built for Apple Silicon. So, you can’t run this on Windows, you need to look for another variant and procedure.