TL;DR: My iPhone 16 Pro Max produces garbage output when running MLX LLMs. An iPhone 15 Pro runs the same code perfectly. A MacBook Pro also runs the same code perfectly. The tensor outputs on the 16 show numerical values an order of magnitude wrong. I suspect it points
  • MolochHorridus@lemmy.mlEnglish
    72·
    1 month ago

    Quite obviously not the optimal use case. “The tensor outputs on the 16 show numerical values an order of magnitude wrong.”