LocalAI 4.11.0: local-to-remote failover, retries limited to pre-response errors
LocalAI 4.11.0 puts ordered local and remote models behind one name. It can switch targets on selected failures, but only before the response starts.
devotd.
Recent developments, checked against their sources.
LocalAI 4.11.0 puts ordered local and remote models behind one name. It can switch targets on selected failures, but only before the response starts.