Phi 3 and Mistral 7B Serverless API deprecation notice

microsoft/Phi-3-mini-4k-instruct and mistralai/Mistral-7B-Instruct-v0.2 serverless APIs will be deprecated on 18th January 2025. That means Phi3 mini and Mistral 7B LLM Serverless APIs will no longer process any requests from 18th January 2025 onwards.

We encourage you to transition to our other LLM APIs i.e. Google/gemma-2-9b-it and meta-llama/Meta-Llama-3.1-8B-Instruct Serverless LLM APIs.

We are soon going to add more optimized Serverless LLM APIs to enable use-cases such as multi-step reasoning and multi-lingual conversation.

For usage details and implementation guidance on using the existing Models, please refer to our documentation here:

LLM APIs
Image Gen Model APIs
Speech processing Model APIs
Data augmentation APIs