If you havenโt yet, be sure to try out ๐ฎ๐ถ๐๐๐ถ๐๐ฒ python library by Andrew Ng.
Itโs pretty simple but powerful. If you are using more than one LLM provider in your applications or you are testing which provider fits your use case the best, this abstraction layer is very convenient.What does the library do?
โก๏ธ Provides a unified interface for models of different third party providers.
โก๏ธ Uses a convenient notation of <๐ฑ๐ณ๐ฐ๐ท๐ช๐ฅ๐ฆ๐ณ>:<๐ฎ๐ฐ๐ฅ๐ฆ๐ญ_๐ต๐ข๐จ> to call different apis. My thoughts:
โ
I love how notation similar to container tagging is used to invoke different APIs. It follows software engineering best practices and allows for efficient model versioning in your Agentic apps.
โ
Useful for quickly testing different combinations of Prompt x Model.
โ
Open Source - different providers are open to include themselves in the list of supported models.
โน๏ธ In general, you would be implementing similar abstractions in your agentic application code - it makes it easier to maintain the codebase due to unified abstraction over multiple providers.
โ It implements API ๐๐ถ๐บ๐ถ๐น๐ฎ๐ฟ ๐๐ผ ๐ข๐ฝ๐ฒ๐ป๐๐ library. Will the abstraction stick well? Weโll see. Looking forward to the library evolving!
Install the library by running:
โก๏ธ pip install aisuite
or
โก๏ธ pip install aisuite[all] - if you want to install provider libraries (required) together with ๐ข๐ช๐ด๐ถ๐ช๐ต๐ฆ.
Github repo: lnkd.in/dTRibHda you already used ๐ข๐ช๐ด๐ถ๐ช๐ต๐ฆ? Let me know in the comment section ๐
If you want to get some insights about AI Engineering, I have wrote an article sharing my thoughts here: