Lot of open source models like LLama3, Phi, Mixtral are getting better and better.

Langtail should support testing & deploying these as well