Langtail Roadmap, Feedback and Changelog

Enable integration and support for Anthropic models (specifically Claude) within the application.

Lot of open source models like LLama3, Phi, Mixtral are getting better and better. Langtail should support testing & deploying these as well

Develop a Python client library for Langtail, enabling seamless integration and usage of Langtail functionalities in Python applications.

There are many APIs available that are compatible with openai standard. Like fireworks.ai , togehter, claude etc. It would be great if we can add them as providers ourselves by changing the URLs

Hey, we are building an app that may send private data via LangTail. We want to make sure we dont save logs for the production deploy. We still want logs when we are testing the prompts or using other deployment tracks.

https://platform.openai.com/docs/api-reference/batch/create - this can be used to run Langtail tests cheaper, it would just take up to 24 hours to process

I store longs of my API calls to openAI, I want to be able to just copy the log and import it to Langtail so everything will be populated, including the tools and system messages.

Enable the sharing of assertions between prompts and projects, allowing for seamless reuse and consistency in testing and validation.

Enable the ability to create test cases directly from the application logs for efficient debugging and troubleshooting.