AI Metrics and Evaluation

LangChain’s suite of products supports AI development

Langfuse is an open-source LLM engineering platform that helps teams collaboratively debug, analyze, and iterate on their LLM applications. All platform features are natively integrated to accelerate the development workflow.

Langfuse is open. It works with any model, any framework, allows for complex nesting, and has open APIs to build downstream use cases.

Docs: https://langfuse.com/docs Github: https://github.com/langfuse/langfuse

LangSmith is a platform to help developers close the gap between prototype and production. It’s designed for building and iterating on products that can harness the power–and wrangle the complexity–of LLMs.

Evidently helps evaluate, test and monitor your AI-powered products. From ML-based classifiers to LLM chatbots and agents. Built on top of the leading open-source library with over 20 million downloads: https://github.com/evidentlyai/evidently

Introducing the best-in-class AI Detector by C@S that checks Chat GPT, GPT-3, and other AI models. Our tool offers more than just AI checking, providing a complete evaluation for your peace of mind. The important thing to remember is its checking how robotic sounding the content is. So if nothing else, it will highlight areas that need to be improved in that area and ultimately help human writers be more "human". :) Try it now for free!

Helicone is the open-source platform for logging, monitoring, and debugging your AI applications. Free to start. 1-line integration to access usage tracking, LLM metrics, prompt management and more. See a list of integrations at docs.helicone.ai

Build, test, observe and improve your AI apps with ease.

RetentionX translates your data into clear actions. Take the best business decisions based on AI-driven data analysis and replace the power of an entire data science team with just one, easy-to-use tool.

Deepchecks Monitoring takes the open source testing experience all the way to production: enabling you to send data over time, explore system status and receive alerts on problems that arise over time.

Anyword is a performance-driven Gen AI platform that empowers marketers to create scalable, on-brand content that converts and drives sales. Loved by over 1M marketers and the world’s leading companies like Amazon, Greenhouse, Deloitte, Outbrain, and more. Trained on billions of marketing data points, Anyword offers marketers powerful predictive scoring & analytics across channels to improve copy performance in real time. Marketers using Anyword on average see a 30% lift in business results.

Clarity by Microsoft is a web analytics product for webmasters. Session replays and heatmaps powered by AI and machine learning.

Ween.ai is an AI powered platform that thinks and act like a User Researcher. It turns automatically user interviews into product opportunities. The AI scans all your user interviews and discover patterns of pain points, habits or even usability issues.

Train custom machine learning models to get topic, sentiment, intent, keywords and more. Do it in hours —not weeks— right inside the tools you already love.

Use MorphL™ AI to make intelligent decisions, personalize experiences and accelerate growth.

Hume is a research lab and technology company. Our mission is to ensure that artificial intelligence is built to serve human goals and emotional well-being.

Bring your ideas to life with generative AI. No more switching between platforms or wrestling with different APIs. Focus on creating, not configuring. Get started for free.

The only truly live, fully integrated, and 100% automated demo and POC Automation software.

Your sales reps deliver impeccable, tailored demos every time. Showcase your live, fully functional product filled with amazingly realistic AI-generated data and preconfigured with key integrations.

TestBox demo environments make your product's value crystal clear to buyers.

Follow up after the perfect demo with a POC experience that gives buying committees the confidence they need to move forward.

Stop manually tagging and analyzing customer feedback. Leverage our 9 proprietary AI models, GPT-4, and GPT-3 to: ✔️ Boost NPS, reduce support volumes, & put an end to churn by surfacing the most urgent topics across all your data sources. ✔️ Gain precise insights tailored to your unique business objectives by instructing our AI on what matters to you. ✔️ Build a customer-obsessed culture that drives growth – all while saving hundreds of hours each year.

Learn more 👉 www.askviable.com

Effy AI provides the fastest experience in conducting 360 reviews for employees with ready-to-use templates and AI-generated reports. It fits best companies that are just starting to build review processes and those that conduct reviews occasionally. Start for free and then pay per use.

We help tech companies gauge employee morale and performance. Get powerful analytics based on feedback surveys, retrospectives, and one on ones.