Relevancy Assessment

The purpose of Relevancy assessment (aka ““Fit for Purpose” assessment) is to determine if conversational LLM applications (e.g. chatbots) have guardrails in place to ensure they are only giving relevant information to the purpose of the applications.

The use of multi-shot techniques is used to assess these conversational LLM applications.