GitHub

ashwini-madhavan/Eval-framework-example

Your laptop (VS Code) Azure Static Web Apps ─────────────────── ───────────────────── 1. Prep data python scripts/data_prep.py 2. Run eval python run_eval.py --agent1 data.xlsx 3. Publish python ...
IEEE

HLS-Eval: A Benchmark and Framework for Evaluating LLMs on High-Level Synthesis Design Tasks

Abstract: The rapid scaling of large language model (LLM) training and inference has accelerated their adoption in semiconductor design across academia and industry. Most prior works benchmark LLMs ...
WWLP-22News

Vectara Launches Open Source Framework for RAG Evaluation, Empowering Major Advances in ...

Built in Collaboration with a World-Renowned University of Waterloo Research Team, the Open RAG Eval Framework Brings Unprecedented Visibility and Optimization to Complex RAG Deployments PALO ALTO, ...
IEEE

PyHDL-Eval: An LLM Evaluation Framework for Hardware Design Using Python-Embedded DSLs

Abstract: Embedding hardware design frameworks within Python is a promising technique to improve the productivity of hardware engineers. At the same time, there is significant interest in using ...
GitHub

kuntal-c/eval-scope

Large Language Model (LLMs) evaluation has become a critical process for assessing and improving LLMs. To better support the evaluation of large models, we propose the Eval-Scope framework, which ...