3
LLM Inference Endpoint Performance Benchmarking Tool (github.com/ray-project)
5 months ago | richardliaw | github.com | frontpage
3
A comprehensive guide to building RAG-based LLM applications for production (github.com/ray-project)
6 months ago | richardliaw | github.com | newest
2
Ray – an open source project for scaling AI workloads (github.com/ray-project)
8 months ago | richardliaw | github.com | newest
1
Continuous batching enables 23x throughput in LLM inference (anyscale.com)
10 months ago | richardliaw | anyscale.com | newest
12
Anyscale's Aviary is a dashboard for evaluating Open Source LLMs (anyscale.com)
11 months ago | richardliaw | anyscale.com | newest
127
Numbers every LLM developer should know (github.com/ray-project)
11 months ago | richardliaw | github.com | best
1
How to build a LLM search engine using a self-hosted LLM (anyscale.com)
a year ago | richardliaw | anyscale.com | newest
2
Ray is the next generation ML framework (super.site)
a year ago | richardliaw | super.site | newest