Hacker News headlines

1

Native LLM APIs in Ray Data and Ray Serve (anyscale.com)

a week ago | robertnishihara | anyscale.com | newest

2

Joins and Hash-Shuffle in Ray Data (anyscale.com)

a week ago | robertnishihara | anyscale.com | newest

2

AsyncFlow: An Asynchronous Streaming RL Framework for LLM Post-Training (arxiv.org)

a week ago | robertnishihara | arxiv.org | newest

1

Open Source RL Libraries for LLMs (anyscale.com)

2 weeks ago | robertnishihara | anyscale.com | newest

1

Large-Scale Deployment of Ray in Tencent's Weixin AI Infrastructure (anyscale.com)

2 weeks ago | robertnishihara | anyscale.com | newest

17

Uv and Ray: Pain-Free Python Dependencies in Clusters (anyscale.com)

3 weeks ago | robertnishihara | anyscale.com | frontpage

1

Roll: Reinforcement Learning Optimization for Large-Scale Learning (github.com/alibaba)

a month ago | robertnishihara | github.com | newest

1

An Open Source Stack for AI Compute: Kubernetes and Ray and PyTorch and VLLM (anyscale.com)

a month ago | robertnishihara | anyscale.com | newest

1

Uv and Ray: Pain-Free Python Dependencies in Clusters (anyscale.com)

5 months ago | robertnishihara | anyscale.com | newest

1

Ray Batch Inference at Pinterest (Part 3) (medium.com/pinterest-engineering)

9 months ago | robertnishihara | medium.com | newest

1

Direct Preference Optimization with Synthetic Data on Anyscale (anyscale.com)

11 months ago | robertnishihara | anyscale.com | newest

1

Building an LLM Router for High-Quality and Cost-Effective Responses (anyscale.com)

a year ago | robertnishihara | anyscale.com | newest

1

Ray Infrastructure at Pinterest (medium.com/pinterest-engineering)

a year ago | robertnishihara | medium.com | newest

2

Lessons from training a Stable Diffusion model on 2B images (anyscale.com)

a year ago | robertnishihara | anyscale.com | frontpage

1

Canva Built a Modern AI Platform Using Anyscale (anyscale.com)

a year ago | robertnishihara | anyscale.com | newest

2

Building RAG-Based LLM Applications for Production (anyscale.com)

a year ago | robertnishihara | anyscale.com | newest

1

Fine-tuning LLMs for longer context and better RAG systems (anyscale.com)

a year ago | robertnishihara | anyscale.com | newest

2

Two-day hands-on RAG Bootcamp for developers (twitter.com/martin_casado)

a year ago | robertnishihara | twitter.com | newest

1

RAG at Scale: 10x Cheaper Embedding Computations with Anyscale and Pinecone (anyscale.com)

a year ago | robertnishihara | anyscale.com | newest

1

Comparing LLM Performance: Introducing the Open Source Leaderboard for LLM APIs (anyscale.com)

a year ago | robertnishihara | anyscale.com | newest

2

LLMPerf Leaderboard (github.com/ray-project)

a year ago | robertnishihara | github.com | newest

2

Anyscale Endpoints: JSON Mode and Function Calling Features (anyscale.com)

a year ago | robertnishihara | anyscale.com | newest

1

LLM summarization: A case study of human, Llama-2, & GPT-4 summarization quality (anyscale.com)

a year ago | robertnishihara | anyscale.com | newest

2

Reproducible Performance Metrics for LLM Inference (anyscale.com)

a year ago | robertnishihara | anyscale.com | newest

1

Building Rag-Based LLM Applications for Production (anyscale.com)

a year ago | robertnishihara | anyscale.com | newest

1

Anyscale Endpoints: LLM inference and fine-tuning (anyscale.com)

a year ago | robertnishihara | anyscale.com | newest

1

Anyscale Private Endpoints and Anyscale Endpoints Fine-Tuning (anyscale.com)

a year ago | robertnishihara | anyscale.com | newest

3

Loading Llama-2 70B 20x faster with Anyscale Endpoints (anyscale.com)

a year ago | robertnishihara | anyscale.com | newest

50

A Comprehensive Guide for Building Rag-Based LLM Applications (github.com/ray-project)

a year ago | robertnishihara | github.com | best

6

Llama 2 is about as factually accurate as GPT-4 for summaries and is 30X cheaper (anyscale.com)

a year ago | robertnishihara | anyscale.com | newest

2

Nearly all LLMs will be multi-modal (twitter.com/robertnishihara)

a year ago | robertnishihara | twitter.com | frontpage

4

ByteDance Scales Offline Inference with Multi-Modal LLMs to 200 TB Data (anyscale.com)

a year ago | robertnishihara | anyscale.com | newest

95

Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Models (anyscale.com)

a year ago | robertnishihara | anyscale.com | best

1

Distributed Machine Learning at Instacart (instacart.com)

2 years ago | robertnishihara | instacart.com | newest

2

ChatGPT got all the buzz, but beneath it is a $1B developer framework (businessinsider.com)

2 years ago | robertnishihara | businessinsider.com | newest

1

Training One Million Machine Learning Models in Record Time with Ray (anyscale.com)

2 years ago | robertnishihara | anyscale.com | newest