Header Ads

ad728
  • Breaking News

    Show HN: Proxima serves 4x more requests with no hardware change on vLLM https://ift.tt/0qKnftl

    Show HN: Proxima serves 4x more requests with no hardware change on vLLM hey everyone, i decided to make a vLLM plugin that implements the Star-KV paper. the results are quiet promising with a decode kernel thats faster than FA2 in higher batch sizes. would love any thoughts and recommendations https://ift.tt/Q2DMmZl August 11, 2026 at 08:34PM

    No comments

    Post Top Ad

    ad728

    Post Bottom Ad

    ad728