All pull requests

Pull requests

• feat: Reuse gRPC inference request across retries

  #936·parammadan opened Oct 10, 2026·8 of 10 tasks·

  ·
  1

  3

• build: remove -Werror from library build options

  #917·fwinkl opened Aug 18, 2026·

  ·
  1

  2

• fix: Make CUDA shared memory stream cache thread-safe in Python client

  #915·jpbhdrey opened Aug 9, 2026·

  ·
  1

• Mchornyi/tri 971 cmake client dependency management

  #901·mc-nv opened Jun 9, 2026Contributor·

  ·

• feat: Enable bfloat16 input/output tensor dtype in Python client

  enhancement
  #880·yinggeh opened Feb 14, 2026Contributor·

  ·
  10

  

• Add type hints to simple_grpc_aio_infer_client.py

  #878·gwencasey96 opened Feb 11, 2026·5 tasks done·

  ·

• init aiohttp.TCPConnector with keepalive_timeout param

  #872·oOTWK opened Dec 12, 2025·

  ·

• Allow thread in grpc _InferStream be daemon

  #867·pavelkochnev opened Nov 19, 2025·

  ·
  1

• Add testing of python client on github actions against multiple python versions

  #863·springmeyer opened Nov 11, 2025·

  ·
  2

• feat: add gzip & deflate compression support for java

  #846·math-hiyoko opened Aug 5, 2025·

  ·
  1

• feat: Add getOutputAsString function to Java client

  #844·hossamelshamyy opened Jul 29, 2025·

  ·

• Add proxy support to http tritonclient

  #842·hytromo opened Jul 11, 2025·

  ·

• fix get_output while as_json=True

  #829·p-constant opened Mar 28, 2025·

  ·

• Fix typo

  #786·MasterYi1024 opened Sep 27, 2024·

  ·

• Cancel the requests in streaming case by default when closing the connection

  #781·Tabrizian opened Sep 10, 2024Member·

  ·
  1

• feat: Client-side input shape/element validation

  enhancement
  #742·yinggeh opened Jul 9, 2024Contributor·7 of 11 tasks·

  ·
  31

  

• Piotrm request client

  #707·piotrm-nvidia opened Jun 17, 2024Contributor·

  ·
  1

• feature: triton generate support

  #675·nnshah1 opened May 24, 2024Contributor·

  ·
  23

• Fast PA teardown

  #674·tgerdesnv opened May 24, 2024Contributor·

  ·
  7

• fix is_contiguous_logic issue in dlpack

  #668·wjddn279 opened May 20, 2024·

  ·
  4

• Ci updates

  #665·nvda-mesharma opened May 17, 2024·

  ·

• Fixing memory leakage when using dlpack

  #631·ParshikovMM opened May 5, 2024·

  ·
  4

• return response metadata to associate it with request

  #613·sydnash opened Apr 26, 2024·

  ·

• [Windows] Support CPU shared memory (Client/Frontend)

  #551·fpetrini15 opened Mar 27, 2024Contributor·

  ·
  20

• Add gRPC stream client example for java

  #441·zhansg opened Nov 28, 2023·

  ·