neroued/ninfer

neroued/ninfer is a C++·CUDA engine providing text, image, and video inference plus a compatible server for some models and GPUs.

stars

★ 3.2K

Forks

673

Language

C++

License

Apache-2.0