dnth

I spent the past 3 weeks building x.infer, a Python package that lets you run computer vision inference on a framework of choice. It currently supports models from transformers, Ultralytics, Timm, vLLM and Ollama.…

In this post, I show how to speed up inference for PyTorch image classification models (from TIMM) using ONNX Runtime and TensorRT optimizations. Key techniques covered: - Converting PyTorch models to ONNX format -…

Visualizing your dataset (especially large ones) in a low-dimensional embedding space can tell you a lot about the patterns and clusters in your dataset. We recently release a notebook showing how you can visualize your…