If you want audio transcription just add distill-whisper to the mix.
SAM2/Grounding DINO + Phi3.5 Instruct(Vision) give essentially an unlimited vocabulary
Nah, you can do all of this with a simple phi3.5 instruct + SAM 2, both of which fit into an Nvidia Jetson Orin 64 GB chip. We do this at scale in factories/warehouses describing everything that happens within like:…
Looks like the open interpreter project might be what you’re looking for.
If you want audio transcription just add distill-whisper to the mix.
SAM2/Grounding DINO + Phi3.5 Instruct(Vision) give essentially an unlimited vocabulary
Nah, you can do all of this with a simple phi3.5 instruct + SAM 2, both of which fit into an Nvidia Jetson Orin 64 GB chip. We do this at scale in factories/warehouses describing everything that happens within like:…
Looks like the open interpreter project might be what you’re looking for.