There's a photo here showing 600GBps memory bandwidth so maybe they have doubled it: https://www.servethehome.com/nvida-introduces-rtx-spark-an-a...
Looks like Antigravity cli is moving to weekly limits whereas Gemini cli was daily. Ouch
Kai | Engineering (Multiple) | Onsite (San Jose, CA) | Full-time Ai + Cybersecurity. Our Ai team is well funded, and growing. Although we have a dedicated engineering team, the Ai team is looking for dedicated engineers…
Microsoft used to with their Azure Service Dev Kit. the ASDK was a single-node "sandbox" meant to emulate the entire Azure cloud locally. They may have something similar now but paired back
Those keys are easily replaced, my friend.
Well… I did/do see many around the Bay Area. Especially during the morning commute. But I agree, overall it was a low volume car.
Toyota restricted the sale of its hydrogen fuel cell vehicles to specific, qualified customers who lived or worked near existing, functional hydrogen refueling stations. I remember looking into them when first released…
This video is pretty great. “The joke is this is not a joke” comment in there… how many of us understood everything that was said and then felt like maybe we need a different hobby…
This is such a great website. I have enjoyed reading the articles in the past. It was the final push that inspired me to build my own wheel set instead of buying a complete when I was building my new mountain bike piece…
If they have an Apple TV, you can just install the app and use it as an exit node. I would check out the devices that are on their network currently, chances are you can use one of those.
I started off using gpt-oss-120b on cpu. It uses about 60-65gb of memory or so but my workstation has 128gb of ram. If I had less ram, I would start off with the gpt-oss-20b model and go from there. Look for MoE models…
I don’t get it? Are they sharing a quote they liked or taking credit for it? Maybe they just saw the YouTube video and decided to turn it into the page? Edit: Seems like a way to show they’re looking for roles, I guess.
It sounds like you don’t need immediate llm responses and can batch process your data nightly? Have you considered running a local llm? May not need to pay for api calls. Today’s local models are quite good. I started…
I linked results where the user ran Kimi k2 across his 8-node cluster. Inference results are listed for 1,10,100 concurrent requests. Edit to add: Yeah, those stations with the GB300 look more along the lines of what I…
I mean, you could put together a cluster of dgx sparks (8 of them) and hit 100tps with high concurrency: https://forums.developer.nvidia.com/t/6x-spark-setup/354399/... Or a single user at about 10tps. This is probably…
I found that rotating my phone to landscape makes it readable, just as an fyi
Just yesterday I was reading through this five year old post on triton by its creator. Triton was their PHD thesis and they coined the name before the inference server was renamed to it… if this is what you are…
Well it looks like as you were typing your comment, a press release was going out announcing OpenAi’s $10B investment in Cerebras.
The server seems cool but the networking seems insufficient for data centers.
These are my thoughts exactly. If people enjoy the music, they will listen to it. If they don't, they wont.
Not a musician (dabble with the guitar from time to time but I do absolutely love music) and don’t make music but one of my best friends growing up has been playing instruments forever. He writes songs and song lyrics.…
I have read of people doing remote coding with clause but through having Claude create pull request. The user then looks through the requests, and either approves or sends it back with edits. Seems like a good way to…
"Even code at the club!" haha if you're coding at the club, just go home! but also, I really wish Sony still made their micro Vaio laptops (Sony Vaio P, for instance).
There's a photo here showing 600GBps memory bandwidth so maybe they have doubled it: https://www.servethehome.com/nvida-introduces-rtx-spark-an-a...
Looks like Antigravity cli is moving to weekly limits whereas Gemini cli was daily. Ouch
Kai | Engineering (Multiple) | Onsite (San Jose, CA) | Full-time Ai + Cybersecurity. Our Ai team is well funded, and growing. Although we have a dedicated engineering team, the Ai team is looking for dedicated engineers…
Microsoft used to with their Azure Service Dev Kit. the ASDK was a single-node "sandbox" meant to emulate the entire Azure cloud locally. They may have something similar now but paired back
Those keys are easily replaced, my friend.
Well… I did/do see many around the Bay Area. Especially during the morning commute. But I agree, overall it was a low volume car.
Toyota restricted the sale of its hydrogen fuel cell vehicles to specific, qualified customers who lived or worked near existing, functional hydrogen refueling stations. I remember looking into them when first released…
This video is pretty great. “The joke is this is not a joke” comment in there… how many of us understood everything that was said and then felt like maybe we need a different hobby…
This is such a great website. I have enjoyed reading the articles in the past. It was the final push that inspired me to build my own wheel set instead of buying a complete when I was building my new mountain bike piece…
If they have an Apple TV, you can just install the app and use it as an exit node. I would check out the devices that are on their network currently, chances are you can use one of those.
I started off using gpt-oss-120b on cpu. It uses about 60-65gb of memory or so but my workstation has 128gb of ram. If I had less ram, I would start off with the gpt-oss-20b model and go from there. Look for MoE models…
I started off using gpt-oss-120b on cpu. It uses about 60-65gb of memory or so but my workstation has 128gb of ram. If I had less ram, I would start off with the gpt-oss-20b model and go from there. Look for MoE models…
I started off using gpt-oss-120b on cpu. It uses about 60-65gb of memory or so but my workstation has 128gb of ram. If I had less ram, I would start off with the gpt-oss-20b model and go from there. Look for MoE models…
I don’t get it? Are they sharing a quote they liked or taking credit for it? Maybe they just saw the YouTube video and decided to turn it into the page? Edit: Seems like a way to show they’re looking for roles, I guess.
It sounds like you don’t need immediate llm responses and can batch process your data nightly? Have you considered running a local llm? May not need to pay for api calls. Today’s local models are quite good. I started…
I linked results where the user ran Kimi k2 across his 8-node cluster. Inference results are listed for 1,10,100 concurrent requests. Edit to add: Yeah, those stations with the GB300 look more along the lines of what I…
I mean, you could put together a cluster of dgx sparks (8 of them) and hit 100tps with high concurrency: https://forums.developer.nvidia.com/t/6x-spark-setup/354399/... Or a single user at about 10tps. This is probably…
I found that rotating my phone to landscape makes it readable, just as an fyi
Just yesterday I was reading through this five year old post on triton by its creator. Triton was their PHD thesis and they coined the name before the inference server was renamed to it… if this is what you are…
Well it looks like as you were typing your comment, a press release was going out announcing OpenAi’s $10B investment in Cerebras.
The server seems cool but the networking seems insufficient for data centers.
These are my thoughts exactly. If people enjoy the music, they will listen to it. If they don't, they wont.
Not a musician (dabble with the guitar from time to time but I do absolutely love music) and don’t make music but one of my best friends growing up has been playing instruments forever. He writes songs and song lyrics.…
I have read of people doing remote coding with clause but through having Claude create pull request. The user then looks through the requests, and either approves or sends it back with edits. Seems like a good way to…
"Even code at the club!" haha if you're coding at the club, just go home! but also, I really wish Sony still made their micro Vaio laptops (Sony Vaio P, for instance).