This is really cool! I’m becoming convinced the optimal UI to engage with agents, long term is going to be something spatial. No idea shape that even takes, though I really feel what you’ve made might be Xerox PARC days in terms of metaphor maturity, but there’s some real new seeds of “obvious in retrospect” ideas here. Thanks for conceiving of and building this!
Haven't tried it yet, but I think we need something in that direction.
The terminal "Read file: xyz" mentions are not really followable.
It would be nice to easily see where the LLM is taking info from.
That's great but im not sure what the use cases are. Did you have something in mind when building this to help the conception process ? I dont feel like i need to know what the agent did, never opened the session json. But there could be gold in there perhaps.
This reminds me of that community epsiode where they get the VR system and the dean has to walk through a maze, climb up several things so that they can go to a filing cabinet and then retrive a file. Yes, its cool to see and watch but it seems to be adding more friction than reducing it. Like who is going to spend that much time watching what their agents did when there are far quicker and efficient ways of scanning through changes and organizing code with better ergonomics?
Tried exploring a small project i built with CC, but i don't see anything in the tree/terrain view (The edits/reads/writes do show up in the timeline). The project itself doesn't exist on my drive anymore, is that a requirement?
this is cool! i started tracking file changes across sessions with file hunk method on a binlog.. to see hot paths, or do partial reverts where files werent committed across my sessions. not for visual, but operational for the harness i use. approach lets you see the whole rollups on a period of days or minutes. think there are many use cases where you can run a side agent to check things / progress analyze risky areas as you go etc etcs .. all file change lookups are 3-5ms. script here: https://github.com/geeewhy/haicue-brew/tree/main/scripts
i wonder if i would be able to visualize with mindwalk
As a once-off, not much because the treemap or graph look arbitrary so it's just eye candy. But a small fast treemap in your IDE would quickly become something you depend on, just like minimaps turned out to be really useful to enough people that they become a default in vscode.
A lot of people want a use case. One I think might be cool is some kind of spatial/represented comparison: let's see how two different models interact with the codebase (for the same problem), what they touched, and what they did. Or the same model, but averaged across 100 runs, so we can see how much variance there really is per task. Something along those lines sounds interesting to me.
Hey OP, this is absolutely awesome and I am very much on your creative wavelength! I'd love to get in contact with you if you have a moment, as I've built an adjacent 3D visualizer that might complement the rendering portion of your system by providing actual glyph-level rendering of each file instead of block-based representations (glyph3d.dev). I have a similar "trace" feature that shows files pre/post edit from CC at the moment, so there is some definitely interesting overlap.
I think the chord diagram in the video is not informative. Generally speaking I suggest starting with the problem you are trying to shed light on, and devise the visualization accordingly. For example, if you are shipping a mobile app and want to keep your package small, the treemap in the video would help you understand how the space is allocated.
When it comes to coding sessions my problems are memory and inter-agent communication, for which I'm using https://ctx.rs/, and tracking, for which I'm testing https://usegitai.com/
I do not see what there is to be gained from replaying a session.
35 comments
[ 2.6 ms ] story [ 65.8 ms ] threadThanks OP.
i wonder if i would be able to visualize with mindwalk
Well done creating A Cool Thing!
* https://en.wikipedia.org/wiki/Chord_diagram_(information_vis...
* https://en.wikipedia.org/wiki/Treemapping
When it comes to coding sessions my problems are memory and inter-agent communication, for which I'm using https://ctx.rs/, and tracking, for which I'm testing https://usegitai.com/
I do not see what there is to be gained from replaying a session.