HN Explorer

platypii

↗ HN profile [ 67.8 ms ] full profile

No user record in our sample, but platypii has activity below (stories or comments). Likely we have partial data — the full bulk-load will fill profiles in.

  1. A visual explainer of how to scroll through billions of rows in the browser (rednegra.net)
    3 points 1
  2. Ask HN: Where are you keeping your LLM logs?

    LLM logs are crushing my application logging system. We recently launched AI features on our app and went from ~100mb/month of normal website logs to 3gb/month of llm conversation logs and growing. Our existing logging…

    1 points 2
  3. Show HN: Squirreling: a browser-native SQL engine (blog.hyperparam.app)

    I made a small (~9 KB), open source SQL engine in JavaScript built for interactive data exploration. Squirreling is unique in that it’s built entirely with modern async JavaScript in mind and enables new kinds of…

    2 points 0
  4. Best way to annotate large parquet LLM logs without full rewrites?

    I asked this on the Apache mailing list but haven’t found a good solution yet. Wondering if anyone has some ideas for how to engineer this? Here’s my problem: I have gigabytes of LLM conversation logs in parquet in S3.…

    2 points 2
  5. Ask HN: Local tools for working with LLM datasets?

    I’ve been doing data science for years, and am very familiar with jupyter notebooks and more recently been using duckdb a lot. But now I have this huge pile of output tokens from my 4090s, and it feels…

    2 points 0
  6. What UI do you use on top of data engineering tools to look at data?

    Tools like DuckDB Wasm and data engineering platforms like Iceberg leverage Parquet’s built-in indexing to very efficiently query files over the network. But as I’ve been building data tools myself, the stack gets…

    1 points 1
  7. Show HN: We built an AI tool for working with massive LLM chat log datasets (hyperparam.app)

    There’s an important problem with AI that nobody’s talking about. AI’s entire lifecycle is tons of data in for training, and an even larger amount of text data out. Traditional tools can’t handle the sheer volume of…

    16 points 1
  8. Lessons from Hyperparam's year of open source data transformation (blog.hyperparam.app)
    1 points 1
  9. Ask HN: How far can we push the browser for large-scale data parsing?

    How far can we push the browser as a data engine — not just for visualizations, but for curating and querying large datasets? Do we need traditional backend architectures? I wanted to see what happens when we treat the…

    1 points 1
  10. The Quest for Instant Data (blog.hyperparam.app)
    16 points 1
  11. Show HN: Hyperparam: OSS tools for exploring datasets locally in the browser (hyperparam.app)

    For the last year I’ve been developing Hyperparam — a collection of small, fast, dependency-free open-source libraries designed for data scientists and ML engineers to actually look at their data. - Hyparquet: Read any…

    77 points 22
  12. 1 points 0
  13. Hyparquet.js: World's Smallest and Most Conformant Parquet File Parser (github.com)
    3 points 1
  14. Show HN: Hyparquet 1.0 – Apache Parquet Parser for the Browser (github.com)

    I started 6 months ago when I wanted to look inside datasets from Hugging Face. I was not satisfied with existing libraries. So, naturally, I built my own library from scratch. Parquet is a very complicated format. It…

    6 points 3
  15. Tracking Economic Development with Open Data and Predictive Algorithms (socrata.com)
    10 points 0
  16. Algorithm Development is Broken (blog.algorithmia.com)
    80 points 55