agencies

I want to have a local device that will serve web apps to my Android browser over bluetooth or wifi *while my Android is still connected to normal wifi or mobile data*. I have thought about trying local http proxies…

I recently completed a small web crawl including only pages linked from HN stories. For example I would crawl the lwn article from https://news.ycombinator.com/item?id=32614633. I used archive.org's wayback machine to…

Where do folks keep up with and ask questions about sota performance code (e.g. simd, hashmap tuning, allocators, Dan Lemire, gaming code optimizations, etc.)? Stackoverflow? Particular forums?

HN links to over 6 million urls in stories and comments. Many domains have expired or content is no longer available. Internet archive has much of the content but throttles requests. What's the fastest way to get the…

How much does it cost to crawl all urls that are linked from hackernews submissions and comments? Ballpark at least 3.5 million story urls. Several services would likely do this for several thousand dollars but I'm…

Is there an updated dump of hackernews that picks up where pushshift data ends? Specifically asking about web hosted flat files (for much easier access than BigQuery). https://files.pushshift.io/hackernews/

For a local machine to be able to load and serve say 10 different machine learning models (assume model sizes are 500MB to 1GB in size) at the same time, what are good enough GPUs to run classification without worrying…

There is usually smaller versions of models provided that are likely to work on a Nano 4GB, but give up some accuracy. I'm curious to find examples when people found these smaller models not quite good enough.

To improve web search, we need to break down problems and make algorithms, code, and data accessible. For starters, we need a communal dataset of 50-100 million urls/data/metadata that's "good" (for any value of good)…

If you had the 4 billion pages Google had on its index in 2004 in elasticsearch today, what would it take to replicate 2004-era web search quality using that static index? What relevant research or projects are trying…

A handful of places are working to make web search better (for any value of better). The clueweb dataset (eg [1]) has been around quite a while but is it actually useful for any real world purposes? Common crawl is…

In your experience has your startup kept up salary raises with inflation? Or are salaries largely flat?

What are your go-to maps APIs for budget minded businesses? Where is there still room for improvement? The Google price hike was a while ago but APIs continue to be too expensive for folks [1]. [1]…

What freelance agencies do you know of or use to help develop MVPs, validate markets, etc. There were some on the recent "who wants to be hired?", but I'm sure there many out there who are always looking for leads.