Ask HN: No interest for my idea (private LLM and RAG for teams), how to proceed?
I've been working on an AI + RAG B2B app for the past few weeks.
It's a AI chat interface for teams, to allow fast and private conversations with all company data (think Perplexity but searches on your company's data)
It uses open-source LLMs and has RAG integration with Jira, Slack, etc via LlamaIndex stored on the Weaviate vector DB.
Everything can be 1 click self-hosted for maximum privacy.
There are some similar products in this space so I know there's some demand.
But, I can't figure out a way to find potential users to talk to.
So far, I've tried Twitter ads and have found some people through my network, but in total it's only a couple of people who are actively talking to me.
What approach can work in this stage to get more people from my target audience to check out my product?
Or is this not a valid idea at all, and I should switch to working on something else?
(Link for the curious: prosgpt.com)
Cheers, N
21 comments
[ 3.6 ms ] story [ 33.2 ms ] threadThe main purpose of the app is allowing team members to search through the entire company knowledgebase
E.g. one can search through Jira to find all open tickets relating to a particular feature
Or, you can search through slack to find threads relating to a topic of your choice
Show how it would work in practice, show how it is better than normal Jira search. Show why I should use your project instead of the many, many others?
I agree with your assessment but I'm having a difficult time thinking of how I could "show" rather than tell (I'm a developer and sales/marketing is my weak point)
Possible to share some more details on what you have in mind?
There are literally 100s of this same application. Here's the start to mine:
https://topicalsource.dev/chat/8e8c2bdf-41f4-4fd6-b8db-9bbda...
See how I am (1) providing something people could log into and try; and (2) providing the ability to have public posts that are sticky between visits, even for non-users (localStorage gimmic)
Here's a second link so you can see the public menu grow
https://topicalsource.dev/chat/84a0d6dd-f66f-4f12-af17-5e99c...
Will probably have a page/search for public chats eventually (private by default)
I only made this available in the last week, no signups outside my network yet either, but the goal isn't really a basic chat / rag app for business, I'm definitely looking at the b2c area, but not for your data. The goal is to work on the misinformation / trust problem that is starting and only getting worse
TopicalSource looks great, and you're right using an example is 100x clearer than reading the website.
Follow you on X btw, keep me updated on TopicalSource this might be something I'd use.
https://bsky.app/profile/verdverm.bsky.social/post/3kx5x22yx...
(Gemini rick-rolled me...)
This is a really exciting area to build a software business, there is huge potential.
Think about the audiences you need to get through to: potential customers yes, but maybe also systems integrators, consultants, agencies.
We can assume that there are many B2B service-oriented companies that have good client portfolios but do not have RAG-LLM-integration skills, some of these could be good targets to partner with.
You could consider focusing on a particular industry segment. Do an analysis to identify the most promising sectors. Build knowledge and contacts in your chosen sector(s).
More accurate target marketing in specialist media for that sector will give you more bang for your marketing bucks.
You could also contract with one or more independent sales reps who specialize in software sales. There are a bunch of platforms for 'commission based sales agents' that can link you up with software sales people.
I have more thoughts and will email you if you want to chat further.
Email: hi [at] nmn.gl
Discord: nmnyg
Cheers!
Beyond that, emphasizing privacy while also advertising your use of models from OpenAI, Anthropic, Google, etc., is confusing. In my understanding, the central challenge of enterprise “chat with your company data” is how to do it without giving the data to cloud model providers. Self-hosting the server where the model calls are made doesn’t address this at all and I think you may risk engineers and security people viewing this as misleading marketing as a result.
Regarding the privacy aspects: i should have made this clearer in the landing page, I also offer the option to use local/self-hosted llms through ollama. Thanks for the reminder, I'll update this soon.
Makes sense about the local models. Definitely a good idea to make that clearer imo.
Plus, almost all of them will either be single model or involve heavy tracking which I can compete on
The issue is not the idea, which is about as obvious as “b2b spreadsheets” would have been in 1981. The value of the pitched product is self evident, if it works. But why should anyone choose to try it over the many relatively mature alternatives?
If you want to win any slice of the pie, you’re going to need to find some way to differentiate, and some kind of growth hack or flywheel to systematically expand. Preferably you can identify one vertical and use case where you can offer features that are sufficiently specialized for buyers to choose your product over generic solutions.
In other words: don’t try to be everything for everyone. Instead of wasting your time building pipelines for 1000 sources that nobody will use, pick a cluster of them and hitch your wagon to that. Go deep on that use case, and if you find success, only then begin to expand “wide,” deliberately and methodically.
I admire your ambition, but personally I’d consider attacking the problem from a different angle. This is a crowded space with well-funded competitors.
I'll try to figure out some ways to further niche it down.
If you have any advice on what angles pass this check I'd be happy to hear more about that.
I suggest you research those industries and make a list of their most used specialized software, which is unlikely to be connected already to a generic RAG solution. Then map out the industry size and participants: can you find some 10-50 employee companies to sell to? Locate their technology leaders (e.g. CTO or CIO) and ask them if you can do some user research for a product you think could help them (offer to compensate with a gift card). Prepare a list of questions, both specific and open-ended, and be prepared to have a discussion where you actively listen to them and probe deeper on their pain points. After the interview, ask to stay in touch and if they’d be interested in another session when you’ve developed a prototype they can play with.
Take this as hard earned advice from someone who spent five years paying for the mistake of “do everything for everyone:” DO USER RESEARCH. Everybody says it, hardly anyone does it. It’s tempting to think you know better, but trust me, you do not. It is the absolute best way to spend your time now, to figure out who you can sell to and what exactly to build for them, so you do not waste time building features and connectors that nobody will ever use. Also, if you do it right, those user research subjects could eventually become your first customers.