In my own experience, if the problem is not solvable by a LLM. No amount of prompt "engineering" will really help. Only way to solve it would be by partially solving it (breaking down to sub-tasks / examples) and let it…
So did you just combine Title+Abstracts+Authors into a single chunk and embed them or embedded them individually?
I always wondered where to start learning reverse-engineering. Most people will say learn Assembly first. But from there on, there seems to be not much more concrete information online. Do people just figured it out by…
Thanks. "In-context learning" was the phrase I was looking for. Also, I found these 2 links pretty good too. 1. http://ai.stanford.edu/blog/understanding-incontext/ 2. http://ai.stanford.edu/blog/in-context-learning/…
I think some earlier NLP applications have something called "Unknown token", which they will replace any unseen word. But for recent implementations, I don't think they are being used anymore. It still baffles me why…
Not completely related. Does anyone know where I can find articles / papers that discuss why transformers, while acting as merely "next token predictor" can handle questions with: 1. Unknown words (or subwords/tokens)…
Thanks, that make sense. I think my comment was not worded properly. I was thinking "geometry properties = linear properties", what I really should say is: Why does the latent space has geometry properties where we…
where did ).exe came from? I thought you need to use VBscript of some sort to download a file from command line.
In my own experience, if the problem is not solvable by a LLM. No amount of prompt "engineering" will really help. Only way to solve it would be by partially solving it (breaking down to sub-tasks / examples) and let it…
So did you just combine Title+Abstracts+Authors into a single chunk and embed them or embedded them individually?
I always wondered where to start learning reverse-engineering. Most people will say learn Assembly first. But from there on, there seems to be not much more concrete information online. Do people just figured it out by…
Thanks. "In-context learning" was the phrase I was looking for. Also, I found these 2 links pretty good too. 1. http://ai.stanford.edu/blog/understanding-incontext/ 2. http://ai.stanford.edu/blog/in-context-learning/…
I think some earlier NLP applications have something called "Unknown token", which they will replace any unseen word. But for recent implementations, I don't think they are being used anymore. It still baffles me why…
Not completely related. Does anyone know where I can find articles / papers that discuss why transformers, while acting as merely "next token predictor" can handle questions with: 1. Unknown words (or subwords/tokens)…
Thanks, that make sense. I think my comment was not worded properly. I was thinking "geometry properties = linear properties", what I really should say is: Why does the latent space has geometry properties where we…
where did ).exe came from? I thought you need to use VBscript of some sort to download a file from command line.