Top Problems with LLM App Development

2 points by devilankur18 ↗ HN
Please share top 3 development/production problems that you have faced in order of priority.

3 comments

[ 4.9 ms ] story [ 18.2 ms ] thread
- getting access to bigger models - getting enough RPM once approved - testing prompts against each other to determine what is the winner in development
where problem do you think take the most time ?
1. the model's responses are unreliable 2. to make them reliable, you have to tell the model the answer 3. even though you now have a process to figure out the answer, you still have to use the model because the VP wants you to