Ask HN: How do you deploy Python-based LangChain or LlamaIndex code on prod? 2 points by pinglin 1y ago ↗ HN
[–] efriis 1y ago ↗ Erick from LangChain here - would recommend either deploying with LangGraph Cloud or anywhere that deploys a FastAPI easily.LangGraph Cloud: https://langchain-ai.github.io/langgraph/cloud/ Example (chat-langchain): https://github.com/langchain-ai/chat-langchain?tab=readme-ov...FastAPI example with LangServe (old chat-langchain implementation): https://github.com/langchain-ai/chat-langchain/blob/langserv...Or just use regular fastapi endpoints instead of langserve.add_routes with a fastapi server: https://fastapi.tiangolo.com/
1 comment
[ 3.4 ms ] story [ 4.4 ms ] threadLangGraph Cloud: https://langchain-ai.github.io/langgraph/cloud/ Example (chat-langchain): https://github.com/langchain-ai/chat-langchain?tab=readme-ov...
FastAPI example with LangServe (old chat-langchain implementation): https://github.com/langchain-ai/chat-langchain/blob/langserv...
Or just use regular fastapi endpoints instead of langserve.add_routes with a fastapi server: https://fastapi.tiangolo.com/