Ask HN: Video site framework

(Noob Question) What is the ideal framework, stack, language, algorithm or method to build a video site.

Something like a self hosted YouTube or Vimeo clone with minimal features.

Should I learn how to build a cms first or is there a simpler and elegant way to implement this without reinventing the wheel.