Ask HN: How are neural networks used for contextual multiarm bandit problems?

I am trying to understand how the algorithms behind Facebook, tiktok, etc work.

What function are the networks approximating?