What info's given away by giving Android apps access to files, folder and media?

A lot of apps ask for this permission. Does this mean that they can basically read (and potentially view) all my phone data?