How do I make a directory readable only by Apache?

I have set up .htaccess in apache to make sure that users can't access files, but the server can, and since php is server side and only outputs what it is told to with the echo command it never gets sent to the client. I hope this has helped