That’s the simplest way to do it if you want complete control of the page layout. The frameworks just automate the “responsiveness” by limiting how you can lay out the page to what the particular framework knows how to deal with.
In fact for most you only need CSS - using JavaScript for making a page responsive is rarely necessary and usually indicates that you are not using the right CSS for the job.