How to display widgets on select pages only

I’m sure many have encountered this problem…you are building a website using WordPress, drag a widget into a sidebar, add your content, and then you noticed that every single page in your website that has that sidebar is now showing the widget everywhere. Frustrating at best, especially if you want to show it only on a few pages, but not all pages.