If you are one of the over 2.2 million Windows Insiders then you are part of a massive feedback engine that is helping Microsoft determine how Windows 10 is being used and what shape some of its features will take.
This information which is collected by automatic telemetry, interactive feedback while you are using Windows 10 and of course the Windows Feedback app where you can provide feedback in your own words, are providing Microsoft with mountains of data.
The telemetry data is just part of being a Windows Insider participant and there is no way to shut that down. I guess you could call that the price of admission into the Insider Program.
The other two methods of providing feedback, the Windows Feedback app and the interactive questions that pop up as you use the technical preview, are more voluntary methods of letting Microsoft know what works, what does not and why.
I am not finding the interactive feedback requests as I use the Windows 10 Technical Preview to be overwhelming at all and it is a very easy way to provide regular input into the different areas of the OS I might not otherwise think about providing feedback about.
You may not be aware of this but there is an option to control how frequently you will see these interactive feedback prompts while you are using the Windows 10 Technical Preview.
If you go to the Modern Settings App (search for Settings from the Start menu) and then go to Privacy and then Feedback you will be presented with a drop down box to select how often you are asked about your usage of the system for feedback purposes:
The options are very straight forward but I encourage you to keep this set at Automatically so you can continue to provide feedback to Microsoft on Windows 10.
Like I said earlier, this is actually a great way to provide input on areas you may not think about giving them feedback on and is another way to contribute as a Windows Insider.