I had the same Problem. The solution is hidden somewhat deep within the Android Settings:
Android Settings:
'System'
'Languages and input'
'On-screen keyboard'
'Android Keyboard (AOSP)'
'Preferences'
'Vibrate on keypress': this can be turned off here