Simple Distraction

What it does:

This lightweight mod allows characters of any class to create distractions similar to the Minor Illusion cantrip or cat familiar's Meow by throwing objects or shooting arrows at the ground while sneaking.

Try using this alongside my Simple Sap mod for more chicanery.

How it works:

As soon as any player-controlled character begins sneaking outside of combat, they'll receive a status condition that causes all of their basic ranged weapon attacks and thrown items to create an audible disturbance. NPC's within the affected radius will direct their attention toward the source of the noise for about 30 seconds or until the disturbance has been investigated. Attempting to create another distraction within 2 rounds (about 12 seconds) will risk giving away the player's position. Ranged attacks require the character have proficiency with the weapon being used, but any thrown object will work.

In addition, while the Simple Distraction status is active, throwing objects will not break stealth unless they cause damage, like normal ranged attacks.

Compatibility:

Should work with everything, since it uses a script to dynamically apply the status to any player-controlled character.

Is it safe to uninstall?

The scripting is lightweight and doesn't leave anything behind, but to be sure you should probably save with none of your characters sneaking before uninstalling.