'bugger' in the U.S. is a very inoffensive term used to describe something or someone small and perhaps annoying. For example, if you were chasing a little cousin around the house, you might say "I'll get you, you little bugger!"
In the UK, the verb 'to bugger' means 'to have anal sex with'...