"Pounds from" is something like
when you have to do something and
you don't care much about the feelings of the other people.
"Pounds from my brothers, cause I need to leave." means "Sorry for my brothers, but I have to leave (now and I don't care of what you're saying!)."