Its Hard And the "hold just like you are playing a game" method doesnt work for me.Is there any other way to remove it?

What?
Well first off what type is it? Big or s?
If it's big just flex the plastic back and forth. You will hear it start to crack but that just means it's working. (I have done this myself)

If it's an S I hear you can stick it in the frezzer and smack the back of it to pop it out.

On my big controller I ended up breaking the clear jewel by tryign the "heating it with a blowdryer for 15 minutes" and "twisting while in the gameplay hold" method. I ended up finding a little clip under the hump from the underside. I tried later on with a different controller, just try and dremmel all the black plastic out from behind it . There's space between the XBOX logo and the actual clear plastic. I ended up ruining my XBOX logo (got cuts from the dremel), but I didn't get the dremel far enough in to damage my clear/jewel plastic. It looks great!

its the original big controller and unfortunately i dont have a dremel to work with!