It's quite simple. I opened my 3gen iPod quite easily. It's the same as the 4th gen.
You can take something liek a .73 mm guitar pick or a SMALL screw driver
Then, you put it down on the right side, around 1/4 from the bottom. You'll know when you hit the right spot, it'll pop it out a little...