Not sure about the tweeters, but I think that Toyota has a large screw in the arm rest of the door that primarily holds the panel on. The arm rest panel should pop up to reveal it. I'll check in mine when I get home tonight to be sure. I would also recommend getting a Haynes or Chilton manual. It will tell you everything you need to know.

all you have to do is pop open the small panel in the center of where the door handle is located, and remove the screw. Once that is done, then pop up the arm rest(back half first, then the front half where the lock and window control are located), then remove the two screws that hold it in place. Now depending on whether or not you have the 6 speaker system with the tweeters in the doors, the next steps vary. If you don't, then all you have to do is pry off the cover where they would be(located at the corner of the window, near the mirror). If you do have the tweeters in the doors, then you still have to pop off the cover, but you also have to remove the bolt that hold it into place(its held in place by a 10mm bolt). Once the cover and/or the tweeter is out of the way....then all you have to do is pry around the door panel, which is held in place by 8 plastic clips. Once the clips are out, then just lift the door panel straight up, and lay it too the side. And that's all there is to it!