Valve has added a frame rate counter overlay in its latest Steam beta client.
This means that you can quickly and simply check what FPS a game is running in without having to fire up FRAPS to manually check to see how your computer is running the specific you're playing.
Beta client features almost always make their way to the general release, so you probably won't have to wait to long if you're not a part of the beta program.
