Well, id say just work at it
Because there are ways to work around not having a dominating fastball--look at Byrd!
Besides, if you start doing long toss in the offseason, and working on it, you could add some speed.
What other pitches do you have?
And are they sharp//can you locate them well?