I mostly do the same. My workflow is usually like this:
1. Supply CC with a simple user story with light spec / business logic, asking it to write a specification for the feature and ask me any questions that need to be answered to make it complete.
2. Build up the context with all relevant files that I want to use. In Ruby on Rails it means refercing models, views and controllers that show the structure we are going to use.
3. Write the code and tests.
Not sure the complexity of your app but mine's pretty complex with many daily active users. One-shot rarely works unless it's a simple feature/chore and I tell CC exactly what to do, which functions to touch, and how (which defeats the purpose).
