Heat olive oil in a large skillet over medium-high heat. Sprinkle fish with salt and pepper. Add half of fish to skillet and sauté until just opaque in center, about 3 minutes per side. Transfer fish to platter. Repeat with remaining fish.
Add parsley and crushed red pepper to same skillet; sauté 1 minute. Add tomatoes, olives, and garlic; sauté until tomatoes are soft and juicy, about 2 minutes. Season sauce with salt and pepper. Spoon over fish.