Correct, it's typically called an "interconnection fee". All the utilities increased this fee within the last year here in Florida. Usually it's a minimum of $25-$30. What it really is, is just another way to fleece people out of money. The energy you send back during the day is of great benefit to the utilities and eases the strain on their power distribution. The utilities are fighting solar tooth and nail, and that should tell you all you need to know about how good solar is for the average consumer.
For the record, I don't mind the $25/month we pay, even though we ultimate produce all of the electricity we consume annually for our panels. There is a value in gaining electricity from our electricity provider when our solar isn't producing. For example, we consume ~80% of our electricity from our electricity provider during the four primary winter. Our bill is still $25 each of those months though, as we're sitting on a credit of electricity produced versus consumed heading into those months.
I view it as $25/month to have continual electricity. I'm good with that (as long as the cost remains reasonable).
If you live in a warmer climate, I could see viewpoints being fully aligned with yours.