So Steve trusts no one but Apple. Seem legit. ;)
But seriously, you knew that, at some point, Apple had to transfer the details of the transaction to your credit card company as the intermediary. And you must have known they'd need your credit card number for that to make any sense.
So did you think Apple didn't know your credit card number?
Or did you think your bank wouldn't need the transaction details as they do for any credit card transaction, including the detail that you paid via pay?
Or did you think that as an intermediary, Apple would have no relationship with the financial institutions who they send your transaction data to?
I don't think you're crazy, I just think you might not have fully thought this out yet. No problem with that, mind you, I do that a fair bit myself from time to time.
Well, never mind, consider my questions rhetorical. The best of the rest of your day to you! :)