What rubbish.
No one can get anything out of your bank account with only your account number.
Many businesses publicly print their account numbers, sort codes, & swift codes so customers can make bank transfers.

Regards

Jim