Can someone get my information from my bank account number?

I've been wondering this for a while - I use "electronic checks" often to pay bills - usually I either submit my routing and bank account number over the internet or over the phone to a customer service rep - could an unethical service rep record that information & later get my info using that account number?