I haven't played it for a while, but I think I found car batteries in warehouses and hardware stores. As for regular batteries, I can't remember if they can be found there too.
To get batteries just scavenge in areas that have components listed as loot (example:-Warehouse, Hardware Store, Office) and for car batteries you can loot streets as well.