Battery swapping is a non-starter for many reasons. The biggest one is that it fundamentally requires an extreme level of standardization. But vehicles don't standardize well. Different shaped vehicles need different layouts. FWD needs a different weight distribution than RWD, and the battery is the heaviest part of your vehicle. Some vehicles want higher-end batteries (longer range, faster charging, etc) that cost a lot more, while others want cheaper batteries. A motorcycle requires a way smaller battery than a semi. And on and on -- not even considering how hard it is to make all manufacturers adopt the same *anything*. There's really no good way to standardize. And even if you did standardize, battery tech is a moving target. A couple years from now and something better will come out. So you need to stock multiple generations of inventory. And each unit is hundreds of pounds and massive.
Rapid charging is the way to go. And thankfully Nissan is encouraging it. What the Leaf supports is pretty minimal for Level 3 charging, but it's definitely a start!
As for batteries themselves: while the weight and bulk of EV batteries is a disadvantage, it comes with advantages as well. Namely, you have a great deal of flexibility about where you can put it. Under the floor, like in the Leaf. Under the seats, like in the MiEV. Up front, like in a number of EVs. In the trunk, like the Roadster. Down the center tunnel, like in the Volt. Wherever is optimum for your vehicle's weight distribution and space availability, you can put it there. This gives you more freedom in designing the shape of your vehicle. Expect shorter hoods on EVs twenty years in the future, as that's no longer a requirement.
The weight is a disadvantage in handling in a number of regards, but at the same time, it's great for rollover resistance, since it's usually kept low. For an extreme example, see the Commuter Cars Tango.