While you can replace the buttermilk with milk, I highly recommend using buttermilk. Not only does it impart great flavor and texture, it also helps with the rise. Buttermilk goes a long way in creating that great fluffy texture we all know and love in pancakes.