Well, there are left leaning and right leaning libertarians. But one big reason that libertarians get lumped in with conservatives is because a lot of them tend to run on Republican tickets to make it easier to get into races (eg. Ron Paul). Being fiscally conservative is also a factor.