Answer: because the Americans saw it for the first time, assumed it could be fired from the knee, and came up with the name knee mortar. Their assumption was wrong.

Oh no.

I though it was because the small cannon thing when in stand up position is at knee level.

Because you have to kneel to be able to shoot it. BTW... Bye bye leg.