(kA mod 1) returns the fractional part of kA.
In this case the choice of m is less critical. Typically choose a power of 2 to simplify arithmetic.
However, the choice of A does matter. A recommendation is to use
The worst choice is A = 0.5, because in this case every key hashes to or 0.