Alaska was admitted to the Union as the 49th state. The "Lower-49" refers to the order of admission. Hawaii is the 50th state, which obviously is not part of the Lower-49...
"Lower" in the case of Lower-49 has nothing to do with geography or latitude.
This img doesnt contain Canada or Mexico too