Yes the water is safe ! Some people prefer to drink it directly from the lake and some people prefer to boil the water before drinking it, putting some in containers in the fridge (easiest way!).
Other options are: You can use water cleaning tablets.
You can bring a filter (they are around $35 or $45 to purchase) or you can bring in your own water but remember you weight limit on the plane?