True, but outside of the City of Victoria is Saanich, the largest municipality of the 13 that make up the Capital Regional District. Saanich has roughly the same climate and another ~110k.
Also, anecdotally, despite the smaller population, Victoria is a tourist destination and swallows cruise ships worth of passengers with ease. If you want to visit, come visit. You'll find all the amenities you need.