Verdict: False
Wi-Fi bars mainly describe the wireless connection between your device and the nearby Wi-Fi equipment. They do not guarantee that the router itself has a fast path to the internet.
A useful test
Compare performance close to the router and in the problem location, then compare more than one device. This helps separate coverage issues from ISP or device-specific problems.