Have internet connection but no internet access?

[Mustang Tom]

You might start with ISP, and have them check the modem. Since you have a new router any chance you printed the instructions. There you should what colors the router lights should be. It any are red there is a problem. It modem is connected the cable co. check it's lights as well if one is red this could also indicated a problem from the ISP .

Did you do the unplug um and plug em back trick? Unplug both modem and router, replug modem first, after all it's come back to green, replug the router back in. After it restarts see if the internet has returned.
Remember the router may connect to computer, but if the modem is acting up the internet may be getting accessed.