The Hammers have climbed to third in the Premier League after a memorable run of away wins against Arsenal, Liverpool and, on Saturday, leaders Manchester City.
The only blips in their fine start to the season were home losses to Bournemouth and Claudio Ranieri's Leicester, who they face at the King Power Stadium on Tuesday night.
And midfielder Payet, who has starred in the Hammers' attack with three goals so far this term, says manager Slaven Bilic has solved their early-season defensive wobbles.
"We know that in view of the potential going forward, we're capable of scoring at any given moment
If we're not conceding, that's going to bring us points and that's what's happened," the Frenchman told the club website.
"I might have been a little sceptical if you told me where we'd be, but we've shown that our position's not happened by chance
We continue to take points, that's the important thing.
"I wouldn't necessarily say (we're winning away) with ease, but it's true that we've got a defensive unit that's tough to budge.
"Of course we followed the manager's game plan to the letter
It's been some time now since those defeats at home that we took a close look at our defensive play."
Bilic will be without winger Michail Antonio, who is cup-tied, while right-back Carl Jenkinson will be checked over after limping off at City.
Angelo Ogbonna (hamstring), Alex Song (ankle) and Enner Valencia (knee) are still out
Bilic must decide whether to hand Andy Carroll his first start of the season after the striker made his comeback from his latest injury absence as a substitute in the 2-0 win over Newcastle a week ago
Source : PA
Source: PA