Aston Villa kicked off the weekend's Premier League action with a tight 1-0 win over Norwich City, as Villa manager Paul Lambert made a victorious return to his former club.

Villa scored the only goal of the game through Libor Kozak, though the striker missed his first chance before tapping in the rebound from a Gabriel Agbonlahor assist.

Norwich were not without chances throughout the match, and both Robert Snodgrass and debutant Gary Hooper will be disappointed after the former missed a penalty early on and the latter had his shot tipped over the bar by Villa keeper Brad Guzan.

The Canaries pushed until the end, but this is an important away win for Villa, their first since the opening day of the Premier League against Arsenal. For Norwich the home loss was particularly deflating, and fans jeered Chris Hughton, who took over as manager at Carrow Lane from Lambert in the summer of 2012.

Villa will be anxiously waiting on news of an injury to striker Christian Benteke, who came off the pitch in the 30th minute with what appeared to be a groin problem.

Meanwhile, as the later games kicked off it was all action at St James' Park as Newcastle took on Premier League newcomers Hull City. Loic Remy scored his first and second goal for the north eastern club in the first half - his first the result of a header off Papiss Cisse and the second a successful rebound from Yohan Cabaye's shot which was partially blocked by Hull's James Chester.

But Hull were able to keep up with the summer signing with Robbie Brady finding the back of the net in the 26th minute to equalise 1-1 and Ahmed Elmohamady scoring just into the second half to bring the score to 2-2.

It wasn't all the visitors would produce for the day though, with Sone Aluko scoring with a brilliant volley from 18 yards out. With the score 3-2, Remy in particular pushed hard for an equaliser, hitting wide from just yards out.

Everton were looking to keep their hot streak going after a shock win against Chelsea last weekend by taking out West Ham at the Boleyn Ground but the Toffees found themselves on the back foot thanks to Ravel Morrison scoring his first goal for the east London club in the 33rd minute. The former Manchester United man was helped by a deflection off Phil Jagielka.

But Everton were able to find their feet in the second half and Leighton Baines showed why the club wanted to keep him so much in the summer with a superb free kick finding the top corner in the 62nd minute.

West Ham were able to retake the advantage thanks to a successful penalty kick from Mark Noble, but the Hammers man quickly undid his good work by receiving a red card for a second bookable offence. Down to 10 men, Baines scored once more to take Everton to 2-2 with their opposition and summer loan-signing Romelu Lukaku took the tally to 3-2 with a header that left the young star needing treatment after a collision with Joey O'Brien.

Liverpool played out a lacklustre first half with Southampton, with Brendan Rodgers bringing in Raheem Sterling for Iago Aspas at half time in the hopes of breaking the Reds' stat of not scoring a goal in the second half so far in the season. But the move had the opposite effect, with Southampton star Dejan Lovren getting past Daniel Agger to score the first goal of the game in the 53rd minute.

The Reds were unable to atone for their mistake and the game ended in their first loss of the season.

West Brom faced Sunderland at home and with the side having collected only five points from five games a home win was particularly important. Steve Clarke's men were at their dominant best against the Black Cats with Stephane Sessegnon scoring in the 20th minute and Liam Ridgewell adding a second in the 75th just after the Black Cats went down to 10 men.

A goal from Morgan Amalfitano in the 90th minute put West Brom in a comfortable position and Paulo Di Canio will have been left feeling particularly disappointed leaving with a 3-0 loss for his squad.

Elsewhere, Chelsea and Fulham kicked off in the late slot at Stamford Bridge, with both sides going goalless in the first half. On the back of Jose Mourinho's comments about Juan Mata the playmaker did not start and it was the Cottagers who looked more in control in the first 45 minutes with Darren Bent displaying the best chance for the side in that time.

But the second half was all about the Blues and the side were able to clock up two goals thanks to Oscar and John Obi Mikel. Chelsea looked to be in complete control and despite Martin Jol bringing on Adeb Taarabt the side were unable to convert and of their few chances.