The Lights of New York (1928) was the first ever feature film that had complete sound sychronization.(Source: http://www.imdb.com/title/tt0019096/trivia) Thus it can be said to be the first complete "Talkie" feature film ever.

Directed by Bryan Foy, it was originally to be a two-reeler. However, it was changed to sound in the last minute. It cost $75,000 to produce, and grossed $2,000,000. (Source: http://www.imdb.com/title/tt0019096/trivia)

One of the famous dialogues from this movie is as follows (Source:http://www.imdb.com/title/tt0019096/quotes)

Hawk Miller: I want you guys to make him disappear.

Sam: Oh. You mean...

Hawk Miller: Take.....him.....for.....a.....ride. kill him