Learning line by line