Comments on: Loading Netflix Dataset into SQL

By: Tom

Tom — Tue, 23 Jun 2009 15:58:31 +0000

Thanks Aislan, that worked…

Now on to the next bit (this is my first foray into any sort of programming, so progress is slow…)

Tom

By: Aislan

Aislan — Mon, 22 Jun 2009 13:48:43 +0000

I got the same problem, maybe the format of the file changed. Anyway, I removed the parser line and add a simpler one and it worked:

#removed
#id, year, title = movie.chomp.scan(/(\\d+),(\\d+|NULL),(.*)/).flatten
#added
id, year, title = movie.chomp.split(”,”)

Regards,
Aislan

By: Ilya Grigorik

Ilya Grigorik — Sat, 20 Jun 2009 16:14:41 +0000

Tom, have you tried adding some debugging output to the script? Is it picking up the file / reading in the lines correctly?

You might have to do some tweaking if Netflix changed their format.

By: Tom

Tom — Wed, 17 Jun 2009 13:58:05 +0000

No, sorry Ilya I wasn’t really clear there, running your netflix_movie_import.rb still returns:

exception: private method ‘gsub’ called for nil:NilClass.

By: Ilya Grigorik

Ilya Grigorik — Wed, 17 Jun 2009 12:48:48 +0000

Tom, glad to hear it’s working!

By: Tom

Tom — Wed, 17 Jun 2009 09:08:34 +0000

The first way I tried it - whihc gave the error message i left before was just to use “movie_titles.txt” . I tested whether ruby could read the file by running this:

my_file = ‘movie_titles.txt’

f = File.open(my_file, ‘r’)
file_data = f.read
f.close

puts file_data

which worked.

By: Tom

Tom — Wed, 17 Jun 2009 08:44:36 +0000

Ilya,

I am running the program from C:\Ruby\Ruby Programs , and the movie_titles.txt file is in that folder.

Should I run the ruby script just the same as the version on the website or should I change “../movie_titles.txt” to something else?

Thanks in advance for what may seem like a daft question - i’m new…

Tom

By: Ilya Grigorik

Ilya Grigorik — Wed, 17 Jun 2009 02:25:39 +0000

Tom, it sounds like the script just can’t find the files on disk. Are you sure the following file exists with respect to where you’re running the import process from? (../movie_titles.txt)

By: Tom

Tom — Tue, 16 Jun 2009 11:39:13 +0000

I’m new to both sql and ruby, but trying to have a go at playing with the netflix data.

when I run the netflix_movie_import.rb file I get the reply:

exception: private method ‘gsub’ called for nil:NilClass

and movies-import.sql file i get only has this in it:

USE `netflix`;
DROP TABLE IF EXISTS `movies`;
CREATE TABLE `movies` (
`id` int(5) NOT NULL default ‘0′,
`year` int(4) default ‘0′,
`title` varchar(255) NOT NULL default ”,
PRIMARY KEY (`id`)
) ENGINE=MyISAM DEFAULT CHARSET=latin1;

I take it it should have all of the movie titles in it as well?

Any ideas where I am going wrong? (I’m using windows XP and Ruby 1.8.6

Thanks

Tom

By: Ilya Grigorik

Ilya Grigorik — Fri, 06 Jun 2008 12:07:24 +0000

Awesome, thanks for sharing the tips Larry!