Meteor Incremental CSV Package (Deprecated)

Process a CSV file incrementally on either the client or server. Useful when a file is large or you can't (or don't want to) store it first.

Installation:

meteor add jeffm:incr-csv

Documentation:

27 July 2015 - This package is deprecated.

Constructors:

IncrementalCSV(function onRecord(row, index));
IncrementalCSV(object options);

OnRecord is called once for each row and is passed the parsed record as an array of strings and the zero-based ordinal index of the row.

Available options and defaults are:

  quoteCharacter:  '"',                       // length must be 1
  fieldSeparator:  ',',                       // length must be 1
  recordSeparator: '\r\n',                    // length must be 1 or 2
  onRecord:        function (row, index) {}

Methods:

  push(string);

Push a string into the parser for processing. The string should be a valid CSV fragment, but does not need to be a complete row.

  finish();

Since the CSV specification allows the last line of the input to be unterminated calling finish() will flush any remaining data.

Example:

Incrementally parse a CSV file uploaded using Chris Mather's EventedMind File Uploader.

if (Meteor.isServer) {
  // array of parsers for multi-file upload.
  var csvs = {};

  Meteor.methods({
    'uploadFile': function (file) {
      // create parser on first block
      if(file.start === 0) {
        csvs[file.name] = new IncrementalCSV(
          function(rec, idx) {
            // process your data here.
            // idx is zero-based, skip if there's a header.
            console.log(idx, "->", rec);
          }
        );
      }

      // convert data to a buffer and
      // send it as a string to the parser
      var buffer = new Buffer(file.data);
      csvs[file.name].push(buffer.toString());

      // end of file. flush the parser and cleanup
      if (file.size === file.end) {
        csvs[file.name].finish();
        delete csvs[file.name];
      }
    }
  });
}

Credit:

The parser is adapted from cvsToArray v2.1 by Daniel Tillin:

https://code.google.com/p/csv-to-array/