Opened 6 years ago

Closed 4 years ago

#2647 closed project-idea (wontfix)

Import old Pickles

Reported by: dustin Owned by:
Priority: minor Milestone: 0.9.0
Version: Keywords:

Description (last modified by dustin)

The most likely plan for data from 0.8.x implementations is to ignore it. However, it would be great for users if data in build pickles could be easily imported into the database.


The outline of this project is pretty clear: if the user requests it, read all of the 0.8.x data from pickles and logfiles, and write it into the database. The tricky bits will be about handling subtle incompatibilities between the pickle data format and what's in the database, as well as encoding errors (most of the data in pickles are bytestrings, while everything in the DB is unicode).

A good GSoC application would talk about these edge cases:

  • What are some of the subtle incompatibilities? (this will require looking at what's in the pickles and in the database) How will you handle them?
  • How will you handle converting bytestrings into unicode strings?
  • When a user's data import fails because of some error we haven't anticipated, what happens? Is their database corrupt? Can they re-run the script once they've fixed the error? How will the script report progress?

There's a lot of design work here, and we will need to see much of it in the application. Part of the decision to accept the proposal will be on the quality of the design, so make it good! Keep in mind that you can ask for feedback on your design before the applications are due.

Change History (3)

comment:1 Changed 6 years ago by dustin

  • Description modified (diff)
  • Type changed from task to project-idea

comment:2 Changed 5 years ago by dustin

  • Priority changed from major to minor
  • Summary changed from [nine] Import old Pickles to Import old Pickles

This needs to happen in 0.9.0 or never, really -- we don't want to be importing data in a later version.

comment:3 Changed 4 years ago by dustin

  • Resolution set to wontfix
  • Status changed from new to closed

We've decided on "never", particularly since we're dropping support for pickles so that we can move to new-style classes.

Note: See TracTickets for help on using tickets.